If you can't read please download the document
Upload
melina-west
View
215
Download
0
Embed Size (px)
Citation preview
Please note that the session topic has changed
Please note that the session topic has changed. Please visit My
Ignite for current session description. Whats new in SQL Server
2016 Integration & Master Data Services
Jimmy Wong DAT 325 Overview This session covers the major
improvements in SQL ServerIntegration Services (SSIS) & Master
Data Services (MDS) in theSQL Server 2016 release. There will be
slides, and demos. There will be happy faces (if we did it right).
System Center Marketing
4/27/2017 Focus Areas Performance Manageability Connectivity
Customer Feedback 2012 Microsoft Corporation. All rights reserved.
Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. SQL Server
2016 Master Data Services (MDS) Master Data Services in SQL
2016
System Center Marketing 4/27/2017 Master Data Services in SQL 2016
Performance and Scale Modeling and Management Security and
Administration 2012 Microsoft Corporation. All rights reserved.
Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Do more.
Faster. Massive improvements to performance and scalability
Microsoft Ignite 2015 4/27/2017 7:58 AM Do more. Faster. Massive
improvements to performance and scalability Capability Heavy
performance optimizations for theMDS backend system. Scale entities
to100 million members (and beyond). Benefits 15x performance
increase for Excel Faster entity based staging Reduce the overhead
by optimizingsecurity check 15x 2015 Microsoft Corporation. All
rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. System
Center Marketing
4/27/2017 Do more. Achieve more. Transaction log retention
Configurable settings for retaining the MDS transaction history
table to enable automatic truncation. Improved hierarchy management
Simplified the various hierarchy types, and made it easier to find
and manage unused members. Manage hierarchies from Excel. Improved
business rule experience Create and manage business rules from
Excel, and use custom SQL logic as part of yourbusiness rules.
Addition of NOT operator, and conditional ELSE logic. Historical
subscription views See attribute change history in an easy to
consume format. Custom and compound indexes Add a custom index on
commonly used attributes to improve overall performance. Also
allows combination of multiple attributes to create a compound
index. Modeling and Management 2012 Microsoft Corporation. All
rights reserved. Microsoft, Windows, and other product names are or
may be registered trademarks and/or trademarks in the U.S. and/or
other countries. The information herein is for informational
purposes only and represents the current view of Microsoft
Corporation as of the date of this presentation. Because Microsoft
must respond to changing market conditions, it should not be
interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. Entity Sync Share common entities between models
Capability Benefits
Allows entities to be shared across models onthe same MDS instance.
You can configure onetime, on-demand, or continuous sync ofmembers.
Benefits Reuse of common entities Many-to-Many Relationships
Create M2M relationships in an derived hierarchy Capability Goes
beyond the One-to-Many relationshipmapping normally implied by
derivedhierarchies, allowing you to model Many-to- Many
relationships. Benefits Allows modeling of M2M relationships
Replaces Collections Simple Approval Flows Require approval before
changes are made to an entity Capability This feature allows the
model administrator tospecify that changes to a give entity
requireapproval. Changes will be batched (ChangeSet), and only
committed once they areapproved. Benefits Create (single level)
approval flows Review changes before an entity ismodified Do more.
With confidence.
System Center Marketing 4/27/2017 Do more. With confidence.
Security and Administration Granular security permissions Allows
permissions to be set around read, write, create, and delete.
Multiple administrator roles Support for Super User and Model Admin
roles allows for multiple system administrators, and model level
admins. 2012 Microsoft Corporation. All rights reserved. Microsoft,
Windows, and other product names are or may be registered
trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and
represents the current view of Microsoft Corporation as of the date
of this presentation. Because Microsoft must respond to changing
market conditions, it should not be interpreted to be a commitment
on the part of Microsoft, and Microsoft cannot guarantee the
accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. User
Experience Improvements
Capability Redesign of the MDS web portal. Benefits Modern look and
feel Cross Platform Usability improvement foradministration tasks
Hierarchy managementsimprovements Updated Excel Add-in Capability
Benefits
General usability and performanceimprovements. More functionality
movingfrom the Web Portal to the Excel add-in. Benefits Manage and
edit business rules fromExcel Change display names for DomainBased
Attributes Filter attribute values in Domain BasedAttributes based
on another attribute(using hierarchies) MDS SQL 2016 at a glance
Performance and Scale Modeling and Mgmt
Security and Admin Excel add-in 4-8x perf increase for SQL Server
2012 and SQL Server Up to 15x in SQL 2016. Entity based staging
Loading data into MDS is now % faster than SQL Server 2014. Model
deployment Faster deployment, and removed size limitations
whendeploying models with data. Custom indexes Create non-clustered
indexes on one or more attributesto improve query performance.
Transaction log retention Configurable settings for retaining the
MDS transaction history table to enable automatic truncation.
Entity sync relationship Share entities and data between models.
Many to many relationships Create derived hierarchies that support
many-to-manyrelationships. Attribute filters Filter domain based
attribute values based on anotherattribute. Business rule
extensions Apply user defined SQL scripts as business rule
conditionsand actions. Granular security permissions Allows
permissions to be set around read, write, create, and delete.
Multiple administrator roles Support for Super User and Model Admin
roles allows for multiple system administrators, and model level
admins. Smarter caching of permissions Reduces the overhead of
adding member and attributelevel security settings. Member revision
history Track change history of members (type 2) throughspecialized
subscription view. Change sets and approval Use change sets to save
pending changes. SQL Server 2016 Integration Services (SSIS) System
Center Marketing
4/27/2017 Three Focus Areas Manageability Connectivity Usability
& Productivity BIG DATA 2012 Microsoft Corporation. All rights
reserved. Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. System
Center Marketing
4/27/2017 Do more. Achieve more. Better deployment Incremental
project deployment Always On support for the SSIS Catalog Better
debugging Column names included in error outputs Customized logging
levels in the SSIS Catalog Better package management Package
templates Automatic MaxBufferSize for Data Flow Task Manageability
2012 Microsoft Corporation. All rights reserved. Microsoft,
Windows, and other product names are or may be registered
trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and
represents the current view of Microsoft Corporation as of the date
of this presentation. Because Microsoft must respond to changing
market conditions, it should not be interpreted to be a commitment
on the part of Microsoft, and Microsoft cannot guarantee the
accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Always On
support for SSISDB
Server & Tools Business 4/27/2017 Always On support for SSISDB
High Availability for the SSIS Catalog Capability DBA can set up
Always On availability groupsfor the SSIS Catalog Benefits
Consistent with SQL Server HighAvailability setup flow Works for
any user database whichcontains encrypted data based ondatabase
master key Support SSISDB upgrade even when it hasbeen added to the
HA group Easy to configure 2012 Microsoft Corporation. All rights
reserved. Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Error Column
Name Support
Server & Tools Business 4/27/2017 Error Column Name Support No
need to manually figure out the column name Capability Developer
can see the error column name thedata viewer Developer can also see
the IntToString lineageID mapping in the log Developer can also
programmatically get thecolumn name using the lineage ID Benefits
No more manual work to figure it out Speed up and simplify
debugging 2012 Microsoft Corporation. All rights reserved.
Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Custom
Logging Level & Log Reader Role
Server & Tools Business 4/27/2017 Custom Logging Level &
Log Reader Role Customize your SSIS log with exactly what you need
Capability Define custom logging levels for packageexecutions
within the SSIS Catalog Additional ssis_logreader role to see the
SSIS logs(no need to be DBA / Admin) Benefits Capture the exact
information you need Flexibility of roles and reporting 2012
Microsoft Corporation. All rights reserved. Microsoft, Windows, and
other product names are or may be registered trademarks and/or
trademarks in the U.S. and/or other countries. The information
herein is for informational purposes only and represents the
current view of Microsoft Corporation as of the date of this
presentation. Because Microsoft must respond to changing market
conditions, it should not be interpreted to be a commitment on the
part of Microsoft, and Microsoft cannot guarantee the accuracy of
any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO
THE INFORMATION IN THIS PRESENTATION. Server & Tools
Business
4/27/2017 Package Template Give you code reusability Capability
Save part of the package as template and reuse it in thedesign of
other packages Benefits Reuse control flow logic across packages
Simplify package maintenance 2012 Microsoft Corporation. All rights
reserved. Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Automatic
MaxBufferSize in Data Flow Task
Server & Tools Business 4/27/2017 Automatic MaxBufferSize in
Data Flow Task Suitable max buffer size is calculated for you
Capability Set AutoAdjustBufferSize to TRUE to automatically
calculate thebuffer size for your data flow task: BufferSize =
DefaultBufferMaxRows (design time) * RowSize (runtime) Benefits Max
Buffer Size can go up to 2GB-1 Easier to size your buffers Improved
performance when working with ColumnStore inSQL Server 2012
Microsoft Corporation. All rights reserved. Microsoft, Windows, and
other product names are or may be registered trademarks and/or
trademarks in the U.S. and/or other countries. The information
herein is for informational purposes only and represents the
current view of Microsoft Corporation as of the date of this
presentation. Because Microsoft must respond to changing market
conditions, it should not be interpreted to be a commitment on the
part of Microsoft, and Microsoft cannot guarantee the accuracy of
any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO
THE INFORMATION IN THIS PRESENTATION. Do more. With more
sources.
System Center Marketing 4/27/2017 Do more. With more sources.
Expanded Connectivity More on-premises connectivity HDFS Connectors
Hadoop HIVE/PIG Tasks Excel 2013 / 2016 support OData V4 Support
Teradata / Oracle updates Execute SQL Task to run analytics with R
in SQL Server 2016 More cloud connectivity Azure Storage Connectors
HDInsight HIVE/PIG Task BIG DATA 2012 Microsoft Corporation. All
rights reserved. Microsoft, Windows, and other product names are or
may be registered trademarks and/or trademarks in the U.S. and/or
other countries. The information herein is for informational
purposes only and represents the current view of Microsoft
Corporation as of the date of this presentation. Because Microsoft
must respond to changing market conditions, it should not be
interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. Azure Storage Connectors
Server & Tools Business 4/27/2017 Azure Storage Connectors
Enables hybrid ETL Capability Move files or read and write data
Azure Blob storage Benefits Extend existing ETL pipeline with cloud
storage, orcloud based SSIS execution through Azure VMs Data
preparation for cloud compute services such asHDInsight or Azure
Machine Learning Data archival to cloud storage Easy enumeration of
files in blob storage 2012 Microsoft Corporation. All rights
reserved. Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Server &
Tools Business
4/27/2017 HDFS Connectors Enables data movement between Hadoop BIG
DATA Capability Move data to and from HDFS as source or destination
Benefits Extend existing ETL pipeline with on-premises Hadoopand
other big data processing Data preparation for big data compute
services such asHadoop or Spark 2012 Microsoft Corporation. All
rights reserved. Microsoft, Windows, and other product names are or
may be registered trademarks and/or trademarks in the U.S. and/or
other countries. The information herein is for informational
purposes only and represents the current view of Microsoft
Corporation as of the date of this presentation. Because Microsoft
must respond to changing market conditions, it should not be
interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. Server & Tools Business
4/27/2017 HDInsight Tasks Orchestrate and manage HDI clusters
Capability Trigger HDInsight jobs and manage your HDInsightcluster
life cycle directly from SSIS Benefits Integrate big data
processing into your existing ETLflows Filter and process raw
cloud-born data using HDIbefore moving it to your data warehouse
Dynamically create your HDI cluster on demand, andremove it once
processing is complete Combine with Azure Storage connectors to
extendyour ETL environments to the cloud 2012 Microsoft
Corporation. All rights reserved. Microsoft, Windows, and other
product names are or may be registered trademarks and/or trademarks
in the U.S. and/or other countries. The information herein is for
informational purposes only and represents the current view of
Microsoft Corporation as of the date of this presentation. Because
Microsoft must respond to changing market conditions, it should not
be interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. Server & Tools Business
4/27/2017 Hadoop Tasks Orchestrate and manage on-premises Hadoop
BIG DATA Capability Submit Hive and Pig jobs to your Hadoop cluster
directlyfrom SSIS Benefits Integrate big data processing into your
traditionalETL flows Combine with HDFS connectors to extend your
ETLenvironments with big data processing power Leverage the power
of Hadoop as part of your DataWarehouse loads 2012 Microsoft
Corporation. All rights reserved. Microsoft, Windows, and other
product names are or may be registered trademarks and/or trademarks
in the U.S. and/or other countries. The information herein is for
informational purposes only and represents the current view of
Microsoft Corporation as of the date of this presentation. Because
Microsoft must respond to changing market conditions, it should not
be interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. Server & Tools Business
4/27/2017 OData V4 Support Connect more with applications out of
the box Capability Use the same OData source data flow task to
connect toOData V4 feed Benefits Same OData source UI, no change
Automatic detection of OData version 2012 Microsoft Corporation.
All rights reserved. Microsoft, Windows, and other product names
are or may be registered trademarks and/or trademarks in the U.S.
and/or other countries. The information herein is for informational
purposes only and represents the current view of Microsoft
Corporation as of the date of this presentation. Because Microsoft
must respond to changing market conditions, it should not be
interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. System Center Marketing
4/27/2017 Do more. Faster. Usability & Productivity Faster
Design Experience Multi-version support in SSDT Many designer
improvements Faster Install Experience IS designer is now part of
SSDT install Faster Management Studio Experience Performance
improvement on SSIS Catalog views 2012 Microsoft Corporation. All
rights reserved. Microsoft, Windows, and other product names are or
may be registered trademarks and/or trademarks in the U.S. and/or
other countries. The information herein is for informational
purposes only and represents the current view of Microsoft
Corporation as of the date of this presentation. Because Microsoft
must respond to changing market conditions, it should not be
interpreted to be a commitment on the part of Microsoft, and
Microsoft cannot guarantee the accuracy of any information provided
after the date of this presentation. MICROSOFT MAKES NO WARRANTIES,
EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION. Multi-Version Support in SSDT
Server & Tools Business 4/27/2017 Multi-Version Support in SSDT
Handle different SSIS package versions with a single designer
Capability Author, execute, deploy and debug multiple versions
ofSSIS package from a single version of SSDT Designer. Benefits No
need to maintain multiple version of VisualStudio, SSDT designer to
manage different versionsof SSIS packages Enjoy the benefits from
the latest visual studio shelland SSDT designer even when they are
working onolder version of SSIS package Support SSIS 2012, SSIS
2014 and SSIS 2016 2012 Microsoft Corporation. All rights reserved.
Microsoft, Windows, and other product names are or may be
registered trademarks and/or trademarks in the U.S. and/or other
countries. The information herein is for informational purposes
only and represents the current view of Microsoft Corporation as of
the date of this presentation. Because Microsoft must respond to
changing market conditions, it should not be interpreted to be a
commitment on the part of Microsoft, and Microsoft cannot guarantee
the accuracy of any information provided after the date of this
presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR
STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Usability
& Productivity
SSIS SQL 2016 at a glance Manageability Connectivity Usability
& Productivity Incremental Project Deployment Incrementally
deploy projects to the SSIS Catalog. Error Column Name Support See
lineage identification string from the log / data viewer Custom
Logging Level Customize your own logging level for more flexibility
Package Template Achieve code usability by creating template part
Always On Support Build your SSIS server farm with high
availability Automatic MaxBufferSize Automatically calculate the
suitable max buffer size for you Azure storage connectors Move data
to/from Azure storage for hybrid data scenarios. HDInsight Tasks
Orchestrate HDInsight jobs and manage your HDInsight cluster life
cycle directly from SSIS. HDFS Connectors Mover data to/from
Windows File system and HDFS Hadoop tasks Orchestrate HIVE jobs and
manage the lifecycle of your on- premises Hadoop from the SSIS
Control Flow. Expanded Connectivity OData V4, Excel 2013/2016,
Teradata/Oracle Execute SQL Task to run analytics with RPrepare
data for model training and trigger R prediction Multi-Version
Support in SSDT Ability to author, execute, deploy and debug
multiple versions ofSSIS packages from a single version of SSDT.
Designer Improvement A number of enhancement and fixes on the
designer capabilitiessuch as drag and drop, resizing, etc Unified
Install for SSDT Faster and easier to install Catalog View Perf
Improvement Make viewing the SSIS catalog view faster Demo - SSIS
2016 Complete your session evaluation on My Ignite for your chance
to win one of many daily prizes. Continue your Ignite learning
path
Microsoft Ignite 2015 4/27/2017 7:58 AM Continue your Ignite
learning path Visit Microsoft Virtual Academy for free online
training visit https://www.microsoftvirtualacademy.com Visit
Channel 9 to access a wide range of Microsoft training and event
recordings https://channel9.msdn.com/ Head to the TechNet Eval
Centre to download trials of the latest Microsoft products 2015
Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO
WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN
THIS PRESENTATION.