Embed Size (px)
Citation preview
© 2015 IDERA, Inc. All rights reserved.Proprietary and confidential.
WHAT IS THE SSIS CATALOG AND WHY DO I CARE?A Hitchhiker's Guide to SSISDB
2© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
ABOUT ME Sr. Product Manager with Idera
• Performance Monitoring of Microsoft BI stack (SQL BI Manager)
• Backup and Recovery of Microsoft SQL Server (SQL Safe)
Geek Sync Presenter Blog Contributor HSSUG,ASSUG presenter Over 25 years experience
• BI, Data Architect• DBA• Developer• Data Analyst
3© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
AGENDA
Introduction SSIS Catalog Overview SSIS Project Deployment Execution and Logging SSISDB Practical Examples
© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential. 4
SSIS CATALOG OVERVIEW
5© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSIS CATALOG
Catalog Creation Catalog Objects
• Projects• Packages• Parameters• Environments
Companion database SSISDB
6© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSIS CATALOG
SQL Server Database Engine
Integration Services Catalog
Folder
Projects Environments
Parameters EnvironmentReferences Packages Environment Variables
7© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSIS CATALOG
© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential. 8
SSIS PROJECT
9© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSIS PROJECT
Parameters• Assigns values at time of execution• Package parameters
• package scope• Expressions allowed
• Project Parameters• Shared among all packages in the project• Literal values
© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential. 10
PROJECT DEPLOYMENT
11© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
DEPLOYMENT
Project Based• Visual Studio• SSMS• isdeploymentwizard.exe
Versioning Parameters Environments Environment variables
• Assign to parameters during package execution
• Configurable
12© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
DEPLOYMENT
Environments• Use with project parameters• Multiple configurations (test, prod, dev,
etc.)
13© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
DEPLOYMENT
Visual Studio Example
• Project level connections
• Parameters• Parameterized
connections
© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential. 14
EXECUTION AND LOGGING
15© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
EXECUTION AND LOGGING
Execution Methods• SSMS• dtexec• SQL Server Agent• Stored Procedure (SSISDB database)
16© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
EXECUTION AND LOGGING
Logging Levels• None• Basic (default)
• All events except custom and diagnostic events
• Performance• OnError and OnWarning events• Performance Statistics
• Verbose• Kitchen Sink
• Customized (SSIS 2016)
17© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
EXECUTION AND LOGGING
Examples
18© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
EXECUTION AND LOGGING
Stored Procedure Example Execution Reporting
• Logging Dependent• Default Reports• Custom Reports
© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential. 19
SSISDB
20© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSISDB
Catalog Database• Tables
• Execution information• Configuration information
• Views• Stored Procedures
• Package Execution• Administration• Maintenance
21© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSISDB
• executions - executables inside the package, parameter values and data taps.
• executables – all executable objects within a package.
• executable_statistics – data about all executable objects
• execution_component_phases – log referring to each data flow
• execution_data_statistics – total rows sent through the data flows
• execution_parameter_values – parameter values at time of execution
22© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
SSISDB
• operations - information about each operation run in the SSIS catalog.
• validations– validation of projects which contains folder name and package name.
• event_messages – all messages passed during events
• operation_os_sys_info – cpu count, available physical memory and total physical memory at the time of operation
• event_message_context - conditions that are associated with execution event messages
23© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
Demo
24© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
THANKS!Any questions?You can find me at:
Twitter: @MSBI_StanEmail: [email protected]
25© 2015 IDERA, Inc. All rights reserved. Proprietary and confidential.
Try SQL BI Manager free for 14 days!
www.idera.com
