44
Data Warehouse ETL OLAP Data Quality Reporting Services Analysis Services BI Methodology BI Lifecycle Skill Improvment Data Profiling Architecture Dimensional Modeling BI Strategy Patterns Consulting Coaching Coaching MDM The Developer Side of Master Data Service 2012 by Sascha Lorenz (PSG) The sequel of the Developer Side of Microsoft Business Intelligence!

The Developer Side of SQL Server Master Data Services

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

The Developer Side of Master Data Service 2012

bySascha Lorenz (PSG)

The sequel of the Developer Side of Microsoft Business Intelligence!

Page 2: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

About me…

• Sascha Lorenz• Lead Consultant, Coach & Trainer• PSG Projekt Service GmbH, Hamburg• Our Customers are German Federal Agencies, Shipping

Companies and Banks (Fonds Administration & NPL)• Support Microsoft as vTSP in EPG engagements• Engaged in German PASS Chapter (Hamburg)

Follow me on Facebook, Twitter (@SaschaLorenz) and http://saschalorenz.blogspot.com

Page 3: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Agenda

• What is MDS? (Short Version, really…)• Why again the Developer Side of something?• How to get data in and out MDS?– Staging– Direct Access– WCF

• Custom Workflow / External action

Page 4: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

What is MDS?

• A Master Data Management Solution

• What are Master Data ?

Page 5: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

What is MDS?

Page 6: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

What is MDS?

Page 7: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Why talking about a developer side of Master Data Services?

• MDS is the first service in SQL Server with a clear business process !

• MDS needs no customization & coding to use !

• MDS is a great tool for (BI/EIM) developer !

Page 8: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Why talking about a developer side of Master Data Services?

• Use cases for the developer side:– Better integration in data/information flows &

business processes– Integration in existing front- & backends (ERP, HR,

CRM…)– Building your own frontends – For much more automation…

Page 9: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Objects in MDS

• Meta Data like– Models– Entities– Attributes– Hierarchies– Versions– Security

• Members

Page 10: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Transactions

• [„MDS“].[mdm].[tblTransaction]

• Very useful feature of MDS ! Record all changes of the member data.

• You can use it for your SCD Type 2 challenge !

Page 11: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Access the schema

[„MDS“].[mdm].[tblModel][„MDS“].[mdm].[tblEntity][„MDS“].[mdm].[tblAttribute]

[„MDS“].[mdm].[viw_SYSTEM_“Model“_“Entity“_CHILDATTRIBUTES]

Page 12: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Access the schema

Custom attributes ,T.[Name] AS [Name] ,T.[Code] AS [Code] ,T.[uda_69_2025] AS [A1] ,T.[uda_69_2026] AS [A2] ,T.[uda_69_2027] AS [A3] FROM mdm.[tbl_19_69_EN] AS T

Page 13: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Demo Access the schema

Page 14: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Staging Tables

• New feature in SQL 2012• stg schema• batch tag (I love batches)– But, you can also change single member !

• Later is no way to change the name !

Page 15: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Import Types

Import Type Operation

0 Merge Optimistic

1 Insert2 Merge Overwrite

3 Delete

4 Purge

5 Delete Automatic

6 Purge Automatic

Page 16: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Import Types

INSERT INTO stg.E1_leaf ( importtype , importstatus_id , BatchTag , Code , name , A1 , A2 , A3 )VALUES ( 0 , 0 , 'Update Member' , ‚3' , null , null , 'M8' , null );

INSERT INTO stg.E1_leaf ( importtype , importstatus_id , BatchTag , Code , name , A1 , A2 , A3 )VALUES ( 1 , 0 , 'New Member' , '3' , 'Name 3' , null , 'M2' , 'M3' );

Page 17: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCF

• Our Models / Schema are „Meta Data“ !

Page 18: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCF

C:\Program Files\Microsoft SQL Server\110\Master Data Services\WebApplication\web.config.xml

Page 19: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCF

Page 20: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCF

Page 21: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFNew Model

Page 22: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFNew Entity

+ 2 Att.

Page 23: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFNew Attribute

Page 24: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFModify Meta Data

Page 25: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFDelete Model

Page 26: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFDealing with Members

Page 27: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Meta Data / WCFDealing with Members II.

Page 28: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Demo WCFMeta Data / Members

Page 29: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 30: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 31: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 32: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 33: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 34: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 35: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 36: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 37: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Microsoft.MasterDataServices.Workflow.exe.config.xml

Page 38: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Microsoft.MasterDataServices.Workflow.exe -console

Page 39: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 40: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Business Rules / External Action

Page 41: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Demo External Action

Page 42: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

Summary…

• Master Data Services is an open service• We can integrate MDS seamlessly in our

business & technical processes• Be creative…

Page 43: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

So long…

Any Questions?

Page 44: The Developer Side of SQL Server Master Data Services

Data WarehouseETL OLAPData Quality Reporting ServicesAnalysis Services

BIMethodology

BI LifecycleSkill Improvment Data Profiling

Architecture

Dimensional Modeling

BI Strategy

Patterns

Consulting

Coaching

Coaching

MDM

The End

Thank you!Follow me on Facebook, Twitter and

http://saschalorenz.blogspot.comQuestions? Send me a mail -> [email protected] !