31
©2015 Experian Information Solutions, Inc. All rights reserved. Experian and the Experian marks used herein are trademarks or registered trademarks of Experian Information Solutions, Inc. Other product and company names mentioned herein are the trademarks of their respective owners. No part of this copyrighted work may be reproduced, modified, or distributed in any form or manner without the prior written permission of Experian. Experian Public. De-risking data integration projects Enabling early business involvement to minimize downstream cost and time Rishi Patel Strategic Technical Manager, Experian Data Quality Michael M. Ott Data Integration Expert and Thought Leader

De-risking data integration projects

Embed Size (px)

Citation preview

Page 1: De-risking data integration projects

© 2015 Experian Information Solutions, Inc. All rights reserved. Experian and the Experian marks used herein are trademarks or registered trademarks

of Experian Information Solutions, Inc. Other product and company names mentioned herein are the trademarks of their respective owners.

No part of this copyrighted work may be reproduced, modified, or distributed in any form or manner without the prior written permission of Experian.

Experian Public.

De-risking data integration projects Enabling early business involvement to minimize downstream cost and time

Rishi Patel Strategic Technical Manager, Experian Data Quality

Michael M. Ott Data Integration Expert and Thought Leader

Page 2: De-risking data integration projects

2 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Agenda

How current environments introduce additional complexity

An advanced approach to overcoming these challenges, including:

A data integration project checklist

Questions & Answers

Historical challenges to data integration projects

User collaboration

Early business-user involvement

Producing accurate specifications prior to coding

Early prototyping

Page 3: De-risking data integration projects

3 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Speakers

Michael M. Ott Data Integration Expert and

Thought Leader

Rishi Patel Strategic Technical

Manager

Experian Data Quality

Page 4: De-risking data integration projects

4 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Historical challenges to data integration projects

Page 5: De-risking data integration projects

5 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Data

Target

System(s)

Analyze Design Build Test

Run over time and/or budget

Errors in source data, lack of

accurate docs, complexity of

sources

Poor:

Documentation

Collaboration

Investigation

= partial truth

80% of data integration projects fail

Page 6: De-risking data integration projects

6 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Data

Target

System(s)

Analyze Design Build Test

Poor:

Documentation

Collaboration

Investigation

Rework x10

Analyst User IT

= partial truth

Page 7: De-risking data integration projects

7 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

“An error detected in the project testing phase

can cost up to 100 times more to correct than the

same error found during the design phase”

--The Quality Assurance Institute

Page 8: De-risking data integration projects

8 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Current environments introduce additional complexity

Page 9: De-risking data integration projects

9 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Today’s complex environments

Page 10: De-risking data integration projects

10 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Data

Target

System(s)

Analyze Design Build Test

Rework x10

Analyst User IT

Page 11: De-risking data integration projects

11 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Advanced approach to overcoming these challenges

Page 12: De-risking data integration projects

12 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Data

Target

System(s)

Analyze Design Build Test

Automated Data Analysis

Proactive discovery

Based on 100% of your actual

data = the whole truth

Rework x10

Analyst User IT

Page 13: De-risking data integration projects

13 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

CIF Key

100% of your current data

Page 14: De-risking data integration projects

14 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

100110010100010101001

1010101101001

1010011011101010100100101010

101001101010100010001010010

01010010010100

101010110010010101

10100110010100101010010010

10100110

1010011011101010100100101010

1010101101001

724-555-5678 724-555-6789 724-555-3456 724-555-4578

Mary Masters Susan McMinn Jean Menendes Maria Menendez

1425673-323 1435675-344 1445682-356 1455690-389

[email protected] [email protected] [email protected] [email protected]

Page 15: De-risking data integration projects

15 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Page 16: De-risking data integration projects

16 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Data

Target

System(s)

Analyze Design Build Test

Target

System(s) Analyze, Design

& Prototype Build Test

Data Prototyping

Validated

Results

Specifications

Time with Advanced Approach

Time with Traditional Approach

Analyst User

Perfect Spec &

Test Data

IT

Page 17: De-risking data integration projects

17 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Screen shot

Page 18: De-risking data integration projects

18 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Page 19: De-risking data integration projects

19 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Page 20: De-risking data integration projects

20 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Page 21: De-risking data integration projects

21 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Screen shot

Page 22: De-risking data integration projects

22 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Collaborate

? ? ? ? ?

Page 23: De-risking data integration projects

23 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Screen shot

Page 24: De-risking data integration projects

24 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

account

customer officer

partner

address

prospect

organization

shareholder

product

Process A

Process Z

data steward

Page 25: De-risking data integration projects

25 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Reference master data

Page 26: De-risking data integration projects

26 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Data integration project checklist

Page 27: De-risking data integration projects

27 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Pre-integration planning

► Assess

► Identify and inform business and IT stakeholders

► Create workflows and documentation

Project initiation

► Adjust plan and policies

► Communicate plan with stakeholders

► Resolve security issues, gain access to legacy datasets, define hardware and software requirements

Data integration project checklist

Page 28: De-risking data integration projects

28 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Landscape analysis

► Build data dictionary

► Define data quality management process

Solution design

► Create mapping specs

► Create data quality management specifications

► Agree to integration SLAs

Data integration project checklist

Page 29: De-risking data integration projects

29 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Build and test

► Build and document integration logic

► Test integration

► Define fall-back policy

Execute and validate

► Execute integration

► Log SLA progress

► Validate integration success

Hand over ownership

Data integration project checklist

Page 30: De-risking data integration projects

30 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Summary

The complexity of today’s environments add even more challenges

An advanced approach to overcoming these challenges includes:

Use a data integration project checklist as a guide

Historical challenges have caused 80% of data integration projects to fail

User collaboration

Early business-user involvement

Producing accurate specifications prior to coding

Early prototyping

Page 31: De-risking data integration projects

31 © 2015 Experian Information Solutions, Inc. All rights reserved.

Experian Public.

Questions & Answers