20
1 Data Integration Services Tools vs. Solutions Richard Pilkington Manager Market Research, Syncsort, Inc. November 15, 2007

Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

1

Data Integration ServicesTools vs. Solutions

Richard PilkingtonManager Market Research, Syncsort, Inc.

November 15, 2007

Page 2: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

2

How Tools and Solutions Fit TogetherThinking Holistically About “Information Delivery”How to Provide Enterprise-wide Solutions with “Best of Breed” DI Services and DI Tools

KEY DISCUSSION POINTS

Page 3: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

3

• Over the next 3 years, organizations that take a strategic, holistic approach to their data integration challenges will achieve a positive return on their investments.

What drives your decision-making?

Source: Gartner

Page 4: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

4

Tools v. Solution Definition

CustomTools

Information

Process

Cave Painters

Environmentalists Artisans/Craftsmen

Conservationists

Source: Gartner

Page 5: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

5

• We must ask ourselves, “Is the concept behind using a tool-driven approach focused on repeating the same process over and over again and the information modeling is just a by-product of that process?”• If so, then the primary use of tools is to conserve the existing process

model. • YET, if the focus is to re-use information concepts across the

organization (such as a model for customer) and to use it in allprocesses, the tool is being used to enforce an environment that includes governance and management of the information model as apriority over preserving the process that uses the information model.

• Organizations that constantly recreate concepts and process models in custom-code will make very little progress in terms of standardization and remain in a “stone-age” of IT.

Thinking about how Tools/Solution Fit

Page 6: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

6

Need: Process Driven BIDI Services in the Context of Business Processes Workflow

Creation Purchase Order

Creation Sales Order Fulfillment

RequestRequest Global

ATPGlobal ATP

Check

Creation & Release Delivery

Request

Release ASN

Delivery Execution

Receives ASN

Update Inventory Accounting Update Inventory

Defection Risk"What is the customer

status?"

Inventory Forecast"Will this be back in

inventory?"

Returns per Customer"What is the customer

history?"CLTV

"Does this order justify extra efforts?"

Delivery Performance"How effective is our fulfillment process?"

Source: SAP

Page 7: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

7DI services and Tools are bound by the same equation = Creator + Location + Consumer

Business Strategy

People Process

Analytic Applications

BI Platforms

Performance Management

Metadata

Metadata

CDI PIM DomainMDM

Metadata

DataMart

ODSMasterdata

DataQuality

HierMgmt

DataMart

Metadata

Metadata

Metadata

DataWarehouse

EnterpriseAppsEnterprise

AppsEnterpriseAppsOperational

Apps

ChangeMgmt

Governance

Metadata Meta

data

OLAP

OLAP

DataGovernance

Information Integration

MDM

Information Management Infrastructure

Page 8: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

8

How Tools and Solutions Fit TogetherThinking Holistically About “Information Delivery”How to Provide Enterprise-wide Solutions with “Best of Breed” DI Services and DI Tools

KEY DISCUSSION POINTS

Page 9: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

9DI Services and DI Tools:Tightly Linked, Not Independent Operations

Tools, Application, Processes

MetadataProfiling Cleansing

Access andConsumption

Data Services

Data Profiling…– is not a one-time

stand-alone thing and…

– creates metadata that is used "actively"…

– to tune data cleansing rules…

– and eventually to optimize how data is accessed and used

Source: Gartner

Page 10: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

10

How can Information Delivery be viewed?

DBMS

BI TOOLS

Interface

Interface

Page 11: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

11

…as a Continuum or a Hierarchy?

DB

MS

BI TO

OLS

Interface

InterfaceInformation

Delivery

Data

Presenter

Performance

Data

Maker

Performance

“Thru-put”

“Thru-put”

Page 12: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

12

Business Utilization: Reporting and Analysis

Source

Source

Source

Source

DataDataIntegrationIntegration

ProcessProcessData

Warehouse

BI UserCommunity

Data Marts

ROLAP

MOLAP

In Memory

Output from … and monitors business processes

Page 13: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

13

How Tools and Solutions Fit TogetherThinking Holistically About “Information Delivery”How to Provide Enterprise-wide Solutions with “Best of Breed” DI Services and DI Tools

KEY DISCUSSION POINTS

Page 14: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

14

Market Impact: Pervasive Change

BI

Applications

Integration

DBMS

Declines in relevance, size ($) and percent of

revenue for major vendors (IBM,

Microsoft, Oracle); smaller DBMS vendors

exit the market

Significant growth as the focus shifts to

interoperability, the need to merge,

cleanse and transform data

remains

Simplification of composite application deployment, domain-

specific expertise becomes key differentiator

Line between BI and applications is

further blurred, new types of BI are possible, all BI

becomes real time

Source: Gartner

Page 15: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

15Evaluating DI Services and DI Tools: Product Capabilities Are Key, but Are Not Everything

Product capabilitiesConnectivity/adaptersModes of connectivity

Data delivery styles Data delivery latency Data transformation

Metadata and data modelingDesign & development

Architecture

ViabilityTotal assets

Growth

Pricing Model and Cost

Customer ExperienceService & support

References

StrategyProductsPartnerships

InnovationCreativityR&D Investment

Geographic ReachLocal presenceVARs & SIs

Market Understanding & LeadershipRecognition of trendsVision

Page 16: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

16

Boise Cascade’s Data Warehouse Model

Legacy

Operational ERP / OLTP

External

Extract, Transform, Load Data

Staging

DW, Modeling

Meta Data

Marts

Query & Reporting

OLAP

Data Mining

Campaign Management

PortalKnowledge Workers

Data Analysis

Data

UsersData

Warehouse Generation

Data Warehouse

ManagementData Sources

Page 17: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

17

Fair Isaac: Enterprise Decision Management

EDWODS

Data SourcesCustomer Transaction Account External

Decision Optimizer(Optimization Design)

Decision Management Service

Rules Models

Strategy ExecutionD R

Request

decision

Deliver

decision

OperationalApplicationData Store

Other Data Store

Model Builder(Model Formulation)

Blaze Advisor(Rules Management)

Design Deployment

Operational Application

Source: Gartner

Required Speedto deliver

“right time” info

Page 18: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

18

Information delivered quickly and accuratelyBusiness process modelBI data on completed proceduresSensors with medical instrumentsAnalysis of inputReaction in application flow

LiveData Combines Business Process, Operational Applications and BI

Source: Gartner

Page 19: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

19… the moral of the story… solution-driven, holistically deployed DI Services and Tools increase ROI.

ROI

Customer Value

Where, When and to Whom

Ability to deliver usable information

Functionality

Perf

orm

an

ce

Lo

High

Low FuncLow Perf

High FuncLow Perf

High FuncHigh Perf

Low FuncHigh Perf

High

Those who find the right balance of Functionality & Performance can build lasting customer value

Page 20: Tools vs. Solutions€¦ · DI Services and DI Tools: 9 Tightly Linked, Not Independent Operations Tools, Application, Processes Profiling Metadata Cleansing Access and Consumption

20

THANK YOU

Richard PilkingtonManager Market Research, Syncsort, Inc.

November 15, 2007