© 2013 Denodo Technologies
6 Sessions Covering Key Data Integration Challenges
Solved with Data Virtualization
Session 5: Implementing Data Virtualization for DW and
MDM Extensions
Topics covered:*Making BI agile
*Integrating Big Data*Combining SOA and Data
Integration*Enhancing and Extending MDM
and DW*Creating a single view of your
customer
© 2013 Denodo Technologies
Today’s Speaker
■ Paul Moxon
Senior Director, Product Management
© 2013 Denodo Technologies
Agenda
■ MDM and Data Virtualization
■ Data Warehouses and Data Virtualization
■ Customer Use Cases
■ Summary
■ Q&A and Next Steps
© 2013 Denodo Technologies
Agenda
■ MDM and Data Virtualization
■ Data Warehouses and Data Virtualization
■ Customer Use Cases
■ Summary
■ Q&A and Next Steps
© 2013 Denodo Technologies
Traditional MDM
© 2013 Denodo Technologies
Data Environments…They Are A-Changin’
■ Disruptive technology
• Big data, Cloud, Mobile, Data brokers, …
■ Multiple data domains
■ Multiple disparate data sources
• Internal and external to organization
• Structured and unstructured data
■ How does the ‘golden record’ fit into this new world?
© 2013 Denodo Technologies
From Golden Record to Golden Profile
© 2013 Denodo Technologies
Data Virtualization Architecture
Data
Co
nsu
me
rsEnterprise Applications, ESB Reporting, BI, Portals Mobile, Web, Users
Data
Vir
tuali
za
tio
n Design Tools
Optimizer
Cache
Scheduler
Monitoring
Governance
Metadata
Security
Publish Real-time (Right-time) Data Services
Combine Transform, Improve Quality, Integrate
Connect Normalized Views of Disparate Data
Denodo Platform
Library of Wrappers Web Automation Any Data or Content Read and Write
Data
So
urc
es
Databases & Warehouses
EnterpriseApplications
Cloud / SaaSApplications
XML, Excel,Flat Files
Big Data, NoSQL
Web 2.0 Soc. Media
PDF, Docs,Index, Emails
More Structured Less Structured
Business SolutionsAccess Information-
as-a-Service
Denodo PlatformRight Information at the Right Time
Disparate DataAny SourceAny Format
Multiple Protocols,
Formats
Linked Data Services
Query, Search, Browse
Request/Reply,
Event Driven
Secure
Delivery
© 2013 Denodo Technologies
MDM and Data Virtualization
■ Data Virtualization provides access to any data, any format, anywhere
• Structured, unstructured, database, big data, web, file-based, documents, emails, etc.
■ Provides point of control for managing MDM
• ‘Point of integration’ for master data
■ Provides views on data
• Lightweight ‘facets’ on to underlying data
• Contextual filter
© 2013 Denodo Technologies
MDM–Data Virtualization Patterns
© 2013 Denodo Technologies
MDM–Data Virtualization Patterns
© 2013 Denodo Technologies
MDM–Data Virtualization Patterns
© 2013 Denodo Technologies
MDM–Data Virtualization Patterns
© 2013 Denodo Technologies
MDM–Data Virtualization Patterns
© 2013 Denodo Technologies
Agenda
■ MDM and Data Virtualization
■ Data Warehouses and Data Virtualization
■ Customer Use Cases
■ Summary
■ Q&A and Next Steps
© 2013 Denodo Technologies
Traditional Data Warehouse Solutions
Real Time
ODS
Subset
Data Marts
Common
Staging
Area
Oracle E-Business
Suite
JDA Supply Chain Salesforce CRM 3rd Party
Federated
Packaged JDA
Supply Chain
Data Marts
Reporting and
Analytical Applications
e-Commerce
Real Time
Data Mining
and Analytics
Real Time Segmentation, Classification,
Qualification, Offerings, etc.
Federated
Marketing
Data
Warehouse
Federated
Financial
Data
Warehouse
© 2013 Denodo Technologies
The ‘2-2-50’ Rule
■ Traditional data warehouse solutions (including ETL) are costly and inflexible
■ Data warehouse projects have a high rate of failure
• Ovum’s ‘2-2-50’ rule
■ Business is moving too fast to wait for large data warehouse projects to finish
■ We need a better solution…
© 2013 Denodo Technologies
EDW and Data Virtualization
■ Data virtualization provides low cost alternative to physical data warehouse
• More agile approach
■ Data virtualization can extend and enhance existing data warehouse systems
• Rapidly adding new data sources
• Enriching existing data assets
■ Data virtualization can enhance existing ETL processes
• Incorporate unstructured data into a very structured world
© 2013 Denodo Technologies
EDW–Data Virtualization Patterns
■ Multiple patterns exist
• Focus on most common patterns
■ Logical Data Warehouse
■ Extending your Data Warehouse
■ Enhancing your ETL Processes
© 2013 Denodo Technologies
Logical Data Warehouse
© 2013 Denodo Technologies
Extending Your Data Warehouse
© 2013 Denodo Technologies
Enhancing Your ETL Process
© 2013 Denodo Technologies
Agenda
■ MDM and Data Virtualization
■ Data Warehouses and Data Virtualization
■ Customer Use Cases
■ Summary
■ Q&A and Next Steps
© 2013 Denodo Technologies
AAA Northern California, Nevada, & Utah (NCNU)
■ AAA-NCNU separated business into two separate companies; Insurance and Auto Club
■ Separate intertwined data centers – incl. data warehouses and databases – and applications
■ While keeping the business running!
“Changing the wheels at 70 mph”
© 2013 Denodo Technologies
AAA Northern California, Nevada, & Utah (NCNU)
© 2013 Denodo Technologies
Shared Data
Sources
DATA VIRTUALIZATION
SQL Server
DB
Insurance Exchange
Data Sources
AppsPDF, Docs,Index, Emails
Auto Club
Data Sources
Oracle DB PDF, Docs,
Index, Emails
Data,
Application
Migration
Informatica ETL
Data Warehouse
Batch load
to EDW
JDBC/ODBC
InterfaceVirtual Database
to ETL
Excel ReportsReporting Tool
Apps
AAA Northern California, Nevada, & Utah (NCNU)
© 2013 Denodo Technologies
Major Life Sciences Company – Physician MDM
■ Large Biotech company
• Global presence
■ Develops wide range of drugs
• Various cancers, non-Hodgkin lymphoma, arthritis, etc.
■ Needs master data (golden record) on physicians suitable for clinical trials
■ Qualification data to validate physicians maintained on external web sites
• Board certifications, Government exclusion lists, etc.
© 2013 Denodo Technologies
Major Life Sciences Company – Physician MDM
Field DataPhysician
Master Data
Clinical Trial
Data
Internal Sources External Web Sources
FDA
Debarment
List
FDA
Disqualified/Restricted
List
OIG
Exclusion
List
Excluded
Parties/GSA
List
Physician Golden Record
DATA VIRTUALIZATION
© 2013 Denodo Technologies
Agenda
■ MDM and Data Virtualization
■ Data Warehouses and Data Virtualization
■ Customer Use Cases
■ Summary
■ Q&A and Next Steps
© 2013 Denodo Technologies
Summary
■ Data Virtualization provides low cost alternative to traditional MDM and EDW
■ Existing MDM and EDW strategies need to accommodate new data
• New data sources and data formats
■ Traditional MDM and EDW systems need to evolve –or be extended…
■ Data Virtualization can extend and enhance existing MDM and EDW solutions
© 2013 Denodo Technologies
Agenda
■ MDM and Data Virtualization
■ Data Warehouses and Data Virtualization
■ Customer Use Cases
■ Summary
■ Q&A and Next Steps
© 2013 Denodo Technologies
Data Virtualization & MDM/EDW – Questions?
© 2013 Denodo Technologies
Data Virtualization & MDM/EDW – Next Steps
Move forward at your own pace
Solution Brief “Pragmatic MDM-Data Virtualization Enables Simple to Complex
MDM with Low Risk
http://www.denodo.com/en/resources/solution_briefs/master_data_management/index.php
Case Study Webinar AAA of Northern CA, NV, and UT:
http://www.denodo.com/en/resources/webcasts/aaa_webinar/index.php
Attend Packed Lunch Webinar Sessions – Covering Data Virtualization for…
Making BI Agile
Integrating Big Data
Combining SOA and Data Integration
Enhancing and Extending MDM and DW
Creating a Single View of Your Customer
Move forward with one of our Data Virtualization experts
Phone: (+1) 877-556-2531 (NA) | Email: [email protected]
Phone: (+44) (0)20 7869 8053 (EMEA)
www.denodo.com
© 2013 Denodo Technologies
Next Session:
Topics covered:*Making BI agile
*Integrating Big Data*Combining SOA and Data
Integration*Enhancing and Extending MDM
and DW*Creating a single view of your
customer
Thank You!
Data Virtualization for Single Entity/Customer View