Upload
denodo
View
149
Download
2
Embed Size (px)
Citation preview
INTERNAL USE ONLY
Modernizing Data Architecture using Data Virtualization for Agile Data Delivery
Dave Kay, Data Consultant
UKGI Data, Analytics and Architecture
INTERNAL USE ONLY 2
INTERNAL USE ONLY 3
55,000Employees (approximately)
170+Countries
USD 4.6 bnBusiness operating profit
INTERNAL USE ONLY 4
The Zurich Group Operates a Federated Model for Data
Deliveries.
Group Function – Delivers Data Framework
Satellite Function – ZNA
Satellite Function – UKGI & UK Life
Satellite Function – Zurich Switzerland BU
Etc…
INTERNAL USE ONLY 5
INTERNAL USE ONLY 6
Big change coming in Insurance – the ability to respond at pace is key to success.
•
•
•
•
•
•
INTERNAL USE ONLY 7
INTERNAL USE ONLY 8
Learn about and build plans for:
•
Driving toward a near future that
encompasses:
•
With ambition for a longer term
where:
•
INTERNAL USE ONLY 9
INTERNAL USE ONLY 10
Sch
ed
uli
ng
Data
So
urc
es
ET
L P
rocessin
g
So
luti
on
Deli
very
User
Access
INTERNAL USE ONLY 11
Reduce
CostFlex
Resource
Raise
throughputAccelerate
change
• Cost of change prohibitive to generating value from data
• Slower time to market inhibiting impact of good analytics
• Complexity of solution can cause delivery bottlenecks
• Bespoke coded solution requires unique resource to maintain
INTERNAL USE ONLY 12
Data
Landing
Conformed
Warehouse
Data Hub Interface
Layer
• Data landed into infrastructure from disparate sources
• Conformed enterprise data warehouse provides central storage
• Data hub providing single ‘user facing’ data source
• Simplified Interface layer landscape – single point of entry
INTERNAL USE ONLY 13
INTERNAL USE ONLY 14
Business Need: Provide daily MI and intra-day
Operational Reporting for a community of business
analysts, salesmen, underwriters, managers and
actuarial staff – off the back of a brand new system.
• XML Source with over 13,000 elements, 10+ products
• XML Schema not available
• Data items and schema differ dramatically per
product type
• Fast pace of change
INTERNAL USE ONLY 15
• Subset of data ‘shredded’ via XSLT – immediately reduces scope
(250 items)
• SSIS transforms at multiple points generate maintenance difficulties
• Data effectively replicated multiple times
• Change Request process lengthy and expensive
• Specialist development skills required
INTERNAL USE ONLY 16
• XML made available into new DAA architecture for ingestion
• Denodo used as a virtual staging wrapper
• Views over XML representing core entities for reporting (Relational
View) virtualised in Denodo – cached to SQL Server
• Relational, Reporting and Analytical stores published as
consumable data sets via Denodo
• Two tier interface:
• Rapid interactive access to quickly changing data for ad-hoc
queries via Alteryx, JDBC, REST etc
• Stable, conformed relational marts virtualised & cached for
exploration, analysis and visualisation in Qlik etc
INTERNAL USE ONLY 17
•
•
•
•
•
•
•
•
••
INTERNAL USE ONLY 18
INTERNAL USE ONLY 19
Data
So
urc
es
Vir
tua
l S
tag
ing
Vir
tua
l S
em
an
tic
Ato
mic
Ware
ho
us
e
Vis
ua
lisati
on
An
aly
tic
s
INTERNAL USE ONLY 20
Reduce
CostFlex
Resource
Raise
throughputAccelerate
change
• Cost model reduced
• Significantly quicker time to market
• Greater throughput
• Resource pool expanded