20
INTERNAL USE ONLY Modernizing Data Architecture using Data Virtualization for Agile Data Delivery Dave Kay, Data Consultant UKGI Data, Analytics and Architecture

Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

  • Upload
    denodo

  • View
    149

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY

Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

Dave Kay, Data Consultant

UKGI Data, Analytics and Architecture

Page 2: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 2

Page 3: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 3

55,000Employees (approximately)

170+Countries

USD 4.6 bnBusiness operating profit

Page 4: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 4

The Zurich Group Operates a Federated Model for Data

Deliveries.

Group Function – Delivers Data Framework

Satellite Function – ZNA

Satellite Function – UKGI & UK Life

Satellite Function – Zurich Switzerland BU

Etc…

Page 5: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 5

Page 6: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 6

Big change coming in Insurance – the ability to respond at pace is key to success.

Page 8: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 8

Learn about and build plans for:

Driving toward a near future that

encompasses:

With ambition for a longer term

where:

Page 9: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 9

Page 10: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 10

Sch

ed

uli

ng

Data

So

urc

es

ET

L P

rocessin

g

So

luti

on

Deli

very

User

Access

Page 11: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 11

Reduce

CostFlex

Resource

Raise

throughputAccelerate

change

• Cost of change prohibitive to generating value from data

• Slower time to market inhibiting impact of good analytics

• Complexity of solution can cause delivery bottlenecks

• Bespoke coded solution requires unique resource to maintain

Page 12: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 12

Data

Landing

Conformed

Warehouse

Data Hub Interface

Layer

• Data landed into infrastructure from disparate sources

• Conformed enterprise data warehouse provides central storage

• Data hub providing single ‘user facing’ data source

• Simplified Interface layer landscape – single point of entry

Page 13: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 13

Page 14: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 14

Business Need: Provide daily MI and intra-day

Operational Reporting for a community of business

analysts, salesmen, underwriters, managers and

actuarial staff – off the back of a brand new system.

• XML Source with over 13,000 elements, 10+ products

• XML Schema not available

• Data items and schema differ dramatically per

product type

• Fast pace of change

Page 15: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 15

• Subset of data ‘shredded’ via XSLT – immediately reduces scope

(250 items)

• SSIS transforms at multiple points generate maintenance difficulties

• Data effectively replicated multiple times

• Change Request process lengthy and expensive

• Specialist development skills required

Page 16: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 16

• XML made available into new DAA architecture for ingestion

• Denodo used as a virtual staging wrapper

• Views over XML representing core entities for reporting (Relational

View) virtualised in Denodo – cached to SQL Server

• Relational, Reporting and Analytical stores published as

consumable data sets via Denodo

• Two tier interface:

• Rapid interactive access to quickly changing data for ad-hoc

queries via Alteryx, JDBC, REST etc

• Stable, conformed relational marts virtualised & cached for

exploration, analysis and visualisation in Qlik etc

Page 17: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 17

••

Page 18: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 18

Page 20: Modernizing Data Architecture using Data Virtualization for Agile Data Delivery

INTERNAL USE ONLY 20

Reduce

CostFlex

Resource

Raise

throughputAccelerate

change

• Cost model reduced

• Significantly quicker time to market

• Greater throughput

• Resource pool expanded