36
DATA VIRTUALIZATION PACKED LUNCH WEBINAR SERIES Sessions Covering Key Data Integration Challenges Solved with Data Virtualization

Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

  • Upload
    denodo

  • View
    83

  • Download
    3

Embed Size (px)

Citation preview

Page 1: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

DATA VIRTUALIZATION PACKED LUNCH WEBINAR SERIES

Sessions Covering Key Data Integration Challenges Solved with Data Virtualization

Page 2: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Evolving from Monolithic to Distributed Architecture Patterns in the Cloud

Paul Moxon

VP Data Architectures & Chief Evangelist, Denodo

Ruben Fernandez

Sales Engineer, Denodo

Page 3: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Agenda

1. The Cloud Changes Everything

2. Accelerating Cloud Migration & Modernization

3. Customer Case Study

4. Demo – Denodo 7.0

5. Q&A

3

Page 4: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

The Cloud Changes Everything

4

Page 5: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Integration – “The Way We Were…”

5

Page 6: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Integration – A Modern Data Ecosystem

6

Page 7: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Gartner: Predicts 2018: Data Management Strategies Continue to Shift Toward Distributed

…..the collection of data as well as the need to

connect to data are rapidly becoming the new

normal, and that the days of a single data store

with all the data of interest — the enterprise data

warehouse — are long gone.”

Page 8: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Integration – A Modern Data Ecosystem

8

Page 9: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Integration – A Modern Data Ecosystem

9

Page 10: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Rightscale, 2017 State of the Cloud Report

85 percent of enterprises have a multi-

cloud strategy, up from 82 percent in 2016”

Page 11: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

A (Typical) Cloud Journey

11On-Premise On-Premise + SaaS

On-Premise + SaaS+ Private Cloud

On-Premise + SaaS+ Private Cloud + iPaaS

Cloud Native

Page 12: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Distributed Cloud Data Architectures

• Pure Cloud (“Cloud Native”)

• Single Cloud provider

• Private or public Cloud

• Hybrid

• Cloud and on-premise

• Pure Cloud…but multiple Cloud providers

• Data in multiple data stores, multiple

locations

• Applications (SaaS) storing data in Cloud

12

Page 13: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Challenges in Cloud Data Integration

• Data is in many locations, data repositories,

formats, etc.

• Cloud, on-premise, SaaS, …

• How do they know what data is available?

• How to users find and access the data?

• Simple tasks become more challenging as

the data gets more dispersed

13

Page 14: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Accelerating Cloud Migration & Modernization

14

Page 15: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Application Modernization with the Cloud

• Moving from legacy – typically monolithic

– applications and application suites

deployed on-premise to specialized SaaS

applications in the Cloud

• e.g. from Oracle E-Business Suite,

PeopleSoft, Siebel, etc.

• e.g. to Salesforce, NetSuite, Workday,

Taleo, etc.

• Cost savings can be substantial

15

Page 16: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Application Modernization (Cont’d)

Data challenges for application modernization:

• How do you access the data in the SaaS applications?

• How do you get a holistic view of data in specialized applications?

• How do you get data into the SaaS apps?

• Are you going to give users access to each and every SaaS application?

This is where Cloud Data Virtualization can play a significant role

16

Page 17: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Denodo’s Cloud Data Virtualization Architecture

17

Execution Agent

Execution Agent

MetadataRepository

Execution Engine

& Optimizer

Data center A Data center B

Corporate Security

Monitoring & Auditing

“The Cloud”

Page 18: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Application Modernization – Bio-Tech Company

18

Data Virtualization

Web, Cloud and SaaS

• HR Performance• Compliance• Recruitment• Workforce Mang.• Compensation

H R M S

• Core HR Functions

H R M S

Internal Enterprise Systems

• Recruitment • Workforce Management

• Compensation

Moving to

the Cloud …

Page 19: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Migration to Cloud

Moving data sources from on premise to Cloud

– or even from Cloud to Cloud

• Using Data Virtualization as an abstraction

layer to isolate the business from the effects

of the change

• Using Data Virtualization as a hybrid data

access layer to access data, whether on-

premise or in the Cloud

19

Page 20: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Migration to Cloud - Asurion

20

• Growing internationally, moving into different privacy and data

protection jurisdictions

• New products – need for different data types and sources

• Mixing structured, multi-structured, streaming, text, video, voice,

geo-location, etc.

• Moving to Cloud for increased speed and agility

• Easier to spin up new virtual servers for new data sets

• Competing pressures for securing data and providing access to

data sets

Page 21: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Migration to Cloud - Asurion

21

Security Constraints

Geographical

Constraints

Contractual Client

Obligations

PII Protection

Departmental Restrictions

Fast Changing Hadoop & Cloud Technologies

Hive, Spark, Redshift

Maintaining different code

base

Discover, Co-relate, Enable Predictive Analytics

Text, CSV, Voice, JSON, Streaming, 3rd Party

Data

60TB+ structured, 200TB+ telemetry & unstructured data

Page 22: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Data Migration to Cloud - Asurion

22

Page 23: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Customer Case Study

23

Page 24: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Cloud Data Integration - Logitech

24

• Logitech struggling with scalability of Exadata data warehouse

• Too expensive to scale up with more data and higher workloads

• Needed to move to Cloud for increased speed and agility

• Easier to dynamically scale for changing workloads

• Wanted analytical engines running on AWS for speed and agility

• Redshift, AWS EMR, Spark, etc.

• But some data staying on-premises

• Needed platform to bridge Cloud and on-premise and to enable the

migration with minimal impact on business

Page 25: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Cloud Data Integration - Logitech

25

Page 26: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Logitech Solution Architecture

26

Page 27: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Logitech - Benefits

27

Data Fest Presentation by Tekin Mentes, Enterprise Data Architect & Data Evangelist, Logitech

Page 28: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Product Demonstration

Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Ruben Fernandez

Sales Engineer, Denodo

Page 29: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Combine Cloud EDW with other Cloud sources (Cloud SaaS, Hadoop, etc.) for agile reporting and analytics

Benefits

• Fresh data coming straight from Cloud systems

• Avoid local replication of cloud systems

Example

Report: Sales volume per lead source in last 30 days (EDW + CRM)

Scenario: Cloud EDW + SaaS CRM + Cloud Hadoop

29

Event (dim)

User (dim)

Customer feedback

Semantic Model

Original Model

Sales (fact)Leads

Amazon Redshift Amazon EMRCRM

Page 30: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Performance & Optimizations

SELECT u.state AS state,

SUM(s.pricepaid) AS sales_total

FROM

sales s JOIN users u ON s.buyerid = u.userid

JOIN salesforce_lead l ON u.email = l.email

WHERE l.leadsource= 'Web'

GROUP BY u.state;

System Execution TimeData

Transferred

Denodo 3 sec. 34k

Non-optimized 8 min 100 M

100 M

2k

join

group by

32k

join

group by email

Group by state

joinjoin

optimizer

2k

Page 31: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Demo

31

Page 32: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Summary

• Moving to Cloud can be disruptive

• Data Virtualization can help minimize the impact on business by

isolating the changes

• Without proper hybrid integration layer, Cloud apps and databases

can become yet more silos

• Cloud Data Virtualization can open up these silos and allow users to

access all data, anywhere

• If you’re struggling with integration of Cloud data, you might lose

the Cloud benefits of lower TCO and agility

• Cloud Data Virtualization can improve agility, lower TCO and help

ensure the benefits of Cloud Modernization

32

Page 33: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Summary

• Benefits of using Denodo Platform include:

• Isolate business from changes in underlying infrastructure

• e.g. moving from Teradata to Snowflake

• Provides hybrid data access layer

• Access all data from anywhere - Cloud-to-Ground, Cloud-to-Cloud

• Common and consistent governance and security across all data

• Enable speed and agility in new environment

• Avoid expensive Cloud ‘data egress’ charges

• Move processing to the data and not the data to the processor

33

Page 34: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Q&A

Page 35: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Next steps

Access Denodo Platform for Azure: https://www.denodo.com/en/denodo-platform/denodo-platform-for-azure

Access Denodo Platform on AWS:

www.denodo.com/en/denodo-platform/denodo-platform-for-aws

Page 36: Evolving From Monolithic to Distributed Architecture Patterns in the Cloud

Thank you!

© Copyright Denodo Technologies. All rights reservedUnless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and

microfilm, without prior the written authorization from Denodo Technologies.