43

- Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf · Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

  • Upload
    doandat

  • View
    256

  • Download
    0

Embed Size (px)

Citation preview

Page 1: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

1

Page 2: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

<Insert Picture Here>

Oracle GoldenGate Product Strategy and Roadmap Catalina Chavarriaga Senior Sales Consultant – Oracle Corporation

Page 3: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

3

This Time Last Year at Oracle Open World… •  Officially GoldenGate was

purchased September 3, 2009

•  Things were pretty hectic at the last OOW

•  This year….

Page 4: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

4

Fast Forward to Today…

•  This year we are excited about our first release since the acquisition

•  It is a joint Oracle Data Integration release with integration between Oracle GoldenGate and Oracle Data Integration

Page 5: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

5

•  Best-in-class leader in real-time data integration and replication

•  Over 500 customers with 4,000+ implementations in Financial Services, Communications, Healthcare, Public Sector, Retail & Utilities industries:

•  Top 3 of 5 largest commercial banks •  Top 3 of 3 busiest ATM networks •  Top 7 of 10 financial data services

companies •  Top 4 of 5 telecommunications providers •  Top 3 of 5 largest food & drug stores

GoldenGate is Strategic for Oracle Best-in-class Solutions

Page 6: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

6

Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in real time

Key Differentiators:

Non-intrusive, low-impact, sub-second latency

Open, modular architecture - Supports heterogeneous sources and targets

Maintains transactional integrity - Resilient against interruptions and failures

What is Oracle GoldenGate?

Performance

Flexible and Extensible

Reliable

Page 7: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

7

Oracle GoldenGate Topologies Unidirectional Query

Offloading Bi-Directional

Live Standby or Active-Active for HA

Peer-to-Peer Load Balancing,

Multi-Master

Broadcast Data Distribution

Integration/Consolidation Data Warehouse

Cascading Data Marts

Page 8: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

8

Oracle GoldenGate and the Red Stack

Page 9: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

9

Oracle Data Integration Solution Best-in-class Heterogeneous Platform for Data Integration

MDM Applications

SOA Platforms

Oracle Applications

Business Intelligence

Activity Monitoring

Custom Applications

Oracle GoldenGate

Log-based CDC

Bi-directional Replication

Real-time Data

SOA Abstraction Layer

Service Bus Process Manager Data Services

Oracle Data Integrator

ELT/ETL

Data Transformation

Bulk Data Movement

OLTP System

Flat Files Data Warehouse/ Data Mart

OLAP Cube Web 2.0 Web and Event Services, SOA

Storage

Data Verification

Oracle Data Quality

Data Profiling

Data Parsing

Data Cleansing

Data Federation

Data Lineage Match and Merge

Comprehensive Data Integration Solution

Page 10: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

10 10

Active Data Guard Direct

Memory Access

Read On-Disk Logs

Fast SQL

Direct Write to Logs

Oracle Products for Data Movement Comparing How They Work

Redo in Memory Buffer

GoldenGate

Data Integrator

DE

CR

EA

SIN

G

LA

TE

NC

Y

INC

RE

AS

ING

T

RA

NS

FO

RM

AT

ION

Retrieve Data Load Data

Disaster Recovery & Data Protection

Real Time Data Integration & High Availability

SQL Query Set-based, Complex SQL

Data Integration for Data Warehouse & SOA

HE

TE

RO

GE

NE

OU

S

Page 11: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

11

Any Data Warehouse

Any Bulk Data Transformation

Complex Migrations

ODI Any Real Time Data Needs

Zero-Downtime Migrations (OS, HW, DB)

Active-Active High-Availability

OGG Any Oracle DR

Read-only Reporting

ADG

Oracle Products for Data Movement When to Use

Page 12: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

12

Comparing GoldenGate & Streams

GoldenGate is Oracle’s strategic replication solution

•  Highly customizable and flexible •  Optimized for Oracle Database •  Few large references

Oracle Streams

•  Out-of-the-box solutions •  Broad heterogeneous support •  Excellent reference base

Oracle GoldenGate

Streams continues to be a supported Oracle Database feature

Page 13: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

13

• Oracle GoldenGate Architecture

Page 14: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

14

•  Broad, heterogeneous connectivity •  Maximum uptime for sources and targets •  Wide range of use cases

Continuous, Pervasive Access

•  Low-impact, non-intrusive, scalable •  Ability to select latency and transformation

points Real-Time

•  High-performance, low-TCO architecture •  Rapid development and deployment •  Reliability and easy maintenance

Efficient

Oracle Data Integration’s Advantages

Page 15: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

15

How Oracle GoldenGate Works

LAN/WAN Internet

TCP/IP

Capture Trail

Pump Delivery Trail

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s).

Delivery: applies data with transaction integrity, transforming the data as required.

Source Oracle & Non-Oracle

Database(s)

Target Oracle & Non-Oracle

Database(s)

Page 16: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

16

How Oracle GoldenGate Works

LAN/WAN Internet

TCP/IP

Bi-directional

Capture Trail

Pump Delivery Trail

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s).

Delivery: applies data with transaction integrity, transforming the data as required.

Source Oracle & Non-Oracle

Database(s)

Target Oracle & Non-Oracle

Database(s)

Page 17: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

17

Database

Legacy

New Application/ OS/ Database/Hardware

Distributed Systems

Replica/ Standby Log-based, changed data

Zero Downtime Upgrade & Migration

Query Offloading, Disaster Recovery

Data Synchronization across the Enterprise

Real-time BI, Operational Reporting

ODS/Data Warehouse

Message Bus

Message Bus

Event Driven Architecture,

SOA

Oracle GoldenGate 11g Low-Impact Real-Time Data Integration & Transactional Replication

Page 18: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

18

EMP

Oracle Real Time Data Integration Oracle’s Unique Offering for Real Time Business Intelligence

Oracle GoldenGate

Oracle Data Integrator

EMP

DEPT

DIM

FACT

DIM

DIM

DIM

ODS Schema DW Schema

On-Disk Logs

Source 1

Source 2

Oracle GoldenGate

EMP

DEPT

DEPT

On-Disk Logs

Page 19: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

19

Traditional ETL + CDC

•  Invasive Capture on OLTP systems using complex Adapters

•  Transformations in ETL engine on expensive middle tier servers

•  Bulk load to the data warehouse with large nightly/daily batch

•  Continuous feeds from operational systems

•  Non-invasive data capture •  Thin middle tier with transformations

on the database platform (target) •  Mini-batches throughout the day or

bulk processing nightly

ODI + Oracle GoldenGate

Staging

Trickle

Lookup Data

Load

Extract

Lookup Data

Xform Xform Bulk

GG

+ OD

I

GG

+ OD

I

Heterogeneous

Real-time CDC Integration Best-in-class solution for real-time with Oracle GoldenGate

Page 20: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

20

Oracle GoldenGate Solutions

Page 21: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

21

Mission-Critical Systems and Batch Processing Too Much Data, Not Enough Time

What time of your day is your business NOT at it’s peak?

operations

operations

Available

Page 22: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

22

Business event

Action Time

Data latency

Analysis latency

Decision latency

Bus

ines

s Va

lue

Data captured

Information delivered

Action taken

From TDWI The Business Case for Real-Time BI Based on concept developed by Richard Hackathorn, Bolder Technology

Why Real Time? Increasing the Value of Enterprise Information

How late is your business reacting?

Page 23: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

23

Data Integration Solutions

•  Real Time Data Warehouse •  Need fresh data 24X7? •  Mission-critical OLTP? •  Want to get double duty from DW

investment?

•  Operational Reporting •  Need operational visibility in real

time? •  Can’t impact performance of OLTP?

•  Zero Downtime Migration •  Want to get on lower cost standard

infrastructure? •  Can’t afford downtime?

•  Data Move & Improve •  Does your data cost $$ or make $$? •  Why not fix data assets as well as HW/

SW assets during a move?

•  Data Integration for SOA •  Large flat files require transformation? •  Direct to database connections for

source and/or target? •  Batch processes?

•  Data Synchronization •  Require very low latencies with very

high transaction throughput? •  Require active-active data sync?

•  DR / Data Protection •  Will your data be available when…? •  Is your standby database sitting idle?

•  Zero Downtime Operations •  Is planned downtime at least as costly

as unplanned downtime? •  Need continual online maintenance? •  Ever expect to do another HW, OS,

DB upgrade?

ODI & GoldenGate

GoldenGate

Active Data Guard

GoldenGate

ODI, Data Quality & Profiling

GoldenGate

ODI Suite

GoldenGate

Page 24: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

24

Announcing

Page 25: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

25

Oracle GoldenGate 11gR1 Goals

•  Differentiators •  New databases •  New versions •  JMS capture •  New data types •  Increased performance

•  Simplified Operations •  Simplify recovery •  Enhanced manageability •  Focused tracing

Page 26: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

26

Oracle Enhancements

  Bounded recovery   Reduce fetching of LOBs   Support direct loads (Capture)

  DDL password replication   High priority DDL enhancements   Suppress triggers on apply   Optionally defer constraint checking

Page 27: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

27

Other DB Enhancements

  MySQL Log based capture (v5.1.16 and above)

  Support InnoDB for Capture   Support InnoDB for Delivery   Statement Caching   Dynamic SQL Support

  Support TEXT and BLOB data types

  TimesTen Delivery

Page 28: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

28

Other DB Enhancements

  DB2 LUW 9.7   Added support of DB2CONNECT –

LUW delivery   DB2 for i delivery

  Base24 Full Refresh enhancement   TCP streaming   Temporary file management   SOURCEISFILE - restart by key

  UNI[VAR]CHAR support   Dynamic SQL support   Array fetching for initial load

Page 29: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

29

Databases O/S and Platforms Oracle GoldenGate Capture:

  Oracle   DB2 for v 9.7   Microsoft SQL Server   Sybase ASE   Teradata   Enscribe   SQL/MP   SQL/MX   MySQL   JMS message queues

Oracle GoldenGate Delivery:   All listed above, plus:  TimesTen, IBM System i   Netezza, Greenplum, HP Neoview and any ODBC compatible databases   ETL products

Linux

Sun Solaris

Windows 2000, 2003, XP HP NonStop

HP-UX

HP OpenVMS

IBM AIX

IBM z Series

zLinux

29

Expanded Heterogeneity

NEW

NEW

NEW

NEW

Page 30: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

30

Oracle GoldenGate Management Pack

Page 31: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

31

Oracle GoldenGate Director What is GoldenGate Director?

•  Simplifies overall deployment and management of GoldenGate TDM products

•  A centralized server-based graphical application that offers an intuitive way to define, configure, manage, and report on GoldenGate TDM processes.

•  An add-on product for new or existing GoldenGate customers.

Page 32: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

32

Director Client •  Rich GUI Client •  Customizable Diagrams •  GoldenGate Networks

•  View •  Configure •  Manage •  Monitor

•  GGSCI Execution •  Consolidated Logs •  Alert Functionality

•  Email •  Custom

•  Wizard Driven

Page 33: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

33

• Oracle GoldenGate Veridata

Page 34: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

34

Oracle GoldenGate Veridata Data Comparison without Downtime

•  A high-speed, low impact data comparison solution •  identifies and reports data discrepancies

between heterogeneous databases •  without interrupting their availability

•  Benefits: •  Reduce financial/legal risk exposure •  Speed and simplify IT work in comparing

data sources •  No disruption to business systems •  Improved failover to backup systems •  Confident decision-making and reporting

Page 35: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

35

Why Do You Need Veridata? Data discrepancies are a reality of life

  User errors -  Input errors -  Unintended use -  Malicious intent

  Infrastructure errors -  System failure -  Disk corruption -  Network outage

  Migration Confirmation -  Database upgrades -  Database migrations -  Operating system upgrades -  Application upgrades

  Real Time Data Integration Verification -  Data warehouse -  Query offloading -  Marketing databases

  Application errors -  Faulty logic -  Failed upgrades -  Latent bugs

  Configuration errors -  Applications -  Replication -  Network

Page 36: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

36

Oracle GoldenGate Veridata Platforms Component Database O/S and Platforms GoldenGate Veridata Java Agent

Oracle 9i, 10g, 11g SQL Server 2000, 2005, 2008 Teradata 2vR6, 12, 13 DB2 LUW v8.x, v9.5 DB2 z/OS v8.x, v9.5

Windows Red Hat Sun Solaris SUSE HP-UX HP Tru64 IBM AIX

GoldenGate Veridata C Agent

Oracle 9i, 10g, 11g

Enscribe NonStop SQL/MP

HP NonStop Server (Guardian environment)

GoldenGate Veridata Server

Repository: Oracle 9i, 10g, 11g MySQL 5 SQL Server 2005 and 2008

Windows Red Hat Sun Solaris HP-UX IBM AIX

Page 37: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

37

• Case Studies • Migration

Page 38: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

38

Business Intelligence Real Time Data Warehouse

•  Solution •  Log-based extract of database transactions

from source •  Load to target with sub-second latency •  Transformation performed on the database

using E-LT in mini-batches

•  Benefits •  No resource / performance impact to OLTP •  Live data available for better decision making •  Get double-duty from database investment by

using it for transformations •  No batch windows necessary – key for global

businesses

•  Products •  ODI & GoldenGate

Ministry of Finance, Financial Data Center

Create a Real Time DW

Page 39: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

39

Solution •  Moves device manufacturing data across the globe

multi-directionally in sub-seconds •  Allows application transactions to be distributed across

multiple databases •  Supports 24*7*365 global manufacturing process with

accurate and reliable data •  Offloads operational reporting to Oracle Exadata for

improved OLTP performance

Customers Example: Research in Motion Global Data Integration and High Availability Solution

Oracle GoldenGate

Oracle RAC

Oracle Exadata

•  Each plant needs to accommodate new device production and capacity depending on the overall load of all manufacturing plants

•  Manufacturing systems need 24x7 availability to support global operations

Page 40: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

40

CHALLENGES / OPPORTUNITIES •  Optimize OLTP system performance –

offload all query activity •  Reduce TCO via platform changes and

segment “lookers” from “bookers” •  Handle growing data volumes and

support heterogeneous systems over life-cycle of Air Travel Shopping Engine (ATSE)

•  Maintain data integrity across all systems

GoldenGate PROVIDES •  Supports 1.6TB of data movement per day

to read-only servers •  Source– Oracle 10g | Target – MySQL •  Current plans to migrate to Oracle 11g on

both source and target.

RESULTS •  80% TCO Reduction – Millions $$ saved

COMPANY OVERVIEW A world leader in the travel marketplace, Sabre Holdings merchandises and retails travel products and provides distribution and technology solutions for the travel industry

Query Offloading Case Study Query Offloading Saves Millions $

“Bookers vs Lookers”

Page 41: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

41

•  Follow us on:

Join the Oracle DI Community Discuss, Share, Learn

• Oracle Data Integration: www.oracle.com/goto/odi • Oracle GoldenGate : www.oracle.com/goto/goldengate • Technical information and downloads: www.oracle.com/technetwork/middleware/data-integration/ • Data Integration Events http://www.oracle.com/events

•  www.twitter.com/ORCLGoldenGate •  http://blogs.oracle.com/dataintegration

•  www.linkedin.com “Oracle Data Integration”

•  Visit to learn more:

Page 42: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

42

Page 43: - Oracle User Groupsfoug.org/Downloads/SFOUG_GoldenGate.pdf ·  Oracle GoldenGate Product Strategy and Roadmap ... Oracle 9i,

43