Oracle Golden Gate

Preview:

Citation preview

<Insert Picture Here>

Continuous Availability: The Path to Success with

Oracle GoldenGateIrem Radzik

Director of Product Marketing

August 25, 2010 Webcast

Nick Wagner

Distinguished Product Manager

2

Speakers

• Irem Radzik– Director of Product

Marketing, Oracle GoldenGate

• Nick Wagner— Distinguished Product

Manager, Oracle GoldenGate

<Insert Picture Here>

Continuous Availability: The Path to Success with

Oracle GoldenGate

Irem Radzik

Director of Product Marketing

4

Agenda

• States of Availability

• Differentiating HA/DR Technologies

• Oracle GoldenGate Overview

• Oracle GoldenGate for Continuous Availability

• Active-Active Configuration Considerations

• Customer Examples

• Summary

• Q&A

5

States of Availability

Available – no issues

6

States of Availability

Available – no issues

• Unplanned outage

• System failure

• Data failure

7

States of Availability

Available – no issues

• Planned outage

• Upgrade

• Migration

• Maintenance

• Unplanned outage

• System failure

• Data failure

8

States of Availability

Available – no issues

• Planned outage

• Upgrade

• Migration

• Maintenance

• Unplanned outage

• System failure

• Data failure

• Semi-available

• Performance

issues

9

Continuous Availability Goal: Minimize Unavailability

Available – no issues

• Planned outage• Upgrade

• Migration

• Maintenance

• Unplanned outage

• System failure

• Data failure

• Semi-available

• Performance

issues

Cost of Downtime

Gartner’s estimate

• Average $42,000/hr

• Average 87 hrs per year.

Standish Group’s estimate:

• Mission-critical, $600,000/hr

• Large companies, $ millions

per minute.

Tangible

Productivity

Revenue loss

Recovery efforts

Penalties

Stock price

Intangible

Damaged reputation

Loss in brand equity

Loss of customer loyalty

11

Common Reasons for System Upgrade and Migration

12

Top Challenges for Major Migration Projects

13

Challenges Faced Result in Project DelaysWhich can decrease IT service levels

72% of UK Financial Services company believe data migration

to be “too risky”

More than 80% run over time and/or over budget

Cost overruns average 30%

Time overruns average 41%

Source: Bloor Research

14

Challenges Faced Result in Project DelaysWhich can decrease IT service levels

72% of UK Financial Services company believe data migration

to be “too risky”

More than 80% run over time and/or over budget

Cost overruns average 30%

Time overruns average 41%

Source: Bloor Research

15

Agenda

• States of Availability

• Differentiating HA/DR Technologies

• Oracle GoldenGate Overview

• Oracle GoldenGate for Continuous Availability

• Customer Examples

• Summary

• Q&A

16

Differentiating HA/DR Technologies

• Conventional

Backup/Recovery

• RAID

• Snapshots

• Point-in-time pictures of

data

Roll Forward / File

Protection

High Availability

and

Disaster Recovery• Physical replication at

storage, host or network

level

• Built-in, change-level

database replication

Continuous

Availability

• Transactional, real-time

replication with

bidirectional capabilities

across heterogeneous

systems

Mean Time to Recovery

17

Storage-Based and Host-Based Remote Mirroring Limitations

•Target machine not available for use

• Must be like to like

• Distance constraints

• Failure cause or data corruption replicated as well

• Restart takes time when the database shuts down improperly

• Replicating all blocks requires more bandwidth

• High overhead on source (host-based)

18

Agenda

• States of Availability

• Differentiating HA/DR Technologies

• Oracle GoldenGate Overview

• Oracle GoldenGate for Continuous Availability

• Customer Examples

• Summary

• Q&A

<Insert Picture Here>

Continuous Availability: The Path to Success with

Oracle GoldenGate

Nick Wagner

Distinguished Product Manager

20

Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in

real time

Key Differentiators:

Non-intrusive, low-impact, sub-second latency

Open, modular architecture - Supports heterogeneous sources and targets

Maintains transactional integrity - Resilient against interruptions and failures

Oracle GoldenGate Overview

Performance

Flexible and Extensible

Reliable

21

Oracle GoldenGate Use CasesEnterprise-wide Solution for Real Time Data Needs

Log Based, Real-Time Change Data

Capture

Heterogeneous Source Systems

EDWODS

EDW

Active-Active HighAvailability

Zero Downtime Migration and

Upgrades

Real-time BI

Fully Active

Distributed Database

Reporting

Database

ETL

ETL

Query Offloading

Data Distribution

New DB/OS/HW/App

Global Data Centers

SOA/EDA

OracleGoldenGate

•Reduce Costs

•Lower Risks

•Achieve Operational Excellence

22

How Oracle GoldenGate Works

LAN/WANInternet

Capture

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

23

How Oracle GoldenGate Works

LAN/WANInternet

CaptureTrail

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

24

How Oracle GoldenGate Works

LAN/WANInternet

CaptureTrail

Pump

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

25

How Oracle GoldenGate Works

LAN/WANInternet

TCP/IP

CaptureTrail

PumpTrail

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed, encrypted for routing to target(s).

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

26

How Oracle GoldenGate Works

LAN/WANInternet

TCP/IP

CaptureTrail

Pump DeliveryTrail

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed, encrypted for routing to target(s).

Delivery: applies data with transaction integrity, transforming the data as required.

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

27

How Oracle GoldenGate Works

LAN/WANInternet

TCP/IP

Bi-directional

CaptureTrail

Pump DeliveryTrail

Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed, encrypted for routing to target(s).

Delivery: applies data with transaction integrity, transforming the data as required.

SourceOracle & Non-Oracle

Database(s)

TargetOracle & Non-Oracle

Database(s)

28

Key Feature: Data Movement in Sub-Seconds

• Log-based change data capture

• High volume

• Low overhead

• Decoupled architecture

• Filtering and compression

• Transaction grouping

• Record batching

29

Key Feature: Reliable Data Delivery

• Decoupled architecture for seamless

restart after interruptions e.g.

unreliable networks

• Maintains transaction boundaries and

integrity

• Complete and fast recovery

• Checkpointing by transaction

• In Capture and Delivery

30

Databases O/S and Platforms

Oracle GoldenGate Capture:

Oracle

DB2

Microsoft SQL Server

Sybase ASE

Teradata

Enscribe

SQL/MP

SQL/MX

Oracle GoldenGate Delivery:

All listed above, plus:

MySQL, Netezza, Greenplum, HP Neoview

and any ODBC compatible databases

ETL products

Linux

Sun Solaris

Windows 2000, 2003, XP

HP NonStop

HP-UX

HP TRU64

HP OpenVMS

IBM AIX

IBM z/OS

zlinux

30

Key Feature: Heterogeneity

31

Oracle GoldenGate VeridataData Comparison without Downtime

• A high-speed, low impact data

comparison solution

• identifies and reports data discrepancies

between heterogeneous databases

• without interrupting their availability

• Benefits:

• Reduce financial/legal risk exposure

• Speed and simplify IT work in comparing

data sources

• No disruption to business systems

• Improved failover to backup systems

• Confident decision-making and reporting

32

Oracle GoldenGate VeridataData Comparison without Downtime

• A high-speed, low impact data

comparison solution

• identifies and reports data discrepancies

between heterogeneous databases

• without interrupting their availability

• Benefits:

• Reduce financial/legal risk exposure

• Speed and simplify IT work in comparing

data sources

• No disruption to business systems

• Improved failover to backup systems

• Confident decision-making and reporting

33

Oracle Management Pack for Oracle GoldenGateEasy Management of Oracle GoldenGate Solutions

• Manages, defines, configures, and

reports on Oracle GoldenGate

components

• Key features:

• Centralized management of

GoldenGate modules

• Rich-client and Web-based

interfaces

• Alert notifications and integration

with 3rd-party monitoring products

• Real-time feedback

• Zero-impact implementation

34

Oracle GoldenGate and Streams

• GoldenGate is Oracle’s strategic replication solution

• Streams continues to be a supported Oracle Database feature

• Best Streams technology will be integrated into GoldenGate

Oracle Streams Oracle GoldenGate

35

Oracle GoldenGate and Data Guard

• For Information Distribution & Consolidation, Application Upgrades & Changes

• Use GoldenGate - heterogeneous, active-active, transformations, subsetting

• For Disaster Recovery / Data Protection / HA

• Simple Full Oracle Database Protection

• Use Active Data Guard

• Application desiring flexible HA, active-active, schema changes, platform changes

• Use GoldenGate

• Combine the two for full database protection and information distribution• Oracle GoldenGate for Oracle Database includes Active Data Guard license

Oracle

Active Data

Guard

Oracle DB Primary Oracle DB Standby

Heterogeneous

Distributed

Fully-active

Subset

Replicas

Oracle

GoldenGate

36

Agenda

• States of Availability

• Differentiating HA/DR Technologies

• Oracle GoldenGate Overview

• Oracle GoldenGate for Continuous Availability

• Customer Examples

• Summary

• Q&A

37

Oracle GoldenGate for Continuous AvailabilityDisaster Recovery/Data Protection

• Active Data Guard for

disaster recovery and

data protection for:

• Oracle-Oracle

databases

• Oracle GoldenGate for

disaster recovery and

data protection for:

• Non-Oracle platforms

• Active-active

configurations

• Cross-OS and Oracle

database version

requirements

38

Oracle GoldenGate for Upgrades and Migrations

Zero Downtime ….

39

Oracle GoldenGate: Zero Downtime Database Upgrades

Minimize Risks with Failback

• Upgrade from priorreleases to Oracle

Database 11gRelease 2

• Verify data consistency

• Minimize risks with failback option and phased migration

Real-time changed data

40

Oracle GoldenGate Query OffloadingImprove Production System Performance and Lower Costs

• Off-load queries from production systems in:

• Heterogeneousconfigurations

• E.g. legacysystem queryoff-load

• E.g. differentOS, databaseversion

41

• Enable continuous

availability during

unplanned and

planned outages

• Synchronize data

across regions

Oracle GoldenGate Active-Active ConfigurationMaximize Performance and ROI

• Improve performance

and scalability via

transaction load

distribution

Region A Region B

42

Delivery

Active / Active – With Data Collisions

Capture

Delivery

Route

LAN/WAN/Web/IP

Capture

Target

Trail

Source

Trail

Production

Database 1

Production

Database 2

43

Agenda

• States of Availability

• Differentiating HA/DR Technologies

• Oracle GoldenGate Overview

• Oracle GoldenGate for Continuous Availability

• Customer Examples

• Summary

• Q&A

44

Oracle Solutions

• Migrated from HP NonStop and MySQL to Oracle without downtime

• Upgraded to Oracle Database 11g without downtime

• Offloading ―looker‖ queries to a set of replicas for performance improvements

• Real-time data feeds to DW

Return on Investment

Decreased TCO by 80% with offloading “looker” activity to lower cost replicas

Lowered software license costs by 64% and hardware costs by 88% by moving from HP NonStop to Oracle Linux

Reduced software maintenance by 69%, hardware costs 81% and hosting costs by 79% moving from MySQL to Oracle

Business Challenges

• Handle growth and scale, while reducing TCO via platform changes

• Ensure continuous availability of Air Travel Shopping Engine (ATSE)

Customer Example: Sabre Holdings

45

Solution

• Multi-master data replication with Oracle GoldenGate across 5 data centers in 3 continents for data distribution and availability

• Zero downtime migration from single to a 2-node RAC with ASM across OS

• Consolidated real-time reporting on Oracle Exadata to remove performance impact on source systems

Return on Investment

Support 24/7/365 global manufacturing operations and meet customer SLAs

Upgraded its systems for enhanced scalability without impacting business

Improved system performance by offloading real-time reporting to Exadata

Business Challenges

• Need 24x7 uptime to support global operations and strict SLAs

• Very small monthly window to take downtime for upgrades, migrations, and planned maintenance

• Each plant’s data center needs to have up-to-date data on each device for multi-step production process

Customer Example: Research In Motion- BlackBerry

46

Solution

• Deployed Oracle GoldenGate for multi-master, 4-way replication with Oracle and MS SQL Server 2005 databases supporting fraud detection and payment processing systems

• Replaced home-grown legacy replication

• Enables geographic distribution

• Allows for reporting against DSS systems

Return on Investment

• Time to recover: ZERO minutes

• Reduced total cost of ownership by using lower cost hardware

• Meets SLAs on availability and performance

• Single HA solution for all database platforms

Business Challenges• High cost of downtime - if payment processing or fraud

detection systems are not working, ReD’s clients lose millions of dollars per hour.

• Service Level Agreements dictate 99.95% availability with aggressive sub-second average response times.

• Must ensure quick, massive scalability

Customer Example: Retail Decisions

47

Benefits of Oracle GoldenGateCut Costs, Reduce Risk, and Improve Business Operations

48

49

Quote Attribution

Title, Company

• Visit the Oracle Fusion Middleware 11g

web site at

oracle.com/goto/fmw11g/index.html

• Oracle Data Integration on oracle.com

oracle.com/goto/odi

• Oracle GoldenGate on oracle.com

oracle.com/goto/goldengate

Get Started

• Oracle GoldenGate Resource Kit:

oracle.com/goto/goldengate

• Blog:

http://blogs.oracle.com/dataintegration

• Technical information available at:

oracle.com/technology/products/oracle-

data-integrator/goldengate/index.html

Resources

50

Recommended