Upload
doandat
View
256
Download
0
Embed Size (px)
Citation preview
1
<Insert Picture Here>
Oracle GoldenGate Product Strategy and Roadmap Catalina Chavarriaga Senior Sales Consultant – Oracle Corporation
3
This Time Last Year at Oracle Open World… • Officially GoldenGate was
purchased September 3, 2009
• Things were pretty hectic at the last OOW
• This year….
4
Fast Forward to Today…
• This year we are excited about our first release since the acquisition
• It is a joint Oracle Data Integration release with integration between Oracle GoldenGate and Oracle Data Integration
5
• Best-in-class leader in real-time data integration and replication
• Over 500 customers with 4,000+ implementations in Financial Services, Communications, Healthcare, Public Sector, Retail & Utilities industries:
• Top 3 of 5 largest commercial banks • Top 3 of 3 busiest ATM networks • Top 7 of 10 financial data services
companies • Top 4 of 5 telecommunications providers • Top 3 of 5 largest food & drug stores
GoldenGate is Strategic for Oracle Best-in-class Solutions
6
Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in real time
Key Differentiators:
Non-intrusive, low-impact, sub-second latency
Open, modular architecture - Supports heterogeneous sources and targets
Maintains transactional integrity - Resilient against interruptions and failures
What is Oracle GoldenGate?
Performance
Flexible and Extensible
Reliable
7
Oracle GoldenGate Topologies Unidirectional Query
Offloading Bi-Directional
Live Standby or Active-Active for HA
Peer-to-Peer Load Balancing,
Multi-Master
Broadcast Data Distribution
Integration/Consolidation Data Warehouse
Cascading Data Marts
8
Oracle GoldenGate and the Red Stack
9
Oracle Data Integration Solution Best-in-class Heterogeneous Platform for Data Integration
MDM Applications
SOA Platforms
Oracle Applications
Business Intelligence
Activity Monitoring
Custom Applications
Oracle GoldenGate
Log-based CDC
Bi-directional Replication
Real-time Data
SOA Abstraction Layer
Service Bus Process Manager Data Services
Oracle Data Integrator
ELT/ETL
Data Transformation
Bulk Data Movement
OLTP System
Flat Files Data Warehouse/ Data Mart
OLAP Cube Web 2.0 Web and Event Services, SOA
Storage
Data Verification
Oracle Data Quality
Data Profiling
Data Parsing
Data Cleansing
Data Federation
Data Lineage Match and Merge
Comprehensive Data Integration Solution
10 10
Active Data Guard Direct
Memory Access
Read On-Disk Logs
Fast SQL
Direct Write to Logs
Oracle Products for Data Movement Comparing How They Work
Redo in Memory Buffer
GoldenGate
Data Integrator
DE
CR
EA
SIN
G
LA
TE
NC
Y
INC
RE
AS
ING
T
RA
NS
FO
RM
AT
ION
Retrieve Data Load Data
Disaster Recovery & Data Protection
Real Time Data Integration & High Availability
SQL Query Set-based, Complex SQL
Data Integration for Data Warehouse & SOA
HE
TE
RO
GE
NE
OU
S
11
Any Data Warehouse
Any Bulk Data Transformation
Complex Migrations
ODI Any Real Time Data Needs
Zero-Downtime Migrations (OS, HW, DB)
Active-Active High-Availability
OGG Any Oracle DR
Read-only Reporting
ADG
Oracle Products for Data Movement When to Use
12
Comparing GoldenGate & Streams
GoldenGate is Oracle’s strategic replication solution
• Highly customizable and flexible • Optimized for Oracle Database • Few large references
Oracle Streams
• Out-of-the-box solutions • Broad heterogeneous support • Excellent reference base
Oracle GoldenGate
Streams continues to be a supported Oracle Database feature
13
• Oracle GoldenGate Architecture
14
• Broad, heterogeneous connectivity • Maximum uptime for sources and targets • Wide range of use cases
Continuous, Pervasive Access
• Low-impact, non-intrusive, scalable • Ability to select latency and transformation
points Real-Time
• High-performance, low-TCO architecture • Rapid development and deployment • Reliability and easy maintenance
Efficient
Oracle Data Integration’s Advantages
15
How Oracle GoldenGate Works
LAN/WAN Internet
TCP/IP
Capture Trail
Pump Delivery Trail
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction integrity, transforming the data as required.
Source Oracle & Non-Oracle
Database(s)
Target Oracle & Non-Oracle
Database(s)
16
How Oracle GoldenGate Works
LAN/WAN Internet
TCP/IP
Bi-directional
Capture Trail
Pump Delivery Trail
Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction integrity, transforming the data as required.
Source Oracle & Non-Oracle
Database(s)
Target Oracle & Non-Oracle
Database(s)
17
Database
Legacy
New Application/ OS/ Database/Hardware
Distributed Systems
Replica/ Standby Log-based, changed data
Zero Downtime Upgrade & Migration
Query Offloading, Disaster Recovery
Data Synchronization across the Enterprise
Real-time BI, Operational Reporting
ODS/Data Warehouse
Message Bus
Message Bus
Event Driven Architecture,
SOA
Oracle GoldenGate 11g Low-Impact Real-Time Data Integration & Transactional Replication
18
EMP
Oracle Real Time Data Integration Oracle’s Unique Offering for Real Time Business Intelligence
Oracle GoldenGate
Oracle Data Integrator
EMP
DEPT
DIM
FACT
DIM
DIM
DIM
ODS Schema DW Schema
On-Disk Logs
Source 1
Source 2
Oracle GoldenGate
EMP
DEPT
DEPT
On-Disk Logs
19
Traditional ETL + CDC
• Invasive Capture on OLTP systems using complex Adapters
• Transformations in ETL engine on expensive middle tier servers
• Bulk load to the data warehouse with large nightly/daily batch
• Continuous feeds from operational systems
• Non-invasive data capture • Thin middle tier with transformations
on the database platform (target) • Mini-batches throughout the day or
bulk processing nightly
ODI + Oracle GoldenGate
Staging
Trickle
Lookup Data
Load
Extract
Lookup Data
Xform Xform Bulk
GG
+ OD
I
GG
+ OD
I
Heterogeneous
Real-time CDC Integration Best-in-class solution for real-time with Oracle GoldenGate
20
Oracle GoldenGate Solutions
21
Mission-Critical Systems and Batch Processing Too Much Data, Not Enough Time
What time of your day is your business NOT at it’s peak?
operations
operations
Available
22
Business event
Action Time
Data latency
Analysis latency
Decision latency
Bus
ines
s Va
lue
Data captured
Information delivered
Action taken
From TDWI The Business Case for Real-Time BI Based on concept developed by Richard Hackathorn, Bolder Technology
Why Real Time? Increasing the Value of Enterprise Information
How late is your business reacting?
23
Data Integration Solutions
• Real Time Data Warehouse • Need fresh data 24X7? • Mission-critical OLTP? • Want to get double duty from DW
investment?
• Operational Reporting • Need operational visibility in real
time? • Can’t impact performance of OLTP?
• Zero Downtime Migration • Want to get on lower cost standard
infrastructure? • Can’t afford downtime?
• Data Move & Improve • Does your data cost $$ or make $$? • Why not fix data assets as well as HW/
SW assets during a move?
• Data Integration for SOA • Large flat files require transformation? • Direct to database connections for
source and/or target? • Batch processes?
• Data Synchronization • Require very low latencies with very
high transaction throughput? • Require active-active data sync?
• DR / Data Protection • Will your data be available when…? • Is your standby database sitting idle?
• Zero Downtime Operations • Is planned downtime at least as costly
as unplanned downtime? • Need continual online maintenance? • Ever expect to do another HW, OS,
DB upgrade?
ODI & GoldenGate
GoldenGate
Active Data Guard
GoldenGate
ODI, Data Quality & Profiling
GoldenGate
ODI Suite
GoldenGate
24
Announcing
25
Oracle GoldenGate 11gR1 Goals
• Differentiators • New databases • New versions • JMS capture • New data types • Increased performance
• Simplified Operations • Simplify recovery • Enhanced manageability • Focused tracing
26
Oracle Enhancements
Bounded recovery Reduce fetching of LOBs Support direct loads (Capture)
DDL password replication High priority DDL enhancements Suppress triggers on apply Optionally defer constraint checking
27
Other DB Enhancements
MySQL Log based capture (v5.1.16 and above)
Support InnoDB for Capture Support InnoDB for Delivery Statement Caching Dynamic SQL Support
Support TEXT and BLOB data types
TimesTen Delivery
28
Other DB Enhancements
DB2 LUW 9.7 Added support of DB2CONNECT –
LUW delivery DB2 for i delivery
Base24 Full Refresh enhancement TCP streaming Temporary file management SOURCEISFILE - restart by key
UNI[VAR]CHAR support Dynamic SQL support Array fetching for initial load
29
Databases O/S and Platforms Oracle GoldenGate Capture:
Oracle DB2 for v 9.7 Microsoft SQL Server Sybase ASE Teradata Enscribe SQL/MP SQL/MX MySQL JMS message queues
Oracle GoldenGate Delivery: All listed above, plus: TimesTen, IBM System i Netezza, Greenplum, HP Neoview and any ODBC compatible databases ETL products
Linux
Sun Solaris
Windows 2000, 2003, XP HP NonStop
HP-UX
HP OpenVMS
IBM AIX
IBM z Series
zLinux
29
Expanded Heterogeneity
NEW
NEW
NEW
NEW
30
Oracle GoldenGate Management Pack
31
Oracle GoldenGate Director What is GoldenGate Director?
• Simplifies overall deployment and management of GoldenGate TDM products
• A centralized server-based graphical application that offers an intuitive way to define, configure, manage, and report on GoldenGate TDM processes.
• An add-on product for new or existing GoldenGate customers.
32
Director Client • Rich GUI Client • Customizable Diagrams • GoldenGate Networks
• View • Configure • Manage • Monitor
• GGSCI Execution • Consolidated Logs • Alert Functionality
• Email • Custom
• Wizard Driven
33
• Oracle GoldenGate Veridata
34
Oracle GoldenGate Veridata Data Comparison without Downtime
• A high-speed, low impact data comparison solution • identifies and reports data discrepancies
between heterogeneous databases • without interrupting their availability
• Benefits: • Reduce financial/legal risk exposure • Speed and simplify IT work in comparing
data sources • No disruption to business systems • Improved failover to backup systems • Confident decision-making and reporting
35
Why Do You Need Veridata? Data discrepancies are a reality of life
User errors - Input errors - Unintended use - Malicious intent
Infrastructure errors - System failure - Disk corruption - Network outage
Migration Confirmation - Database upgrades - Database migrations - Operating system upgrades - Application upgrades
Real Time Data Integration Verification - Data warehouse - Query offloading - Marketing databases
Application errors - Faulty logic - Failed upgrades - Latent bugs
Configuration errors - Applications - Replication - Network
36
Oracle GoldenGate Veridata Platforms Component Database O/S and Platforms GoldenGate Veridata Java Agent
Oracle 9i, 10g, 11g SQL Server 2000, 2005, 2008 Teradata 2vR6, 12, 13 DB2 LUW v8.x, v9.5 DB2 z/OS v8.x, v9.5
Windows Red Hat Sun Solaris SUSE HP-UX HP Tru64 IBM AIX
GoldenGate Veridata C Agent
Oracle 9i, 10g, 11g
Enscribe NonStop SQL/MP
HP NonStop Server (Guardian environment)
GoldenGate Veridata Server
Repository: Oracle 9i, 10g, 11g MySQL 5 SQL Server 2005 and 2008
Windows Red Hat Sun Solaris HP-UX IBM AIX
37
• Case Studies • Migration
38
Business Intelligence Real Time Data Warehouse
• Solution • Log-based extract of database transactions
from source • Load to target with sub-second latency • Transformation performed on the database
using E-LT in mini-batches
• Benefits • No resource / performance impact to OLTP • Live data available for better decision making • Get double-duty from database investment by
using it for transformations • No batch windows necessary – key for global
businesses
• Products • ODI & GoldenGate
Ministry of Finance, Financial Data Center
Create a Real Time DW
39
Solution • Moves device manufacturing data across the globe
multi-directionally in sub-seconds • Allows application transactions to be distributed across
multiple databases • Supports 24*7*365 global manufacturing process with
accurate and reliable data • Offloads operational reporting to Oracle Exadata for
improved OLTP performance
Customers Example: Research in Motion Global Data Integration and High Availability Solution
Oracle GoldenGate
Oracle RAC
Oracle Exadata
• Each plant needs to accommodate new device production and capacity depending on the overall load of all manufacturing plants
• Manufacturing systems need 24x7 availability to support global operations
40
CHALLENGES / OPPORTUNITIES • Optimize OLTP system performance –
offload all query activity • Reduce TCO via platform changes and
segment “lookers” from “bookers” • Handle growing data volumes and
support heterogeneous systems over life-cycle of Air Travel Shopping Engine (ATSE)
• Maintain data integrity across all systems
GoldenGate PROVIDES • Supports 1.6TB of data movement per day
to read-only servers • Source– Oracle 10g | Target – MySQL • Current plans to migrate to Oracle 11g on
both source and target.
RESULTS • 80% TCO Reduction – Millions $$ saved
COMPANY OVERVIEW A world leader in the travel marketplace, Sabre Holdings merchandises and retails travel products and provides distribution and technology solutions for the travel industry
Query Offloading Case Study Query Offloading Saves Millions $
“Bookers vs Lookers”
41
• Follow us on:
Join the Oracle DI Community Discuss, Share, Learn
• Oracle Data Integration: www.oracle.com/goto/odi • Oracle GoldenGate : www.oracle.com/goto/goldengate • Technical information and downloads: www.oracle.com/technetwork/middleware/data-integration/ • Data Integration Events http://www.oracle.com/events
• www.twitter.com/ORCLGoldenGate • http://blogs.oracle.com/dataintegration
• www.linkedin.com “Oracle Data Integration”
• Visit to learn more:
42
43