Information When and Where It's Needed with Oracle Database 10g

Bob ThomeSenior Manager, Distributed Database

Oracle Corporation

Session id: 40149

Oracle Database 10g – The Database for Grid Computing

Better information faster– Spread work across more resources– Access to resources on demand

Easy alignment of IT resources with business needs

– Dynamic allocation of resources as needed Reduced IT costs

– Improve utilization of existing resources– Utilize less expensive commodity platforms– Consolidate resources to reduce management

costs

Virtual Computing Resources

The Grid enables virtualization of resources across servers, data centers, and enterprises

Types of virtual resources– Network– Storage– CPU– Data

Provisioning technologies the key to unlocking the virtual resources on the Grid

Data Provisioning

Provides access to data when and where you need it

Optimizes information access regardless of physical location of data

Integrates information in distributed environments

Enables virtualization of data in Grids

1986 2002

Oracle Data Provisioning

Oracle Streams

Message Gateways

Enterprise/Generic Gateways

Rules Engine Advanced Replication

Heterogeneous Services

Publish/Subscribe

Advanced Queuing Symmetric Replication

Updateable Snapshots (Replication) Remote Procedure Calls

Read Only Snapshots (Replication)

Gateways to 3rd Parties

Distributed Transactions

Location Transparency

Distributed Query

Grid Computing

Methods of Data Provisioning

Consolidate Information Federate Information Share Information

Methods of Data Provisioning

Consolidate Information Federate Information Share Information

Consolidate Information

Consolidate heterogeneous data into a central database

– Any data (audio, video, XML, email, messages, etc…)

– Any platform (Linux, Windows, Solaris, HPUX, AIX, Tru64, OpenVMS, OS/390)

– Proven scalability Hundreds of Very Large Database customers Industry leading benchmarks

Benefits of Consolidation

Simplest form of Data Provisioning Lower administration costs

– Fewer servers and databases to manage

Faster application deployment– Deploy application once, at central server

Faster access to global data– Queries and DML run faster against centralized

data

Features

Massive database support Real Application Clusters (RAC) XML Database Virtual Private Database Partitioning LOBs and BFILEs Loading and migration tools And many more…

New

Massive Database

Ultra large database: 8 Million Terabytes Ultra large number of Tablespaces or Files: 64K

– Tablespaces become tapes in a tape rack

Ultra large data files: 4 Terabytes in a single file Ultra large LOB columns: 8 Gigabytes * blocksize

– Essentially unbounded, can store any object

Proven scalability: Hundreds of VLDB customers

New

Methods of Data Provisioning

Consolidate Information Federate Information Share Information

Federate Information

Federate data in multiple data stores into a single virtual database

– Access both Oracle and non-Oracle data– Access both structured and unstructured data– Hide physical location of data from applications

Benefits of Federation

Fast provisioning– Simple changes yield immediate results

Supports provisioning of data that cannot be consolidated

– Legacy applications– Data requiring local ownership

Ad Hoc provisioning to infrequently accessed data

Features Multiple access methods

– Distributed SQL– XQuery

Any data source– Oracle and non-Oracle

data stores– External files– Web services

Advanced indexing technology

Oracle

DB2

XML

Excel

FlatFiles

TextWebServices

Access Remote Databases with Distributed SQL

Access remote data store transparently

– DB Links hide location of remote data store

Access multiple data stores as single DB

– Tables in multiple remote databases appear local

Perform distributed transactions

– automatic two-phase commit– distributed SQL optimizations

Access Data with XQuery

Query structured and semi-structured data– Relational Data– Native XML files

Reduce application complexity XQuery support evolving with emerging

standard

Access Oracle and non-Oracle Data Stores

Heterogeneous data integration built into the Oracle database

– SQL Translation– Data Dictionary Translation– Procedure execution on non-Oracle system

Transparent Gateways– Available for most major non-Oracle data stores (e.g.,

DB2, SQL Server, Sybase, etc.)– Optimized, certified, end-to-end support

Generic Connectivity– Gateway to any 3rd-party ODBC or OLEDB driver

Access External Files

Access native XML Files– Query via XQuery or SQL

Access proprietary file types via filters– Transform into XML files– Over 100 file types supported by supplied filters

Access external tables– Map data in external files into tables

Database Web Services

Web services consumer– Java classes, PL/SQL, triggers call external

services– Web services viewed as SQL data source

Web services provider– Query database via web service– Perform messaging operations– DML Web Services– Call PL/SQL, Java

Full XML support in database

New

Access Web Services as a SQL Data Source

Built-in support for access to web services data

Track, aggregate, refresh, and query dynamic data and data produced on demand

Web

Service C

lient

Fram

ewo

rk (S

OA

P)

Datab

ase Mo

du

le (W

eb S

ervice

Clien

t)

SELECT city_name, temp, low_temp, high_temp FROM TABLE (Temp_TF)

SOAP Request/Response

HT

TP

Clien

t S

tack

Web Service Provider

(e.g., Weather Service)T

able

Fu

nct

ion

New

Locate Information with UltraSearch

Oracle Ultra Search indexes documents across multiple repositories

– Oracle and non-Oracle databases, HTML web pages, files on disk, IMAP mail servers, and more

Search document meta-data as well as content “Normalize” meta-data across multiple data stores Crawl Oracle databases and others that support

ODBC standard

Federation in Action

Hong Kong Ministry of Education

Integrate legacy Sybase applications with new packaged applications running Oracle

Must keep data synchonized in real-time

Solution: Transparent Gateway

Oracle Sybase

PackageApp

LegacyApp

"Oracle Distributed SQL allows us to effortlessly update data in multiple databases as a single

distributed transaction… reducing the burden on our

application developers."

"Oracle Distributed SQL allows us to effortlessly update data in multiple databases as a single

distributed transaction… reducing the burden on our

application developers."

- Charles Farnell, Venture Forth

Methods of Data Provisioning

Consolidate Information Federate Information Share Information

Share Information

Share information between users, applications, and databases

– Move or copy information as needed– Traditionally implemented as replication or

message queuing– Has evolved to include warehouse loading, event

notification, workflow, and EAI

Benefits of Sharing

Greater flexibility– Locate data where you want it– Control access– Share information with business partners

Faster access to local data– Queries and DML run faster against smaller, local data

store

Higher Availability– Applications not dependent on availability of remote data

stores

Information Sharing Features

Streams– Message Queuing– Replication– Workflow– Much more

Materialized Views Transportable Tablespaces Data Pump New

Eliminate Complexity with Oracle Streams

Unifies all enterprise information into a single Stream

– Unifies database, messaging, replication, publish/subscribe APIs and capabilities

Avoids inherent problems with multiple technologies:

– Multiple development models– Multiple operational models– Builders do the integration

Not just a unified branding of different features

Unified Infrastructure for Information Sharing

Rules based Publish/

SubscribePropagation

Directed andSubset

InformationStreams

In streamTransformations

AutomatedCaptureData Data

ChangesChanges

DatabaseDatabaseEventsEvents

ApplicationApplicationMessagesMessages

DataDataFeedsFeeds

DataDataWarehouses Warehouses and Data Martsand Data Marts

UpdateableUpdateableReplicasReplicas

MessagingMessagingApplicationsApplications

StandbyStandbyDatabasesDatabases

Operational Operational Data StoresData Stores

Intelligent, Unified, Intelligent, Unified, Time OrderedTime Ordered

Information StreamInformation Stream

Stream a File or Database

Oracle Streams can move any file– OS File, BFILE, Database File (tablespace)

Create a replica with a single command– Select tablespaces to replicate and DB Link– Automatically create a synchronized copy

Tracks changes at sourceTransports tablespacesApplies changes to destination

Easy to extend/modify configuration– Apply changes from replica to production database– Add data transformations

Offload processing or migrate to the grid

New

Grid migration with no downtime

Migrate to the Grid – Single command moves your database

Migrate between different platform/OS– Cross-platform transportable tablespaces

move data to new database

No downtime– Capture changes at

source during migration– Update new database– Repoint applications

New

Oracle10g Streams Features

Downstream Capture Performance Improvements Manageability Improvements Row Migration enhancements Expanded datatype support RAC Hot mining and failover Simplified messaging APIs Batch Enqueue/Dequeue of messages Automatic preparation for Explicit Dequeue of

messages Tibco Messaging Gateway

New

Share Data with Materialized Views

Data warehousing– Compute and store aggregated

data, such as sums or averages, for faster queries

Mobile computing– Easy mass deployment– Disconnected computing

Replication– Incrementally maintain local

subset of data – Read-only or updateable with

conflict resolution

NYNY(master)(master)

Updateable Materialized Views

Transportable Tablespaces

Unplug and plug database data files– Move and share data without unload and reload– Plug/unplug performance independent of tablespace size– Mount read-only tablespaces on multiple databases– Cross-platform support– Rename Tablespaces

OS copyFile 1 File

2expdat.dmp

File 1 File

2expdat.dmp

2424

New

Data Pump

High speed, parallel, bulk data and metadata movement of Oracle database contents

– Throttle parallelism up or down, stop and restart– Network mode requires no intermediate dump file

Flexible tool for moving or copying subsets of database in the Grid

– Flexible object selection transfers specific objects– Remaps schemas, datafiles and tablespaces– Interactively add files to dump set

Streams compatible– Export objects to new database and use Streams to

synchronize

New

Data Sharing with Streams: Internet Securities, Inc.

Internet Securities, Inc (www.securities.com) provides Internet-delivery of emerging market news and business information

Over 1 Terabyte of content from over 4400 publications (retained since 1988)

Growing by 10,000 documents per day Documents indexed using Oracle Text Increasing customer demand required

performance and availability improvements

Data Sharing with Streams: Internet Securities, Inc.

Replica of Search database maintained using Oracle Streams to improve performance and availability

Queries execute in half the time or better Switchover in case of failure is instantaneous Can scale to additional replicas as demand grows

Streams

Search DB Search DB

"Streams proved to deliver all the

functionality we wanted for a large

scale database replication solution."

"Streams proved to deliver all the

functionality we wanted for a large

scale database replication solution."

-W. Les Wozniak, Rosetta Biosoftware

Network

Provisioning Data in the GridClustered database Instances

SAN 1 SAN 2 SAN 3 SAN 4

BladeRack

Summary

Oracle supports efficient provisioning of data resources:

– Consolidate Information—Scalable access to large amounts of information

– Federate Information—Data can be located where needed but accessed as single database

– Share Information—Multiple users and applications can share data/information to operate more effectively

AQ&Q U E S T I O N SQ U E S T I O N S

A N S W E R SA N S W E R S