Thomas Kyte [email protected] Oracle Corporation

Thomas Kyte

[email protected] Corporation http://asktom.oracle.com

Resources metalink.oracle.com asktom.oracle.com otn.oracle.com

– Discussion forums– Software download– Documentation– Technology Corners

www.oracle.com/oramag groups.google.com

– comp.databases.oracle.* IOUG

Introducing Oracle 10g

10G10G

Runs all your applications Stores all your information Highly

Scalable Available Reliable

Secure Easy to manage

– Make individual systems self-managing

– Manage many servers at once

Disclaimer

Oracle Database 10g – Database for the Grid

Storage for All Your Data Real Application Clusters High Availability Ease of Management Data Provisioning across Grid Business Intelligence on the Grid Application Development on the Grid



Oracle Database 10g – Align Storage with the Business

ERP

DW

CRM

Problem: Islands of storage– “My storage is 50% utilized

and growing 30% a year”

Oracle Database 10g – Align Storage with the Business

Problem: Islands of storage

– “My storage is 50% utilized and growing 30% a year”

Solution: Groups of standard, modular disks

– Consolidated,Networked Storage

– Dynamically Provision

Oracle Grid Storage ManagementHighly Available and Low Cost

Oracle Automatic Storage Management

– Manages disk storage groups– Mirrors, Stripes, Re-balances– Huge reduction in labor cost

Built-In Data Protection at Lowest Cost

– Disk Based Backup and Recovery

– Flashback in Time– Site Recovery Automatic Storage

ManagementDisk BasedBackup &Recovery

11

Oracle DB 10g ULDB Stores All Your Data

Oracle interMediaOracle interMediaMultimedia managementMultimedia management

Oracle LocatorOracle LocatorLocation and Proximity SearchingLocation and Proximity Searching

XML DBXML DBIntegrated Native XML DatabaseIntegrated Native XML Database

Oracle TextOracle TextText management and searchText management and search

RelationalRelationalCharacters, Numbers and DatesCharacters, Numbers and Dates

OCS FilesOCS FilesLow-cost and EasyLow-cost and Easy

Database size limit raised to millions of Terabytes (8 Exabytes)

Ultra Large Data Files – Terabytes in single file

Unlimited size LOB columns – Terabytes

Automatic Storage Management removes file system limits



Align Processing with the Business

Problem: Islands of computation

– “My servers are 15% utilized“

ERP

DW

CRM

Align Processing with the Business

Problem: Islands of computation

– “My servers are 15% utilized“

Solution: Groups of industry standard servers

– Lowest cost, highest performance

– Capacity on demand– Not Self-healing,

Disposable

ERP CRM DW

Complete, Integrated Clusterware

Complete Oracle cluster software solution

Single-vendor support Low Cost

– No need to purchase additional software

– Easy to install, manage High quality and functionality

across all platforms Common event and management

API’s – Multi-tier HA & minimal MTTR

Support for third-party clusterware

ConnectivityMessaging and Locking

Cluster Control/RecoveryServices Framework

Automatic Server Provisioning

Push-button add/drop server to cluster Hands-free allocation and re-allocation of

servers to services – Automatic routing of service requests to

appropriate server with lowest load– On server failure, automatic re-allocation of

surviving servers to services

Works across all platforms



Low Cost Fault Tolerance

Computer Computer FailuresFailures

Data Data FailuresFailures

System System ChangesChanges

Data Data ChangesChanges

UnplannedUnplannedDowntimeDowntime

PlannedPlannedDowntimeDowntime

Low Cost Fault Tolerance

Oracle10g RAC Integrated

clusterware– Integrated, less

moving parts, better tested

Faster failover between servers

– Single digit seconds







20

New Economics forData Protection & Recovery

Disk-Based RecoveryDisk-Based Recovery







Trade cheap disk spacefor expensive downtime

Lets take a look

Flashback Log

Flashback Database

New strategy for point-in-time recovery

Flashback Log captures old versions of changed blocks

– Think of it as a continuous backup

– Replay log to restore DB to time– Restores just changed blocks

It’s fast - recovers in minutes, not hours

It’s easy - single command restore

– SQL> Flashback Database to ‘2:05 PM’

Like a “Rewind” button for the Database

Old Block

VersionDisk Write

New Block

Version

Flash Backup Fully automatic disk-

based backup and recovery

– Set and Forget Nightly incremental

backup rolls forward recovery area backup

– Changed blocks are tracked in production DB

– Full scan is never needed

– Dramatically faster Use low cost ATA disk

array for recovery area

Database Area Recovery Area Tape

Nightly Applyof

IncrementalBackup

WeeklyArchive to

Tape

And yet more Flashback

Flashback Database Flashback Table

– Put table and related segments back as they was Flashback Row History

– Show me the values of this row for the last three hours– Also great for optimistic concurrency control on the web

Flashback Drop – Undrop that table

Flashback Transaction History– Undo transaction xxx.yyy.zzz

24

GOAL: Allow any change to the system with no downtime

Online ReconfigurationOnline Reconfiguration

No Cost System Changes

Rolling UpgradesRolling Upgrades







Oracle Database 10g Highest Data Protection for Lowest Cost

Storage FailureProtection

ASM Mirroring Human Error Protection

Flashback Logs

Flashback

Corruption Protection

On DiskBackups

Flash Backup Site FailureProtection,

rolling upgrades

RedoShipping

Data Guard

Oracle10i High Availability Features

Backup and Recovery– Automated Disk-

Based Backup and Recovery

– Drop Database– RMAN Database

Deregistration– Backup of Standby

Control File– Automated TSPITR

Instantiation– Simplified Recovery

Manager Cataloging of Backup Files

– Automated Channel Failover for Backup and Restore

– Automated File Creation During Recovery

– Simplified Backups to Disk

– Proxy Copy Backup of Archivelogs

Backup and Recovery (Cont)

– Incrementally Updated Backups

– Simplified Recovery Through Resetlogs

– Restore Tolerates Corrupt or Missing Backups

– Full Database Begin Backup Command

– Change-Aware Incremental Backups

Data Guard– Data Guard Broker

Support for RAC– Automated LogMiner

Configuration– Log Miner Support for

Index-Organized Tables

– Secured Redo Transmission

Data Guard (Cont)– Fine-Grained

Supplemental Logging

– Named Data Guard Configurations

– Simplified Zero Data Loss for Data Guard SQL Apply

– Zero Downtime Instantiation for SQL Apply

– Real Time Apply– Redo Data and

Archivelog Compression

Flashback– Flashback Database– Flashback

Reinstantiation– Flashback Standby

Database– Flashback Table– Flashback Row

History– Flashback Drop– Flashback

Transaction History Online Operations

– Enhanced Online Redefinition

– Improved Handling of DDL Locks on Busy Tables

– Signature-Based Dependency Tracking Using Synonyms

– Rolling Upgrades with Data Guard SQL Apply

Oracle10i High Availability Features

Backup and Recovery– Automated Disk-

Based Backup and Recovery

– Drop Database– RMAN Database

Deregistration– Backup of Standby

Control File– Automated TSPITR

Instantiation– Simplified Recovery

Manager Cataloging of Backup Files

– Automated Channel Failover for Backup and Restore

– Automated File Creation During Recovery

– Simplified Backups to Disk

– Proxy Copy Backup of Archivelogs

Backup and Recovery (Cont)

– Incrementally Updated Backups

– Simplified Recovery Through Resetlogs

– Restore Tolerates Corrupt or Missing Backups

– Full Database Begin Backup Command

– Change-Aware Incremental Backups

Data Guard– Data Guard Broker

Support for RAC– Automated LogMiner

Configuration– Log Miner Support for

Index-Organized Tables

– Secured Redo Transmission

Data Guard (Cont)– Fine-Grained

Supplemental Logging

– Named Data Guard Configurations

– Simplified Zero Data Loss for Data Guard SQL Apply

– Zero Downtime Instantiation for SQL Apply

– Real Time Apply– Redo Data and

Archivelog Compression

Flashback– Flashback Database– Flashback

Reinstantiation– Flashback Standby

Database– Flashback Table– Flashback Row

History– Flashback Drop– Flashback

Transaction History Online Operations

– Enhanced Online Redefinition

– Improved Handling of DDL Locks on Busy Tables

– Signature-Based Dependency Tracking Using Synonyms

– Rolling Upgrades with Data Guard SQL Apply



Business Challenge – How to Scale DBA’s to the Grid ?

Software Maintenance 6%

Ongoing System Management 55%

Installation 6%

Others

15%

Creation & Configuration 12 %

Source: IOUG 2001 DBA Survey

DataLoading 6%

Oracle10i System Management – Built-In Intelligent Infrastructure

Automatic Workload Repository – Automatically collects

statistics, SQL workload, Feature usage

– Base-lining capability– History

Automatic Maintenance Tasks– Pre-packaged, resource

controlled

Server-Generated Alerts– Out-of-the-box, Push vs. Pull,

Just-in-time

Oracle10i System Management – Automatic SGA Management

Only 2 memory parameters

Advisor helpsset parameters

Automatically resizes with changes in workload

Maximize usage of available memory

SGA Pool

PGA Pool

Large Batch Jobs

sort

Java Pool

SQL Cache

Large Pool

Buffer Cache

SQL Cache

sort

Online

Users

Large Pool

Buffer Cache

Java Pool

Oracle10i System Management – Self Optimizing SQL Management

Oracle Query Optimizer– Comprehensive set of access paths, adaptive search

strategy– All cost-based transformations– Preconfigured task to collect object and system statistics – If no statistics available, are collected at parse-time

Automatic memory allocations, automatic degree of parallelism

Automatic identification and capture of high-load SQL– Automatic SQL Tuning– Automatic SQL Analysis – SQL Access Advisor

Oracle10i System Management – Self Optimizing SQL Management

Automated capture and identification of high-load SQL

Automatic SQL Tuning

Automatic SQL Analysis

SQL Access Advisor

SQLProfile

PackagedApps

+

SQLAdvice

CustomApps

+

Indexes & MVs

CustomApps

+

Well-tuned SQL

High-load SQL

PackagedApps

CustomApps

Automatic Tuning Optimizer

Auto SQL Tuning

Auto SQL Analysis

AccessAdvisor

Oracle10g System Management – Automatic Database Diagnostic Monitor (ADDM)

Performance expert in a box

Automatically provides database-wide performance diagnosis, including RAC

Pinpoints root cause and non-problem areas

Runs proactively

Scalable Software Maintenance – Discover and Analyze Configurations

Complete inventory of all Oracle software– Versions– Patch levels

Oracle product configuration details Search and compare configurations Change tracking Reference configurations

Scalable Software Maintenance - Automated Software Cloning

Reduce manual labor in software life-cycle– From hours to minutes

Automate mass provisioning of reference systems

Update

Inventory

Clone to

Selected Targets

2

3

Select Software (and Instances) to Clone

1

Scalable Software Maintenance - Automated Patch Management

Real-time discovery of new patches – Security patch rapid deployment dramatically reduces

vulnerabilities Automatic staging and application

– From hours to minutes Rolling RAC upgrade

Update

Inventory

Determine

Applicability2

Apply Patch3

4Patch Published1

Oracle10g Manageability Features

Infrastructure– Easy OracleJVM

Monitoring– SYSAUX Tablespace– Enhanced Wait Model– Database Features Usage

Tracking– Enhanced Database Time

Model– Top Consumers

Performance Monitoring & Diagnostic

– JDBC: End-to-end Java/J2EE Tracing

– SQLJ: End-to-end Java/J2EE Tracing

– Automated Routine Administration Tasks

– Proactive Server-based Alerts and Notifications

– Database Statistics and Workload Respository

– Threshold-Based Alerts

Server Configuration– Automated Storage

Management Configuration

– Automated RAC Services Configuration

– Simplified Upgrade for RAC and OPS Databases

– Automated Enterprise Manager Configuration

– Automated Portable Clusterware Installation

– Automated Configuration of Recovery Area

– Out-of-the-box LDAP Configuration

– Simplified Initialization Parameters

– Easy Upgrade– Upgrade Information Tool– Simplified Database

Install– User Default Tablespace

Instance Tuning– User-Initiated Buffer Cache

Flushing– Database Resource Manager

- Adaptive Consumer Group Mapping

– Database Resource Manager - Fixed CPU Quota

– New Performance Overview Charts in Oracle Enterprise Manager

– Improved SQL Reporting Using Oracle Enterprise Manager

– Integration of Resource Manager and Profiles

– Automated Checkpoint Tuning

– Transaction Rollback & Recovery Monitoring

– Database Performance Analyzer

– Redo Logfile Sizing Advisor– Automated SGA Memory

Tuning

Application Tuning– SQLAccess Advisor– Materialized View Tuning

API– SQL Tuning Advisor– Enhanced SQLAccess

Advisor– Automatic Optimizer

Statistics Collection Backup and Recovery

– Enhanced RMAN Reporting

– Backup Compression– Bounded Backup Window– Manage RMAN Scripts– Recovery Area Full Alert

Storage Management – Multiple Default Temporary

Tablespace Support for SQL Operations

– Automated Storage Management

– Rename Tablespace

Oracle10g Manageability Features

Infrastructure– Easy OracleJVM

Monitoring– SYSAUX Tablespace– Enhanced Wait Model– Database Features Usage

Tracking– Enhanced Database Time

Model– Top Consumers

Performance Monitoring & Diagnostic

– JDBC: End-to-end Java/J2EE Tracing

– SQLJ: End-to-end Java/J2EE Tracing

– Automated Routine Administration Tasks

– Proactive Server-based Alerts and Notifications

– Database Statistics and Workload Respository

– Threshold-Based Alerts

Server Configuration– Automated Storage

Management Configuration

– Automated RAC Services Configuration

– Simplified Upgrade for RAC and OPS Databases

– Automated Enterprise Manager Configuration

– Automated Portable Clusterware Installation

– Automated Configuration of Recovery Area

– Out-of-the-box LDAP Configuration

– Simplified Initialization Parameters

– Easy Upgrade– Upgrade Information Tool– Simplified Database

Install– User Default Tablespace

Instance Tuning– User-Initiated Buffer Cache

Flushing– Database Resource Manager

- Adaptive Consumer Group Mapping

– Database Resource Manager - Fixed CPU Quota

– New Performance Overview Charts in Oracle Enterprise Manager

– Improved SQL Reporting Using Oracle Enterprise Manager

– Integration of Resource Manager and Profiles

– Automated Checkpoint Tuning

– Transaction Rollback & Recovery Monitoring

– Database Performance Analyzer

– Redo Logfile Sizing Advisor– Automated SGA Memory

Tuning

Application Tuning– SQLAccess Advisor– Materialized View Tuning

API– SQL Tuning Advisor– Enhanced SQLAccess

Advisor– Automatic Optimizer

Statistics Collection Backup and Recovery

– Enhanced RMAN Reporting

– Backup Compression– Bounded Backup Window– Manage RMAN Scripts– Recovery Area Full Alert

Storage Management – Multiple Default Temporary

Tablespace Support for SQL Operations

– Automated Storage Management

– Rename Tablespace

Oracle10g Manageability Features(continued)

Network Management – Back Up Directory Naming

Entries to Local Naming File

– Dynamic Connection Manager Configuration

– Easy Connect Naming Method

– Easy OCI/JDBC Install– Improved Network Outage

Detection– Automated LDAP

Discovery for Clients– Improved Connection

Manager Access Rules– Automated Shared Server

Configuration– Simplified Shared Server

Configuration Parameters

Space, Object, Transaction Mgmt

– Automatic Undo Retention Tuning

– Segment Shrink Advisor– Segment Size Estimation– Online Segment Shrink– Proactive Tablespace

Management– Undo Advisor

Database Utilities– SQL*Plus - SPOOL

CREATE, REPLACE, and APPEND Options

– SQL*Plus - Show Recycle Bin

– SQL*Plus - DBMS_OUTPUT After SELECT

– SQL*Plus - SET SQLPROMPT Runtime Variable Substitution

– SQL*Plus -COMPATIBILITY Command Line Option

– SQL*Plus - Run glogin.sql and login.sql After Each CONNECT

– iSQL*Plus Input Prompting

Scheduler– Core Scheduler Features– Usability and

Manageability– Monitoring– Recovery– Support for Jobs in a

Clustered Environment– Job Processing– ILMS Support– Increased Throughput– Redo Minimization– Dynamic Slave Pool

Oracle10g Manageability Features(continued)

Network Management – Back Up Directory Naming

Entries to Local Naming File

– Dynamic Connection Manager Configuration

– Easy Connect Naming Method

– Easy OCI/JDBC Install– Improved Network Outage

Detection– Automated LDAP

Discovery for Clients– Improved Connection

Manager Access Rules– Automated Shared Server

Configuration– Simplified Shared Server

Configuration Parameters

Space, Object, Transaction Mgmt

– Automatic Undo Retention Tuning

– Segment Shrink Advisor– Segment Size Estimation– Online Segment Shrink– Proactive Tablespace

Management– Undo Advisor

Database Utilities– SQL*Plus - SPOOL

CREATE, REPLACE, and APPEND Options

– SQL*Plus - Show Recycle Bin

– SQL*Plus - DBMS_OUTPUT After SELECT

– SQL*Plus - SET SQLPROMPT Runtime Variable Substitution

– SQL*Plus -COMPATIBILITY Command Line Option

– SQL*Plus - Run glogin.sql and login.sql After Each CONNECT

– iSQL*Plus Input Prompting

Scheduler– Core Scheduler Features– Usability and

Manageability– Monitoring– Recovery– Support for Jobs in a

Clustered Environment– Job Processing– ILMS Support– Increased Throughput– Redo Minimization– Dynamic Slave Pool



Transportable Tablespaces –Fastest Way to Provision Data

Oracle can unplug and plug database data files– Move and share data without unload and reload– Plug/unplug performance independent of

tablespace size– Mount read-only tablespaces on multiple

databases

2424

Now Works Cross-Platform!

Oracle10g Data Pump

High performance import and export – 60% faster than 9i export (single thread) – 15x-20x faster than 9i import (single thread)

Scales with parallel threads Network transfer data between databases

with no intermediate representation– Eg: no disk

Oracle Streams Oracle

Oracle Streams moves or copiestablespaces faster than FTP

Same platform or cross platform

Detach, move, attachwith one command



10g Real Time Warehouse Asynchronous CDC

SQL interface to change data Publish/subscribe paradigm Parallel access to log files, leveraging

Oracle Streams Parallel transformation of data

OLTPDB

Archivedlogfiles

Logical Change DataBased on

Streams

DWTables

SQL, PL/SQL,Java

Transform

Oracle10g Business Intelligence Features

Real Time Data Warehousing

– Asynchronous Change Data Capture

– Cross-Platform Transportable Tablespaces

– Enhanced Table Functions– External Tables Unload– Enhanced MERGE

Functionality– Data Pump Export and

Import Utilities– Parallel Data Pump Export

and Import– SQL*Loader Direct Path

Load Support for ROWID Datatype

– SQL*Loader Direct Path Load Support for VARRAY Datatype

– SQL*Loader Direct Path Load Support for XMLType Tables

VLDB– Bigfile Tablespace– Enhanced Partition

Management in Enterprise Manager

– Global Partitioned Indexes - Hash Partitioning

– Partitioned Index-Organized Tables - List Partitioning

– Partitioned Index-Organized Tables - LOB Support

– Partitioned Index-Organized Tables - Global Index Maintenance

– Enhanced Bitmap Index Performance and Space Management

– Local Partitioned Indexes Manageability Improvements

Summary Management– Summary Management

OLAP Query Performance Improvements

– Summary Management - Enhanced Partition-aware Materialized View Refresh

– Summary Management - EXPLAIN PLAN Shows Materialized View Access

– Summary Management - Enhanced Dimensions

– Summary Management - Nested Materialized View Refresh

– Summary Management - Enhanced PCT Refresh

– Summary Management - Query Rewrite Uses Multiple Materialized Views

OLAP – Parallel AGGREGATE

Command– Parallel SQL IMPORT

Command– PL/SQL Creation of

Analytic Workspaces– Intra-Dimensional

(Attribute) Aggregation– Enhanced Composite

Dimensions Indexing– PL/SQL OLAP Measure

Calculation Definition– Complete Analytical

Workspace Management– Multi-Writer Support– XML Interface for Analytic

Workspace

Oracle10g Business Intelligence Features

Real Time Data Warehousing

– Asynchronous Change Data Capture

– Cross-Platform Transportable Tablespaces

– Enhanced Table Functions– External Tables Unload– Enhanced MERGE

Functionality– Data Pump Export and

Import Utilities– Parallel Data Pump Export

and Import– SQL*Loader Direct Path

Load Support for ROWID Datatype

– SQL*Loader Direct Path Load Support for VARRAY Datatype

– SQL*Loader Direct Path Load Support for XMLType Tables

VLDB– Bigfile Tablespace– Enhanced Partition

Management in Enterprise Manager

– Global Partitioned Indexes - Hash Partitioning

– Partitioned Index-Organized Tables - List Partitioning

– Partitioned Index-Organized Tables - LOB Support

– Partitioned Index-Organized Tables - Global Index Maintenance

– Enhanced Bitmap Index Performance and Space Management

– Local Partitioned Indexes Manageability Improvements

Summary Management– Summary Management

OLAP Query Performance Improvements

– Summary Management - Enhanced Partition-aware Materialized View Refresh

– Summary Management - EXPLAIN PLAN Shows Materialized View Access

– Summary Management - Enhanced Dimensions

– Summary Management - Nested Materialized View Refresh

– Summary Management - Enhanced PCT Refresh

– Summary Management - Query Rewrite Uses Multiple Materialized Views

OLAP – Parallel AGGREGATE

Command– Parallel SQL IMPORT

Command– PL/SQL Creation of

Analytic Workspaces– Intra-Dimensional

(Attribute) Aggregation– Enhanced Composite

Dimensions Indexing– PL/SQL OLAP Measure

Calculation Definition– Complete Analytical

Workspace Management– Multi-Writer Support– XML Interface for Analytic

Workspace

Oracle10g Business Intelligence Features (Continued)

Data Mining – Frequent Itemsets– Attribute Importance

Algorithms– Enhanced Adaptive Bayes

Network– JSR-73 RI & TCK - Java

Data Mining– Multi-User Access Control– Complete Oracle Data

Mining Management– Enhanced Model Seeker– PMML Producers /

Consumers– Enhanced Data

Preprocessing– Data Mining Rapid

Application Development

Bio-informatics– DOUBLE and FLOAT

Datatypes– BLAST Queries– Statistical Functions– Document Clustering– Document Clustering Non-

negative Matrix Factorization

– Document Clustering Neural Nets

– Document Named Entity Extraction

– Support Vector Machines– Taxonomy Builder

SQL Analytics– Grouped Table Outer Join– Increased Number of

Aggregates per Query– SQL Interrow Calculations– Upsert Through SQL

Interrow Calculations

Oracle10g Business Intelligence Features (Continued)

Data Mining – Frequent Itemsets– Attribute Importance

Algorithms– Enhanced Adaptive Bayes

Network– JSR-73 RI & TCK - Java

Data Mining– Multi-User Access Control– Complete Oracle Data

Mining Management– Enhanced Model Seeker– PMML Producers /

Consumers– Enhanced Data

Preprocessing– Data Mining Rapid

Application Development

Bio-informatics– DOUBLE and FLOAT

Datatypes– BLAST Queries– Statistical Functions– Document Clustering– Document Clustering Non-

negative Matrix Factorization

– Document Clustering Neural Nets

– Document Named Entity Extraction

– Support Vector Machines– Taxonomy Builder

SQL Analytics– Grouped Table Outer Join– Increased Number of

Aggregates per Query– SQL Interrow Calculations– Upsert Through SQL

Interrow Calculations



Application Development on the Grid

Improved PL/SQL Performance

Database Web Services

HTML DB– Low Cost, Hosted,

Web Based Development Environment

HTML DB and the Grid - Business Problem

Departmental and LOB data sharing and information tracking

Lots and lots of desktop databases

Fragmented Inaccurate Untimely Vulnerable

HTML DB – the Perfect “Killer App” for the Grid ?

Productivity of a Desktop Database

Infrastructure of an Enterprise Database

Built for the Web Leverages the Grid

Thank YouQuestions and Answers ?

Documents

Thomas Kyte [email protected] Oracle Corporation