56
1

1. Oracle Database 11g Overview Gary Quarles Sales Consultant

Embed Size (px)

Citation preview

1

<Insert Picture Here>

Oracle Database 11g OverviewGary QuarlesSales Consultant

3

Oracle Database 11g

• Major new release of Oracle functionality• In Beta since September 2006• Production expected in 2007

• Furthers the adoption of Grid Computing• Benefits

• Unique scale-out technology with single database image• Lowers server and storage costs• Increases availability and scalability

• Disruptive technology• Changes the game for the database industry• Changes the way data centers look and operate• Currently in rapid adoption phase

4

Sustained Innovation – Grid Computing

Grids oflow cost

hardware andstorage

RACClusters

forAvailability

SMPDominance

5

Well Proven Scalability

• RAC 8+ node customers• Citigroup

• Burlington Coat Factory

• J2 Global Communications

• Genworth Financial

• Amazon.com

• MSDS

• Mercado Libre

• Yahoo! Overture

• Babcock Engineering

• Ordnance Survey

• Dell

• Yahoo!

• SAIC

• Fairmont Hotels

• ADESLAS

• Evite.com

• Quelle AG

• Telstra

• Gas Natural

• MyTravel

• Thompson

• AOL

• Vivo

• Sagawa Kyubin

6

Example: Amazon Data Warehouse

• 51 TB row data• 71 TB of disk space

• RAC and ASM • Pure Scale-Out architecture• Both server and storage layer

• In top ten largest Warehouses in Winter Survey

• 50x growth in data in 6 years• More than doubled in last

year

16 Node RAC Linux Cluster4 CPUs per Node

Switch Switch Switch8 SAN switches, 32 port each

84 HP MSA-1000 Arrays

7

SKU 1 DB

SKU 2 DB

SKU 3 DB

SKU 4 DB

Stand

by for

SKU

5-8

DBs

SKU 5 DB

SKU 7 DB

SKU 6 DB

SKU 8 DB

Dataguard

Benefits Achieved

•Scalability - Easily Expanded Original 10 Node Cluster to 18 Nodes

•Improved Availability

•Disaster Tolerance with Dataguard

•Better Performance - Large Queries – 50% Faster

•Easier, Less Disruptive Storage Changes with ASM

•Significant Cost Savings, Better IT Productivity

18-node cluster IBM x-Series

Oracle RAC 10gR2

IBM xSeries – SUSE Linux

Data Center 2Data Center 1

Oracle ASM – Two diskgroups, one SAN, one SATA

Stand

by for

SKU

1-4

DBs

8

“Oracle customers are highly satisfied with its Real Application Clusters and Automatic Storage Management when pursuing scale-out strategies.”

Mark Beyer, GartnerDecember 2006

9

Business and Technology Status 2007

• Global economy is more dependent on IT than ever before

• Information management is THE major mission of the enterprise

• Organizations are being pushed to ADAPT quickly to change• Economic, Technologic, Regulatory• “At least two-thirds of all IT spending is just to sustain the

business, not to change or transform the business.”

- Gartner Group

10

Oracle Database11g Big Message

• Increases business and IT agility and lowers overall costs!• Enables change to happen while maintaining stability!• Takes management and diagnostic automation to the next

level!• Freeing key personal for higher value tasks!

• Simplifies your information infrastructure!• Provides the least expensive, most scalable, secure and

highly available information management and rapid application development environment!

<Insert Picture Here>

Make Change SafeEnabling Change While Maintaining Stability

12

Barriers to Change

• Proactive testing of upgrades is time consuming, costly, and often not as effective as needed• Upgrades still risk disruption of production systems

• Many upgrades still require significant downtime• Still have to endure potentially long period of

instability as bugs are found and fixed• DBAs are asked to do too much to help, e.g., diagnostic

patches that require more downtime • Software vendors take too long to fix bugs

13

Database Replay

14

The Need for Database Replay

• Businesses want to adopt new technology that adds value• Extensive testing and validation is expensive in time and cost• Despite expensive testing success rate low

• Many issues go undetected

• System availability and performance negatively impacted

• Cause of low success rate• Current tools provide inadequate testing

• Simulate synthetic workload instead of replaying actual production workload

• Provide partial workflow coverage

Database Replay makes real-world testing possible

15

Database Replay

• Replay actual production database workload in test environment

• Identify, analyze and fix potential instabilities before making changes to production

• Capture Workload in Production• Capture full production workload with real load, timing &

concurrency characteristics• Move the captured workload to test system

• Replay Workload in Test• Make the desired changes in test system• Replay workload with full production characteristics• Honor commit ordering

• Analyze & Report• Errors• Data divergence • Performance divergence

Analysis & Reporting

16

Database Replay: Supported Changes

Changes Unsupporte

d

Changes Supported•Database Upgrades, Patches

•Schema, Parameters

•RAC nodes, Interconnect

•OS Platforms, OS Upgrades

•CPU, Memory

•Storage

•Etc.

ClientClient

…Client

Middle Tier

Storage

Recording of External Client

Requests

17

0

20

40

60

80

Tim

e Tak

en (D

ays)

Install & Setup UnderstandApplication

Usage

Identify KeyTransactions

GenerateWorkload

Run Test

DB Replay

LoadRunner

2

205

4

80

24 20

DB Replay: 2 weeks

LoadRunner: 30 weeks

Total Testing Time

500

Comparison of LoadRunner & DB ReplayTesting e-Business Suite

18

To:From:

Why DB Replay?

Complete workflowsPartial workflows

Low riskHigh risk

AutomatedManual intensive

Production workloadsArtificial workloads

Days of developmentMonths of development

150Days

10Days

19

Database Replay Workflow

Production (10.2.0.4) Test (11.1)

Capture Replay Analysis &

Reporting Process

StorageStorage

Mid-Tier

Replay Driver

Clients

20

Make Change Safe

• Major online upgrade enhancements• Online database upgrades for Data Guard Physical Standby

• Physical Standby is Data Guard’s high performance disaster recovery solution• Uses new Transient Logical Standby feature for online

upgrades• Online Database Patching

• For most one-off patches including diagnostic patches

<Insert Picture Here>

Automate Still More Administrative FunctionsFreeing key personal for higher value tasks!

22

Why Automate?

• Free key personal for higher value tasks!• Increased DBA productivity• Reduce risk of DBA errors• Dramatically increase the QOS DBAs deliver

• More proactive management and planning• Continual optimized performance• Higher availability

23

Long Term Project

• Goal: Automate all administrative functions• Over three releases

• Begun in Oracle9i• Major focus in Oracle Database 10g• Continued major focus in Oracle Database 11g

• Three step process• Instrumentation – lays measurement infrastructure• Advisory – monitors the administrative function, identifies

sub-optimal behaviors, alerts DBA to problems, and advises on corrective actions

• Automation – gives DBAs the option to turn on full automation

24

Self Managing Database

Sto

rag

e

Ba

cku

p

Me

mo

ry

Ap

ps

/SQ

L

Sc

he

ma

RA

C

Re

co

ve

ry

Re

plic

ati

on

Auto-TuningTuning

Advisory

Instrumentation

25

Self Managing Database

Sto

rag

e

Ba

cku

p

Me

mo

ry

Ap

ps

/SQ

L

Sc

he

ma

RA

C

Re

co

ve

ry

Re

plic

ati

on

Auto-TuningTuning

Advisory

Instrumentation

26

Inst 1

• Automatic Database Diagnostics Managers (ADDM) for Real Applications Cluster (RAC)

• RAC expert in a box• Identifies performance

problems for the entire RAC cluster database

• Database-wide analysis of:• Global cache interconnect

issues• Global resource contention,

e.g. IO bandwidth, hot blocks

• Globally high-load SQL• Skew in instance response

timesAWR 1 AWR 2 AWR 3

Inst 2 Inst 3

Self-Diagnostic Engine

Database-Level ADDM

11g

Instance-Level ADDM

ADDM for RAC

27

Automatic SQL Tuning

• Automatically captures high-load SQL

• Automatically tunes SQL by creating SQL Profiles

• Automatically implements (optional) greatly improved SQL plans

• Automatically reports analysis • Automatically runs during

maintenance window

PackagedApps

Custom Apps

Automatic SQL Tuning

Auto Capture High-Load SQL

SQL Profiles

Nightly

Well-tuned SQL

Automatic implement

Manually implement

SQL Analysis

Report

28

Well-tunedSQL &

Schema

Partitioning Advisor

• Considers entire query workload to improve query performance

• Advises on partitioning methods • Range (equal-interval), range

key and interval• Hash, hash key

• Integrated, non-conflicting advice with Indexes, MVs

SQL Workload

PackagedApps

Custom Apps

SQL Advisor

SQL PlanTuning

SQLStructureAnalysis

AccessAnalysis

SQLProfile

SQLAdvice

Indexes& MVs

PartitionAnalysis

Partition Advice

New!

29

Automatic Memory Tuning

• Automatically adapts to workload changes

• Maximize memory utilization• Single dynamic memory

parameter• Helps eliminate out-of-

memory errors

OS Memory

DB Process Memory

DB Shared Memory

OS Memory

DB Shared Memory

DB Process Memory

<Insert Picture Here>

Simplify SystemsSimplify Your Information Infrastructure For Maximum Agility and Lowest Cost!

31

HR HRStandby

FinanceStandby

Finance

DSSStandby

DSS

Old Pre-Grid Infrastructure

32

The Cost of Same Old Approach

• Poor Resource Utilization• Built for peak periods

• Gartner estimates average server utilization rate at 5-10%!

• Standby hardware and software costs virtually double the investment and further reduce useful utilization

• Management happens in silos• Uneven process maturity across managed silos

• Availability, security, performance• Increased staff• Proliferation of tools that have overlapping capabilities• Software patching/testing, upgrade tasks are multiplied

• Increases information complexity and lowers agility• More data movement required (i.e. increased latency, increased

storage, increased integrity issues)

33

Oracle Database 10g Database Grid

HR Financials DSS

Consolidate Workloads to a Single…Consolidate Workloads to a Single…

34

Oracle Database 10g Storage Grid

HR Financials DSS

Automatic

Storage Management

Low Cost Module StorageMonolithic Storage

35

• Fundamentally changes the value of redundant infrastructure

• Can now use Physical Standby for:• Reporting

• Read only Physical Standby• Online Upgrades

• Transient Logical Standby• Testing

• Snapshot Stanby• Backups

• Fast incremental backups

• Major performance enhancements too

NetworkBroker

ProductionDatabase

Logical StandbyDatabase

Open for Reports

SQLApply

Transform Redo to SQL

Physical StandbyDatabase

DIGITAL DATA S TORAGE

DIGITAL DATA S TORAGE

Backup

Redo Apply

Sync or Async Redo Shipping

Reporting

Production

Off-SiteDR-RO Queries

AdditionalIndexes &

Materialized Views

NetworkNetworkBrokerBroker

ProductionDatabase

Logical StandbyDatabase

Open for Reports

SQLApply

Transform Redo to SQL

Physical StandbyDatabase

DIGITAL DATA S TORAGE

DIGITAL DATA S TORAGE

Backup

Redo Apply

Sync or Async Redo Shipping

Reporting

Production

Off-SiteDR-RO Queries

AdditionalIndexes &

Materialized Views

Physical/ Snapshot StandbyDatabase

Open for Testing

SQLApply

Transform Redo to SQL

QA - Test

Changesqueued

Physical/ Snapshot StandbyDatabase

Open for Testing

SQLApply

Transform Redo to SQL

QA - Test

Changesqueued

Oracle Database 11g Data Guard

36

Oracle Database 11g SecureFiles

• SecureFiles• Eliminates need for file systems

• Just as fast as file systems with all the capabilities of the Oracle Database

• Store all your data in the database with one consistent:• Security and auditing model• Backup & recovery mechanism • Storage management mechanism (ASM)• Transaction and concurrency model• Interface and protocol

• Value added services like encryption, compression, and de-duplication

37

Oracle Database 11g Partitioning

• Major New Partitioning Enhancements• One consistent way to manage all your data

• Not just for data warehouse and high-end OLTP any more• New referential, virtual column, composite, and interval

partitioning features bring partitioning to mainstream• Easier management of today’s rapidly growing datasets• Improved performance

• Partition elimination speeds table scans • Reduced costs

• Automatically place less used data on lower cost storage

38

• Major New Partitioning Enhancements• Partition by parent / child reference

• e.g., partition orders and order_lines together

• Virtual column partitioning• e.g., partition on “virtual” order status “active”, “less active”, etc.

derived from multiple status fields in order record

• More composite partitioning options• List/Range, Range/Range, List/Hash, List/List

• e.g., Order Status/Month, Month/Day• Automatic interval partitioning

• e.g., create new partition every month • Single partition transportable tablespace

Oracle Database 11g Partitioning

39

Oracle Database 11g Flashback Data Archive

• Flashback Data Archive• Easy, practical way to add

“time dimension” to your data• For change tracking, ILM,

auditing, compliance, …• Query data “AS OF” any time in

the past• Efficient storage / retrieval of

undo data • Fast query access to very

old data • Can specified retention policy

to automatically purge old data

ORDERS

User Tablespaces

Flashback Data Archive

ArchiveTables

Changes

Select * from orders AS OF ‘Midnight 31-Dec-2003’

Total Recall

40

Flashback for Rapid Recovery from Human Error

FlashbackDatabase

FlashbackData Archive

and Transaction

FlashbackTables

FlashbackQuery

<Insert Picture Here>

Enhance PerformanceMajor New Performance Innovations

Advanced Compression in Oracle Database 11g

43

Storage Challenges

• Volume of managed data has exploded recently• Government regulations (Sarbanes-Oxley, HIPPA, etc)• User generated content (Web 2.0)• Mass adoption of rich multimedia content (audio, video, etc)

• IT managers expected to reduce technology budgets • Need to optimize storage consumption• Also maintain acceptable application performance

44

Introducing Advanced Compression

• Advanced compression in Oracle Database 11g• Structured data compression• Unstructured data compression• Compression for backup data• Network transport compression

• Reduces resource requirements and costs • Storage System• Network Bandwidth• Memory Usage

Backups

Redo Logs

Standby

45

Structured Data CompressionFor OLTP and Data Warehousing Applications

• Oracle introduced table compression in Oracle9i Database• Support for bulk load operations

• Oracle Database 11g extends compression for OLTP data• Support for conventional DML Operations

• Support for add/drop columns on compressed tables

• Significantly reduces disk space consumption• Typically 2 to 3x

• Improves the performance of queries• Up to 2x performance improvements for long running queries

• No uncompression required while reading compressed data• Completely transparent to applications

46

Unstructured Data CompressionOracle SecureFiles

• New feature in Oracle Database 11g• Secure, high performance, storage optimized solution• Documents, spreadsheets, images, multimedia, etc.• SecureFile Compression

• Automatically determines if SecureFile data is compressible• 2 to 3x compression for typical files• Industry standard compression algorithms• Multiple compression levels optimize performance & space

47

SecureFile De-duplication

• Multiple copies of identical SecureFiles are stored once• Faster performance for writes and copy operations• May improve read performance• Huge reduction in disk space usage

• Great for document management, email archiving etc.

Secure hash

48

Backup & Network Data Compression

• Data Pump compression• Compresses data unloaded from the database• Single step compression of both data and metadata

• Fast Recovery Manager (RMAN) compression• 40% faster backup compression

• Data Guard network compression• Compression of redo traffic over the network during redo gap

resolution• Improves redo transport performance• Gap resolution is up to 2x faster

49

Advanced Compressionin Oracle Database 11g

• Comprehensive set of data compression capabilities• Structured, unstructured, backup, network transport

• Reduces storage consumption by 2 – 3 times• Savings cascades into test, dev, QA, backup, DR environments

• Improves application performance

• Enhances memory and network efficiency

• Complete application transparency

• Benefits diverse application workloads• Transaction Processing

• Data Warehousing

• Content Management

50

Major New Performance Innovations

• SecureFiles• New generation LOBs just as fast as files

• Table Compression• Now for OLTP as well as DW applications

• Next Generation RAC Cache Fusion• Even more scalable

• Query Results caches • Fast caching of query/function results for read-mostly data

51

Major New Performance Innovations

• TimesTen • Application tier in-memory database gets even more

compatible with Oracle, more functional, and faster

• And much more …• Faster Data Guard and Streams replication• Faster PL/SQL and Java (automatic native compilation) • Faster triggers• Faster simple SQL operations• Faster NFS storage access (AutoNFS)• Faster upgrades • Faster backup/restore for large files• Faster backup compression

<Insert Picture Here>

Enrich Information Management and Application DevelopmentAcross the board improvements in information management and application development tools

53

Information Management Highlights

• Security• Transparent tablespace and

LOB Encryption

• Business Intelligence• OLAP integration with

materialized views

• Simplified Data Mining

• Integration• Faster Gateways

• New mainframe Gateways

• Distributed Scheduler

• XML DB• Binary XML storage

• Enhanced XML indexing

• Schema evolution

• interMedia• Comprehensive DICOM medical

imagery support

• 3X faster image processing

• Spatial• 3D support

• Improved maps

54

Application Development Highlights

• PL/SQL• Automatic compilation

• Java and JDBC• Automatic JIT compilation

• “Like JDK” ease of use

• Windows and .NET • Vista support

• Windows backup (VSS)

• PHP • Database Resident

Connection Pool

• Application Express• Microsoft Access application

migration

• Reporting – BI Publisher

• Flash charting

• Declarative “Ajax” support

• WYSIWYG editing

• SQL Developer• Version Control• Visual Query Builder• Migration Workbench

integration

55

Other Oracle Database 11g Highlights

• High Availability• Snapshot Standby• Logminer, Physical Standby, Streams

support for XMLType, TDE• Fast Start Failover with Async Propagation• Flashback Transaction• One step duplicate DB or create standby

over the network

• Security• Secure By Default • Comprehensive Enterprise Manager support

• Business Intelligence• Comprehensive Enterprise Manager support• PIVOT/UNPIVOT operators

• Automatic Storage Management• Rolling upgrades • Automatic bad block repair • Fast disk array resync• Preferred read for geo clusters

• Manageability and Diagnosability• Automatic Health Monitoring

• PL/SQL• Fine-grained dependency tracking• Dynamic SQL enhancements• Performance analysis aids

• Content Management• Storage & Query of Semantic Content (RDF,

OWL)• Secure Enterprise Search connectors• Text improvements

56

AQ&Q U E S T I O N SQ U E S T I O N S

A N S W E R SA N S W E R S