View
216
Download
0
Category
Preview:
Citation preview
3
Oracle Database 11g
• Major new release of Oracle functionality• In Beta since September 2006• Production expected in 2007
• Furthers the adoption of Grid Computing• Benefits
• Unique scale-out technology with single database image• Lowers server and storage costs• Increases availability and scalability
• Disruptive technology• Changes the game for the database industry• Changes the way data centers look and operate• Currently in rapid adoption phase
4
Sustained Innovation – Grid Computing
Grids oflow cost
hardware andstorage
RACClusters
forAvailability
SMPDominance
5
Well Proven Scalability
• RAC 8+ node customers• Citigroup
• Burlington Coat Factory
• J2 Global Communications
• Genworth Financial
• Amazon.com
• MSDS
• Mercado Libre
• Yahoo! Overture
• Babcock Engineering
• Ordnance Survey
• Dell
• Yahoo!
• SAIC
• Fairmont Hotels
• ADESLAS
• Evite.com
• Quelle AG
• Telstra
• Gas Natural
• MyTravel
• Thompson
• AOL
• Vivo
• Sagawa Kyubin
6
Example: Amazon Data Warehouse
• 51 TB row data• 71 TB of disk space
• RAC and ASM • Pure Scale-Out architecture• Both server and storage layer
• In top ten largest Warehouses in Winter Survey
• 50x growth in data in 6 years• More than doubled in last
year
16 Node RAC Linux Cluster4 CPUs per Node
Switch Switch Switch8 SAN switches, 32 port each
84 HP MSA-1000 Arrays
7
SKU 1 DB
SKU 2 DB
SKU 3 DB
SKU 4 DB
Stand
by for
SKU
5-8
DBs
SKU 5 DB
SKU 7 DB
SKU 6 DB
SKU 8 DB
Dataguard
Benefits Achieved
•Scalability - Easily Expanded Original 10 Node Cluster to 18 Nodes
•Improved Availability
•Disaster Tolerance with Dataguard
•Better Performance - Large Queries – 50% Faster
•Easier, Less Disruptive Storage Changes with ASM
•Significant Cost Savings, Better IT Productivity
18-node cluster IBM x-Series
Oracle RAC 10gR2
IBM xSeries – SUSE Linux
Data Center 2Data Center 1
Oracle ASM – Two diskgroups, one SAN, one SATA
Stand
by for
SKU
1-4
DBs
8
“Oracle customers are highly satisfied with its Real Application Clusters and Automatic Storage Management when pursuing scale-out strategies.”
Mark Beyer, GartnerDecember 2006
9
Business and Technology Status 2007
• Global economy is more dependent on IT than ever before
• Information management is THE major mission of the enterprise
• Organizations are being pushed to ADAPT quickly to change• Economic, Technologic, Regulatory• “At least two-thirds of all IT spending is just to sustain the
business, not to change or transform the business.”
- Gartner Group
10
Oracle Database11g Big Message
• Increases business and IT agility and lowers overall costs!• Enables change to happen while maintaining stability!• Takes management and diagnostic automation to the next
level!• Freeing key personal for higher value tasks!
• Simplifies your information infrastructure!• Provides the least expensive, most scalable, secure and
highly available information management and rapid application development environment!
12
Barriers to Change
• Proactive testing of upgrades is time consuming, costly, and often not as effective as needed• Upgrades still risk disruption of production systems
• Many upgrades still require significant downtime• Still have to endure potentially long period of
instability as bugs are found and fixed• DBAs are asked to do too much to help, e.g., diagnostic
patches that require more downtime • Software vendors take too long to fix bugs
14
The Need for Database Replay
• Businesses want to adopt new technology that adds value• Extensive testing and validation is expensive in time and cost• Despite expensive testing success rate low
• Many issues go undetected
• System availability and performance negatively impacted
• Cause of low success rate• Current tools provide inadequate testing
• Simulate synthetic workload instead of replaying actual production workload
• Provide partial workflow coverage
Database Replay makes real-world testing possible
15
Database Replay
• Replay actual production database workload in test environment
• Identify, analyze and fix potential instabilities before making changes to production
• Capture Workload in Production• Capture full production workload with real load, timing &
concurrency characteristics• Move the captured workload to test system
• Replay Workload in Test• Make the desired changes in test system• Replay workload with full production characteristics• Honor commit ordering
• Analyze & Report• Errors• Data divergence • Performance divergence
Analysis & Reporting
16
Database Replay: Supported Changes
Changes Unsupporte
d
Changes Supported•Database Upgrades, Patches
•Schema, Parameters
•RAC nodes, Interconnect
•OS Platforms, OS Upgrades
•CPU, Memory
•Storage
•Etc.
ClientClient
…Client
Middle Tier
Storage
Recording of External Client
Requests
17
0
20
40
60
80
Tim
e Tak
en (D
ays)
Install & Setup UnderstandApplication
Usage
Identify KeyTransactions
GenerateWorkload
Run Test
DB Replay
LoadRunner
2
205
4
80
24 20
DB Replay: 2 weeks
LoadRunner: 30 weeks
Total Testing Time
500
Comparison of LoadRunner & DB ReplayTesting e-Business Suite
18
To:From:
Why DB Replay?
Complete workflowsPartial workflows
Low riskHigh risk
AutomatedManual intensive
Production workloadsArtificial workloads
Days of developmentMonths of development
150Days
10Days
19
…
…
Database Replay Workflow
Production (10.2.0.4) Test (11.1)
Capture Replay Analysis &
Reporting Process
StorageStorage
Mid-Tier
Replay Driver
Clients
20
Make Change Safe
• Major online upgrade enhancements• Online database upgrades for Data Guard Physical Standby
• Physical Standby is Data Guard’s high performance disaster recovery solution• Uses new Transient Logical Standby feature for online
upgrades• Online Database Patching
• For most one-off patches including diagnostic patches
<Insert Picture Here>
Automate Still More Administrative FunctionsFreeing key personal for higher value tasks!
22
Why Automate?
• Free key personal for higher value tasks!• Increased DBA productivity• Reduce risk of DBA errors• Dramatically increase the QOS DBAs deliver
• More proactive management and planning• Continual optimized performance• Higher availability
23
Long Term Project
• Goal: Automate all administrative functions• Over three releases
• Begun in Oracle9i• Major focus in Oracle Database 10g• Continued major focus in Oracle Database 11g
• Three step process• Instrumentation – lays measurement infrastructure• Advisory – monitors the administrative function, identifies
sub-optimal behaviors, alerts DBA to problems, and advises on corrective actions
• Automation – gives DBAs the option to turn on full automation
24
Self Managing Database
Sto
rag
e
Ba
cku
p
Me
mo
ry
Ap
ps
/SQ
L
Sc
he
ma
RA
C
Re
co
ve
ry
Re
plic
ati
on
Auto-TuningTuning
Advisory
Instrumentation
25
Self Managing Database
Sto
rag
e
Ba
cku
p
Me
mo
ry
Ap
ps
/SQ
L
Sc
he
ma
RA
C
Re
co
ve
ry
Re
plic
ati
on
Auto-TuningTuning
Advisory
Instrumentation
26
Inst 1
• Automatic Database Diagnostics Managers (ADDM) for Real Applications Cluster (RAC)
• RAC expert in a box• Identifies performance
problems for the entire RAC cluster database
• Database-wide analysis of:• Global cache interconnect
issues• Global resource contention,
e.g. IO bandwidth, hot blocks
• Globally high-load SQL• Skew in instance response
timesAWR 1 AWR 2 AWR 3
Inst 2 Inst 3
Self-Diagnostic Engine
Database-Level ADDM
11g
Instance-Level ADDM
ADDM for RAC
27
Automatic SQL Tuning
• Automatically captures high-load SQL
• Automatically tunes SQL by creating SQL Profiles
• Automatically implements (optional) greatly improved SQL plans
• Automatically reports analysis • Automatically runs during
maintenance window
PackagedApps
Custom Apps
Automatic SQL Tuning
Auto Capture High-Load SQL
SQL Profiles
Nightly
Well-tuned SQL
Automatic implement
Manually implement
SQL Analysis
Report
28
Well-tunedSQL &
Schema
Partitioning Advisor
• Considers entire query workload to improve query performance
• Advises on partitioning methods • Range (equal-interval), range
key and interval• Hash, hash key
• Integrated, non-conflicting advice with Indexes, MVs
SQL Workload
PackagedApps
Custom Apps
SQL Advisor
SQL PlanTuning
SQLStructureAnalysis
AccessAnalysis
SQLProfile
SQLAdvice
Indexes& MVs
PartitionAnalysis
Partition Advice
New!
29
Automatic Memory Tuning
• Automatically adapts to workload changes
• Maximize memory utilization• Single dynamic memory
parameter• Helps eliminate out-of-
memory errors
OS Memory
DB Process Memory
DB Shared Memory
OS Memory
DB Shared Memory
DB Process Memory
<Insert Picture Here>
Simplify SystemsSimplify Your Information Infrastructure For Maximum Agility and Lowest Cost!
32
The Cost of Same Old Approach
• Poor Resource Utilization• Built for peak periods
• Gartner estimates average server utilization rate at 5-10%!
• Standby hardware and software costs virtually double the investment and further reduce useful utilization
• Management happens in silos• Uneven process maturity across managed silos
• Availability, security, performance• Increased staff• Proliferation of tools that have overlapping capabilities• Software patching/testing, upgrade tasks are multiplied
• Increases information complexity and lowers agility• More data movement required (i.e. increased latency, increased
storage, increased integrity issues)
33
Oracle Database 10g Database Grid
HR Financials DSS
Consolidate Workloads to a Single…Consolidate Workloads to a Single…
34
Oracle Database 10g Storage Grid
HR Financials DSS
Automatic
Storage Management
Low Cost Module StorageMonolithic Storage
35
• Fundamentally changes the value of redundant infrastructure
• Can now use Physical Standby for:• Reporting
• Read only Physical Standby• Online Upgrades
• Transient Logical Standby• Testing
• Snapshot Stanby• Backups
• Fast incremental backups
• Major performance enhancements too
NetworkBroker
ProductionDatabase
Logical StandbyDatabase
Open for Reports
SQLApply
Transform Redo to SQL
Physical StandbyDatabase
DIGITAL DATA S TORAGE
DIGITAL DATA S TORAGE
Backup
Redo Apply
Sync or Async Redo Shipping
Reporting
Production
Off-SiteDR-RO Queries
AdditionalIndexes &
Materialized Views
NetworkNetworkBrokerBroker
ProductionDatabase
Logical StandbyDatabase
Open for Reports
SQLApply
Transform Redo to SQL
Physical StandbyDatabase
DIGITAL DATA S TORAGE
DIGITAL DATA S TORAGE
Backup
Redo Apply
Sync or Async Redo Shipping
Reporting
Production
Off-SiteDR-RO Queries
AdditionalIndexes &
Materialized Views
Physical/ Snapshot StandbyDatabase
Open for Testing
SQLApply
Transform Redo to SQL
QA - Test
Changesqueued
Physical/ Snapshot StandbyDatabase
Open for Testing
SQLApply
Transform Redo to SQL
QA - Test
Changesqueued
Oracle Database 11g Data Guard
36
Oracle Database 11g SecureFiles
• SecureFiles• Eliminates need for file systems
• Just as fast as file systems with all the capabilities of the Oracle Database
• Store all your data in the database with one consistent:• Security and auditing model• Backup & recovery mechanism • Storage management mechanism (ASM)• Transaction and concurrency model• Interface and protocol
• Value added services like encryption, compression, and de-duplication
37
Oracle Database 11g Partitioning
• Major New Partitioning Enhancements• One consistent way to manage all your data
• Not just for data warehouse and high-end OLTP any more• New referential, virtual column, composite, and interval
partitioning features bring partitioning to mainstream• Easier management of today’s rapidly growing datasets• Improved performance
• Partition elimination speeds table scans • Reduced costs
• Automatically place less used data on lower cost storage
38
• Major New Partitioning Enhancements• Partition by parent / child reference
• e.g., partition orders and order_lines together
• Virtual column partitioning• e.g., partition on “virtual” order status “active”, “less active”, etc.
derived from multiple status fields in order record
• More composite partitioning options• List/Range, Range/Range, List/Hash, List/List
• e.g., Order Status/Month, Month/Day• Automatic interval partitioning
• e.g., create new partition every month • Single partition transportable tablespace
Oracle Database 11g Partitioning
39
Oracle Database 11g Flashback Data Archive
• Flashback Data Archive• Easy, practical way to add
“time dimension” to your data• For change tracking, ILM,
auditing, compliance, …• Query data “AS OF” any time in
the past• Efficient storage / retrieval of
undo data • Fast query access to very
old data • Can specified retention policy
to automatically purge old data
ORDERS
User Tablespaces
Flashback Data Archive
ArchiveTables
Changes
Select * from orders AS OF ‘Midnight 31-Dec-2003’
Total Recall
40
Flashback for Rapid Recovery from Human Error
FlashbackDatabase
FlashbackData Archive
and Transaction
FlashbackTables
FlashbackQuery
43
Storage Challenges
• Volume of managed data has exploded recently• Government regulations (Sarbanes-Oxley, HIPPA, etc)• User generated content (Web 2.0)• Mass adoption of rich multimedia content (audio, video, etc)
• IT managers expected to reduce technology budgets • Need to optimize storage consumption• Also maintain acceptable application performance
44
Introducing Advanced Compression
• Advanced compression in Oracle Database 11g• Structured data compression• Unstructured data compression• Compression for backup data• Network transport compression
• Reduces resource requirements and costs • Storage System• Network Bandwidth• Memory Usage
Backups
Redo Logs
Standby
45
Structured Data CompressionFor OLTP and Data Warehousing Applications
• Oracle introduced table compression in Oracle9i Database• Support for bulk load operations
• Oracle Database 11g extends compression for OLTP data• Support for conventional DML Operations
• Support for add/drop columns on compressed tables
• Significantly reduces disk space consumption• Typically 2 to 3x
• Improves the performance of queries• Up to 2x performance improvements for long running queries
• No uncompression required while reading compressed data• Completely transparent to applications
46
Unstructured Data CompressionOracle SecureFiles
• New feature in Oracle Database 11g• Secure, high performance, storage optimized solution• Documents, spreadsheets, images, multimedia, etc.• SecureFile Compression
• Automatically determines if SecureFile data is compressible• 2 to 3x compression for typical files• Industry standard compression algorithms• Multiple compression levels optimize performance & space
47
SecureFile De-duplication
• Multiple copies of identical SecureFiles are stored once• Faster performance for writes and copy operations• May improve read performance• Huge reduction in disk space usage
• Great for document management, email archiving etc.
Secure hash
48
Backup & Network Data Compression
• Data Pump compression• Compresses data unloaded from the database• Single step compression of both data and metadata
• Fast Recovery Manager (RMAN) compression• 40% faster backup compression
• Data Guard network compression• Compression of redo traffic over the network during redo gap
resolution• Improves redo transport performance• Gap resolution is up to 2x faster
49
Advanced Compressionin Oracle Database 11g
• Comprehensive set of data compression capabilities• Structured, unstructured, backup, network transport
• Reduces storage consumption by 2 – 3 times• Savings cascades into test, dev, QA, backup, DR environments
• Improves application performance
• Enhances memory and network efficiency
• Complete application transparency
• Benefits diverse application workloads• Transaction Processing
• Data Warehousing
• Content Management
50
Major New Performance Innovations
• SecureFiles• New generation LOBs just as fast as files
• Table Compression• Now for OLTP as well as DW applications
• Next Generation RAC Cache Fusion• Even more scalable
• Query Results caches • Fast caching of query/function results for read-mostly data
51
Major New Performance Innovations
• TimesTen • Application tier in-memory database gets even more
compatible with Oracle, more functional, and faster
• And much more …• Faster Data Guard and Streams replication• Faster PL/SQL and Java (automatic native compilation) • Faster triggers• Faster simple SQL operations• Faster NFS storage access (AutoNFS)• Faster upgrades • Faster backup/restore for large files• Faster backup compression
<Insert Picture Here>
Enrich Information Management and Application DevelopmentAcross the board improvements in information management and application development tools
53
Information Management Highlights
• Security• Transparent tablespace and
LOB Encryption
• Business Intelligence• OLAP integration with
materialized views
• Simplified Data Mining
• Integration• Faster Gateways
• New mainframe Gateways
• Distributed Scheduler
• XML DB• Binary XML storage
• Enhanced XML indexing
• Schema evolution
• interMedia• Comprehensive DICOM medical
imagery support
• 3X faster image processing
• Spatial• 3D support
• Improved maps
54
Application Development Highlights
• PL/SQL• Automatic compilation
• Java and JDBC• Automatic JIT compilation
• “Like JDK” ease of use
• Windows and .NET • Vista support
• Windows backup (VSS)
• PHP • Database Resident
Connection Pool
• Application Express• Microsoft Access application
migration
• Reporting – BI Publisher
• Flash charting
• Declarative “Ajax” support
• WYSIWYG editing
• SQL Developer• Version Control• Visual Query Builder• Migration Workbench
integration
55
Other Oracle Database 11g Highlights
• High Availability• Snapshot Standby• Logminer, Physical Standby, Streams
support for XMLType, TDE• Fast Start Failover with Async Propagation• Flashback Transaction• One step duplicate DB or create standby
over the network
• Security• Secure By Default • Comprehensive Enterprise Manager support
• Business Intelligence• Comprehensive Enterprise Manager support• PIVOT/UNPIVOT operators
• Automatic Storage Management• Rolling upgrades • Automatic bad block repair • Fast disk array resync• Preferred read for geo clusters
• Manageability and Diagnosability• Automatic Health Monitoring
• PL/SQL• Fine-grained dependency tracking• Dynamic SQL enhancements• Performance analysis aids
• Content Management• Storage & Query of Semantic Content (RDF,
OWL)• Secure Enterprise Search connectors• Text improvements
Recommended