48
Storage Optimization with Oracle Database 11g

Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Optimization

with Oracle Database 11g

Page 2: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Reduce Storage Costs by Factor of 10xData Growth Continues to Outpace Budget Growth

Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.

200

400

600

800

1000

1998 2000 2002 2004 2006 2008 2010

Te

rab

yte

s o

f D

ata

Rate of Database Growth

Page 3: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Page 4: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Page 5: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

© 2010 Oracle Corporation

• Key metric is I/O per second (IOPs)

• Assume for sizing purposes:

– 5 IOPs per transaction

– 80-110 achievable IOPs per SAS disk

– 50 per achievable IOPs SATA disk

# Disks required = # Transactions per sec * 5

Achievable IOPs

Optimize Performance

Data

Warehouse

Page 6: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

© 2010 Oracle Corporation

• Key metric is I/O per second (IOPs)

• Assume for sizing purposes:

– 5 IOPs per transaction

– 80-110 achievable IOPs per SAS disk

– 50 per achievable IOPs SATA disk

# Disks required = # Transactions per sec * 5

Achievable IOPs

• Key metric is I/O bandwidth (MB/s)

• Assume for sizing purposes:

– 1 core requires ~ 200 MB/s to be kept busy

– Drives today do around 20-30 MB/s

# Disks required = # Cores * 200/20

Optimize Performance

Data

Warehouse

OLTP

Page 7: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

© 2010 Oracle Corporation

• Double disks for mirroring

• Add extra for back-up, test, etc.

• Size HBA and switches to keep throughput balanced

• Plan for linear performance scalability as data

volumes increase

Today, database performance is limited by storage

Optimize PerformanceDon’t Forget the Rest

Page 8: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Sun Oracle Database MachinePerfectly Balanced Environment

• Oracle Database Server Grid

– 8 Database Servers

– 400 GB DRAM

• Exadata Storage Server Grid

– 14 Storage Servers

– 5TB Smart Flash Cache

– 336 TB Disk Storage

• Unified Server/Storage Network

– 40 Gb/sec Infiniband Links

– 880 Gb/sec Aggregate Throughput

• Completely Fault Tolerant

• Extreme Performance out-of-the-box

© 2010 Oracle Corporation

Page 9: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Pre-built Database CloudOracle Exadata

• Best for Database Cloud

– Only database machine that runs and scales all workloads

– Lower total cost of ownership

– Faster Deployment

– Lower Risk

– Higher Quality Implementation

– Supports all Database Cloud capabilities

© 2010 Oracle Corporation

Page 10: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Exadata Storage ServersBreaks Data Bandwidth and Random I/O Bottleneck

• Sun Fire™ X4275 Server

• 2 Quad-Core Intel®

Xeon® E5540 CPUs

• 24GB RAM

• Dual-port 40Gb/s InfiniBand card

• Disk options:– 12 x 600 GB SAS disks (7.2 TB total)

– 12 x 2TB SATA disks (24 TB total)

• 4 x 96 GB Sun Flash PCIe Cards– 384GB total

Hardware by

Software by

© 2010 Oracle Corporation

Page 11: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Exadata Database Machine Breaks Data Bandwidth and Random I/O Bottleneck

• Removes Random I/O bottlenecks– Up to 75,000 IOPS with Flash storage

• Queries run in storage

– Offloading from database server CPUs

– Return query results sets

– Up to 1.5 GB/sec data bandwidth per cell

• Completely scalable infrastructure

– Storage capacity

– Processing power

– Data bandwidth

© 2010 Oracle Corporation

Page 12: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

• Transparently extends buffer cache with flash storage

• Increases caching and eliminates most I/Os

• Faster response times using less power

• Available on Solaris and Unbreakable Linux servers

Database and Storage Smart Flash Cache

© 2010 Oracle Corporation

Integrated Solid State Storage Devices

Page 13: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

2009

© 2010 Oracle Corporation

20102003 - 2008 2009

Q: What was the

total sales revenue

for Q3 in 2009?

Only the relevant

partitions are

accessed

Partition PruningImproves Performance

Page 14: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

1 TB

with compression

10 TB of user data

Requires 10 TB of IO

100 GB

with partition pruning

20 GB

with Storage Indexes

5 GB Smart Scan on

Memory or Flash

Subsecond

On Database

Machine

Data is 10x Smaller, Scans are 2000x faster

Less Storage = Better PerformanceUsing Partitioning, Compression Benefits Multiply

© 2010 Oracle Corporation

Page 15: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

“TUI chose the Sun Oracle Database Machine because it was the only platform that would meet both our needs for all of our database requirements, including OLTP, as well as be the best platform for a high performance data warehouse.”

Eli Lysen

Senior Manager, ICT

TUI

© 2010 Oracle Corporation

Page 16: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Page 17: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Traditional Computing Environments

• Silos of dedicated

hardware and software

• Single application per silo

• Inefficient and expensive

to size for peak load

• Inflexible and

unresponsive to changing

business needs

• Expensive to manage

© 2010 Oracle Corporation

Page 18: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Cloud Computing Environments

• Resource pooling

• Rapid provisioning

• Elasticity

• Dynamic QoS

• Self-service

• Pay-for-use pricing

© 2010 Oracle Corporation

Page 19: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

• Virtualizes and shares storage resources

• Online addition and migration of storage

• Advanced data striping for maximum I/O performance

Automatic Storage ManagementLowers the Cost of Storage Management

© 2010 Oracle Corporation

Page 20: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

• General purpose clustered or local file system

• Optimized disk layout, online rebalance, mirroring

• Volume management, read-only snapshots

ASM Cluster File System

© 2010 Oracle Corporation

Database Files Oracle BinariesOS Files

Page 21: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Manage Data Growth Partition for Better Management

2009

© 2010 Oracle Corporation

20102003 - 2008 2009

• Full partition autonomy

– Partitions are visible and usable for database administration

– Optimized local indexing technique

• Full partition-aware maintenance operations

– Online maintenance capabilities without user impact or interference

ArchivalBulk of management

operations, queries etc.Data loading

Page 22: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

“Using partitioning with Oracle Database gives us a lot of

advantages…we get the performance and management

characteristics of a much smaller table within a larger data set."

Sean WileyCTO & Director EDS Applications ServicesEDS

© 2010 Oracle Corporation

Page 23: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Page 24: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Information Lifecycle ManagementManaging Data During its Lifetime to Reduce Storage Cost

Storage Networking Industry Association (SNIA) Data Management Forum

$ $$Total Cost of Ownership (TCO)

$$$

HighValue

MediumValue

LowValue

Valu

e a

t R

isk

© 2010 Oracle Corporation

Page 25: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Information Lifecycle ManagementManaging Data during its Lifetime to Reduce Storage Cost

Storage Networking Industry Association (SNIA) Data Management Forum

$ $$Total Cost of Ownership (TCO)

$$$

HighValue

MediumValue

LowValue

Va

lue

of

Info

rma

tio

n

© 2010 Oracle Corporation

30

kWh

2

kWh

Save on power, heating, cooling by moving data from High End to

Lower Cost storage devices

Page 26: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Manage Data Growth Partition to Reduce Cost

95% Less Active 5% Active

20102003 - 2008

2009

• Distribute tables across multiple storage tiers

• Scale-out storage at 2-3x less cost per terabyte

• No changes to existing applications

© 2010 Oracle Corporation

2009

Page 27: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Traditional Data Lifecycle

© 2010 Oracle Corporation

ActiveLess Active

HistoricalArchiveData Lifecycle

Less

ActiveHistorical ActiveArchive

High Performance

Storage Tier

$$$$

Offline

Archive

$

Page 28: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Information Lifecycle ManagementLower Cost by Matching Data to Storage

ActiveLess Active

HistoricalArchiveData Lifecycle

Less

ActiveHistorical ActiveArchive

© 2010 Oracle Corporation

High Performance

Storage Tier

$$$$

Low Cost

Storage Tier

$$$

Online Archive

Storage Tier

$$

Offline

Archive

$

Page 29: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

SSD/Flash

Storage Tier

$$$$$

Information Lifecycle ManagementTaking Advantage of Flash Storage (R)evolution

© 2010 Oracle Corporation

ActiveLess Active

HistoricalArchiveData Lifecycle

Less

ActiveHistorical ActiveArchive

Hyper

Active

High Performance

Storage Tier

$$$$

Low Cost

Storage Tier

$$$

Online Archive

Storage Tier

$$

Offline

Archive

$

Page 30: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

• Compress large OLTP and Data Warehouse tables

• Improve query performance for table scans

• No changes to existing applications

• Cascade storage savings throughout data center

Reduce Storage RequirementsAdvanced OLTP Compression

4XUp to

Compression

© 2010 Oracle Corporation

Page 31: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

• 3x storage saving on production database– 4x table compression

– 2x index compression

– 2.3x LOB compression

• Savings cascade across test, backups & mirrors

Oracle’s Global Single Instance215 TB of Total Storage Savings!

LOBs

Indexes

Tables

Original

Compressed

© 2010 Oracle Corporation

Page 32: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

50XUp to

• Data stored by column and then compressed

• Query mode for data warehousing tables– Typical 10x compression ratios

• Archival mode for old data– Typical 15-50x compression ratios

Oracle ExadataHybrid Columnar Compression

© 2010 Oracle Corporation

Page 33: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Other Compression Techniques

COMPRESSION TYPE: SUITABLE FOR:

Basic Compression Read only tables and partitions in Data

Warehouse environments or “inactive” data

partitions in OLTP environments.

OLTP Compression Active tables and partitions in OLTP and

Data Warehouse environments.

SecureFiles Compression Non-relational data in OLTP and Data

Warehouse environments.

Index Compression Indexes on tables in OLTP and Data

Warehouse environments.

Backup Compression All environments.

Hybrid Columnar Compression –

Data Warehousing

Read only tables and partitions in Data

Warehouse environments.

Hybrid Columnar Compression –

Archival

“Inactive” data partitions in OLTP and Data

Warehousing environments.

© 2010 Oracle Corporation

Page 34: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Feeling the Storage Squeeze?

© 2010 Oracle Corporation

Page 35: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

“Our Chief Financial Officer likes the Advanced Compression

option of Oracle Database 11g because with it we won't need

two thirds of the disks we have right now.”

Mike Prince

Chief Technology Officer

Burlington Coat Factory

© 2010 Oracle Corporation

Page 36: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Page 37: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Protect Against Data Loss ASM Mirroring

• Efficient 3-way mirroring and striping

• Flexible redundancy choices

• Complements hardware RAID mirror and parity protection

ASM Disk Group

© 2010 Oracle Corporation

Page 38: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Oracle Secure Backup

• Unified backup management

• Comprehensive tape data protection:

– Unix / Linux / Windows / NAS file systems

– Oracle Databases: Oracle9i forward

• Secure inter-domain communications

• Central administration for distributed backups

• Supports over 200 tape devices

• Read-only Tables & Tablespaces reduce the need

to backup

© 2010 Oracle Corporation

Page 39: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Comprehensive Oracle Data Validation

• Oracle Database checks to detect and repair corruptions– In data and redo blocks using checksum validation

– Detects writes acknowledged, but actually lost by the I/O subsystem

• Various checks can be configured by the administrator– Choose the desired protection level

– Can be configured for data blocks / data + index blocks

• Specific technologies provide additional validation– Recovery Manager

– Automatic Storage Management

– Data Guard

© 2010 Oracle Corporation

Page 40: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Recovery Manager

Active Data Guard

Automatic Storage Management

Real Application Clusters

Data Guard

Secure Backups to Cloud and Tape

© 2010 Oracle Corporation

Efficiently Backup and Restore Data Utilizing Integrated Tiered Storage

Page 41: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Revolution in Error RecoveryFlashback Operates on Changed Data Only

• Reduces correction time from hours to minutes

– No longer a factor of database size

• Applies to all types of user errors

– End users

– Developers

– Administrators

• Simple to use

– Single command instead of complex procedures

– Much faster and easier than traditional recovery

Correction Time = Error Time + f(DB_SIZE)

© 2010 Oracle Corporation

Page 42: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

© 2010 Oracle Corporation

• Less expensive than remotely mirrored storage

• Less network bandwidth required

• Data corruptions not propagated

• Standby database can be utilized

Production

Database

Standby

Database

Protect Against Loss Through Disaster Oracle Data Guard

Page 43: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

“With Oracle Active Data Guard we maintain 24 by 7

availability to client application services while also making

available our physical standby database to customers for

read-only access for reports and queries.”

Sue MerriganDirector, Information ManagementIntermap Technologies

© 2010 Oracle Corporation

Page 44: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

© 2010 Oracle Corporation

Storage Management What Customers Think…

Page 45: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Page 46: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

Summary

• Many customers are successfully deploying

Private Database Clouds today

• They are benefiting from high quality of service,

low cost, reduced complexity and increased

agility

• Private Database Clouds consolidate servers,

storage, operating systems, databases, and

workloads

• Exadata is a pre-integrated, highly optimized

platform for deploying Private Database Clouds

that maximizes ROI

© 2010 Oracle Corporation

Page 47: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

For More Information

http://search.oracle.com

or

oracle.com/database

storage management

© 2010 Oracle Corporation

Page 48: Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Source: Winter TopTen Survey, Winter Corporation,

© 2010 Oracle Corporation