Storage Optimization with Oracle Database 11g · Reduce Storage Costs by Factor of 10x Data Growth...

Preview:

Citation preview

Storage Optimization

with Oracle Database 11g

Reduce Storage Costs by Factor of 10xData Growth Continues to Outpace Budget Growth

Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.

200

400

600

800

1000

1998 2000 2002 2004 2006 2008 2010

Te

rab

yte

s o

f D

ata

Rate of Database Growth

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

© 2010 Oracle Corporation

• Key metric is I/O per second (IOPs)

• Assume for sizing purposes:

– 5 IOPs per transaction

– 80-110 achievable IOPs per SAS disk

– 50 per achievable IOPs SATA disk

# Disks required = # Transactions per sec * 5

Achievable IOPs

Optimize Performance

Data

Warehouse

© 2010 Oracle Corporation

• Key metric is I/O per second (IOPs)

• Assume for sizing purposes:

– 5 IOPs per transaction

– 80-110 achievable IOPs per SAS disk

– 50 per achievable IOPs SATA disk

# Disks required = # Transactions per sec * 5

Achievable IOPs

• Key metric is I/O bandwidth (MB/s)

• Assume for sizing purposes:

– 1 core requires ~ 200 MB/s to be kept busy

– Drives today do around 20-30 MB/s

# Disks required = # Cores * 200/20

Optimize Performance

Data

Warehouse

OLTP

© 2010 Oracle Corporation

• Double disks for mirroring

• Add extra for back-up, test, etc.

• Size HBA and switches to keep throughput balanced

• Plan for linear performance scalability as data

volumes increase

Today, database performance is limited by storage

Optimize PerformanceDon’t Forget the Rest

Sun Oracle Database MachinePerfectly Balanced Environment

• Oracle Database Server Grid

– 8 Database Servers

– 400 GB DRAM

• Exadata Storage Server Grid

– 14 Storage Servers

– 5TB Smart Flash Cache

– 336 TB Disk Storage

• Unified Server/Storage Network

– 40 Gb/sec Infiniband Links

– 880 Gb/sec Aggregate Throughput

• Completely Fault Tolerant

• Extreme Performance out-of-the-box

© 2010 Oracle Corporation

Pre-built Database CloudOracle Exadata

• Best for Database Cloud

– Only database machine that runs and scales all workloads

– Lower total cost of ownership

– Faster Deployment

– Lower Risk

– Higher Quality Implementation

– Supports all Database Cloud capabilities

© 2010 Oracle Corporation

Exadata Storage ServersBreaks Data Bandwidth and Random I/O Bottleneck

• Sun Fire™ X4275 Server

• 2 Quad-Core Intel®

Xeon® E5540 CPUs

• 24GB RAM

• Dual-port 40Gb/s InfiniBand card

• Disk options:– 12 x 600 GB SAS disks (7.2 TB total)

– 12 x 2TB SATA disks (24 TB total)

• 4 x 96 GB Sun Flash PCIe Cards– 384GB total

Hardware by

Software by

© 2010 Oracle Corporation

Exadata Database Machine Breaks Data Bandwidth and Random I/O Bottleneck

• Removes Random I/O bottlenecks– Up to 75,000 IOPS with Flash storage

• Queries run in storage

– Offloading from database server CPUs

– Return query results sets

– Up to 1.5 GB/sec data bandwidth per cell

• Completely scalable infrastructure

– Storage capacity

– Processing power

– Data bandwidth

© 2010 Oracle Corporation

• Transparently extends buffer cache with flash storage

• Increases caching and eliminates most I/Os

• Faster response times using less power

• Available on Solaris and Unbreakable Linux servers

Database and Storage Smart Flash Cache

© 2010 Oracle Corporation

Integrated Solid State Storage Devices

2009

© 2010 Oracle Corporation

20102003 - 2008 2009

Q: What was the

total sales revenue

for Q3 in 2009?

Only the relevant

partitions are

accessed

Partition PruningImproves Performance

1 TB

with compression

10 TB of user data

Requires 10 TB of IO

100 GB

with partition pruning

20 GB

with Storage Indexes

5 GB Smart Scan on

Memory or Flash

Subsecond

On Database

Machine

Data is 10x Smaller, Scans are 2000x faster

Less Storage = Better PerformanceUsing Partitioning, Compression Benefits Multiply

© 2010 Oracle Corporation

“TUI chose the Sun Oracle Database Machine because it was the only platform that would meet both our needs for all of our database requirements, including OLTP, as well as be the best platform for a high performance data warehouse.”

Eli Lysen

Senior Manager, ICT

TUI

© 2010 Oracle Corporation

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Traditional Computing Environments

• Silos of dedicated

hardware and software

• Single application per silo

• Inefficient and expensive

to size for peak load

• Inflexible and

unresponsive to changing

business needs

• Expensive to manage

© 2010 Oracle Corporation

Cloud Computing Environments

• Resource pooling

• Rapid provisioning

• Elasticity

• Dynamic QoS

• Self-service

• Pay-for-use pricing

© 2010 Oracle Corporation

• Virtualizes and shares storage resources

• Online addition and migration of storage

• Advanced data striping for maximum I/O performance

Automatic Storage ManagementLowers the Cost of Storage Management

© 2010 Oracle Corporation

• General purpose clustered or local file system

• Optimized disk layout, online rebalance, mirroring

• Volume management, read-only snapshots

ASM Cluster File System

© 2010 Oracle Corporation

Database Files Oracle BinariesOS Files

Manage Data Growth Partition for Better Management

2009

© 2010 Oracle Corporation

20102003 - 2008 2009

• Full partition autonomy

– Partitions are visible and usable for database administration

– Optimized local indexing technique

• Full partition-aware maintenance operations

– Online maintenance capabilities without user impact or interference

ArchivalBulk of management

operations, queries etc.Data loading

“Using partitioning with Oracle Database gives us a lot of

advantages…we get the performance and management

characteristics of a much smaller table within a larger data set."

Sean WileyCTO & Director EDS Applications ServicesEDS

© 2010 Oracle Corporation

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Information Lifecycle ManagementManaging Data During its Lifetime to Reduce Storage Cost

Storage Networking Industry Association (SNIA) Data Management Forum

$ $$Total Cost of Ownership (TCO)

$$$

HighValue

MediumValue

LowValue

Valu

e a

t R

isk

© 2010 Oracle Corporation

Information Lifecycle ManagementManaging Data during its Lifetime to Reduce Storage Cost

Storage Networking Industry Association (SNIA) Data Management Forum

$ $$Total Cost of Ownership (TCO)

$$$

HighValue

MediumValue

LowValue

Va

lue

of

Info

rma

tio

n

© 2010 Oracle Corporation

30

kWh

2

kWh

Save on power, heating, cooling by moving data from High End to

Lower Cost storage devices

Manage Data Growth Partition to Reduce Cost

95% Less Active 5% Active

20102003 - 2008

2009

• Distribute tables across multiple storage tiers

• Scale-out storage at 2-3x less cost per terabyte

• No changes to existing applications

© 2010 Oracle Corporation

2009

Traditional Data Lifecycle

© 2010 Oracle Corporation

ActiveLess Active

HistoricalArchiveData Lifecycle

Less

ActiveHistorical ActiveArchive

High Performance

Storage Tier

$$$$

Offline

Archive

$

Information Lifecycle ManagementLower Cost by Matching Data to Storage

ActiveLess Active

HistoricalArchiveData Lifecycle

Less

ActiveHistorical ActiveArchive

© 2010 Oracle Corporation

High Performance

Storage Tier

$$$$

Low Cost

Storage Tier

$$$

Online Archive

Storage Tier

$$

Offline

Archive

$

SSD/Flash

Storage Tier

$$$$$

Information Lifecycle ManagementTaking Advantage of Flash Storage (R)evolution

© 2010 Oracle Corporation

ActiveLess Active

HistoricalArchiveData Lifecycle

Less

ActiveHistorical ActiveArchive

Hyper

Active

High Performance

Storage Tier

$$$$

Low Cost

Storage Tier

$$$

Online Archive

Storage Tier

$$

Offline

Archive

$

• Compress large OLTP and Data Warehouse tables

• Improve query performance for table scans

• No changes to existing applications

• Cascade storage savings throughout data center

Reduce Storage RequirementsAdvanced OLTP Compression

4XUp to

Compression

© 2010 Oracle Corporation

• 3x storage saving on production database– 4x table compression

– 2x index compression

– 2.3x LOB compression

• Savings cascade across test, backups & mirrors

Oracle’s Global Single Instance215 TB of Total Storage Savings!

LOBs

Indexes

Tables

Original

Compressed

© 2010 Oracle Corporation

50XUp to

• Data stored by column and then compressed

• Query mode for data warehousing tables– Typical 10x compression ratios

• Archival mode for old data– Typical 15-50x compression ratios

Oracle ExadataHybrid Columnar Compression

© 2010 Oracle Corporation

Other Compression Techniques

COMPRESSION TYPE: SUITABLE FOR:

Basic Compression Read only tables and partitions in Data

Warehouse environments or “inactive” data

partitions in OLTP environments.

OLTP Compression Active tables and partitions in OLTP and

Data Warehouse environments.

SecureFiles Compression Non-relational data in OLTP and Data

Warehouse environments.

Index Compression Indexes on tables in OLTP and Data

Warehouse environments.

Backup Compression All environments.

Hybrid Columnar Compression –

Data Warehousing

Read only tables and partitions in Data

Warehouse environments.

Hybrid Columnar Compression –

Archival

“Inactive” data partitions in OLTP and Data

Warehousing environments.

© 2010 Oracle Corporation

Feeling the Storage Squeeze?

© 2010 Oracle Corporation

“Our Chief Financial Officer likes the Advanced Compression

option of Oracle Database 11g because with it we won't need

two thirds of the disks we have right now.”

Mike Prince

Chief Technology Officer

Burlington Coat Factory

© 2010 Oracle Corporation

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Protect Against Data Loss ASM Mirroring

• Efficient 3-way mirroring and striping

• Flexible redundancy choices

• Complements hardware RAID mirror and parity protection

ASM Disk Group

© 2010 Oracle Corporation

Oracle Secure Backup

• Unified backup management

• Comprehensive tape data protection:

– Unix / Linux / Windows / NAS file systems

– Oracle Databases: Oracle9i forward

• Secure inter-domain communications

• Central administration for distributed backups

• Supports over 200 tape devices

• Read-only Tables & Tablespaces reduce the need

to backup

© 2010 Oracle Corporation

Comprehensive Oracle Data Validation

• Oracle Database checks to detect and repair corruptions– In data and redo blocks using checksum validation

– Detects writes acknowledged, but actually lost by the I/O subsystem

• Various checks can be configured by the administrator– Choose the desired protection level

– Can be configured for data blocks / data + index blocks

• Specific technologies provide additional validation– Recovery Manager

– Automatic Storage Management

– Data Guard

© 2010 Oracle Corporation

Recovery Manager

Active Data Guard

Automatic Storage Management

Real Application Clusters

Data Guard

Secure Backups to Cloud and Tape

© 2010 Oracle Corporation

Efficiently Backup and Restore Data Utilizing Integrated Tiered Storage

Revolution in Error RecoveryFlashback Operates on Changed Data Only

• Reduces correction time from hours to minutes

– No longer a factor of database size

• Applies to all types of user errors

– End users

– Developers

– Administrators

• Simple to use

– Single command instead of complex procedures

– Much faster and easier than traditional recovery

Correction Time = Error Time + f(DB_SIZE)

© 2010 Oracle Corporation

© 2010 Oracle Corporation

• Less expensive than remotely mirrored storage

• Less network bandwidth required

• Data corruptions not propagated

• Standby database can be utilized

Production

Database

Standby

Database

Protect Against Loss Through Disaster Oracle Data Guard

“With Oracle Active Data Guard we maintain 24 by 7

availability to client application services while also making

available our physical standby database to customers for

read-only access for reports and queries.”

Sue MerriganDirector, Information ManagementIntermap Technologies

© 2010 Oracle Corporation

© 2010 Oracle Corporation

Storage Management What Customers Think…

Storage Goals

MitigateRisk

Reduce Cost

Efficient Management

Critical Storage Challenges

Storage

Optimize Performance

Manage Better

Reduce Costs

Data Loss Protection

© 2010 Oracle Corporation

Summary

• Many customers are successfully deploying

Private Database Clouds today

• They are benefiting from high quality of service,

low cost, reduced complexity and increased

agility

• Private Database Clouds consolidate servers,

storage, operating systems, databases, and

workloads

• Exadata is a pre-integrated, highly optimized

platform for deploying Private Database Clouds

that maximizes ROI

© 2010 Oracle Corporation

For More Information

http://search.oracle.com

or

oracle.com/database

storage management

© 2010 Oracle Corporation

© 2010 Oracle Corporation

Recommended