Upload
others
View
10
Download
0
Embed Size (px)
Citation preview
Storage Optimization
with Oracle Database 11g
Reduce Storage Costs by Factor of 10xData Growth Continues to Outpace Budget Growth
Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.
200
400
600
800
1000
1998 2000 2002 2004 2006 2008 2010
Te
rab
yte
s o
f D
ata
Rate of Database Growth
Storage Goals
MitigateRisk
Reduce Cost
Efficient Management
Critical Storage Challenges
Storage
Optimize Performance
Manage Better
Reduce Costs
Data Loss Protection
© 2010 Oracle Corporation
Storage Goals
MitigateRisk
Reduce Cost
Efficient Management
Critical Storage Challenges
Storage
Optimize Performance
Manage Better
Reduce Costs
Data Loss Protection
© 2010 Oracle Corporation
© 2010 Oracle Corporation
• Key metric is I/O per second (IOPs)
• Assume for sizing purposes:
– 5 IOPs per transaction
– 80-110 achievable IOPs per SAS disk
– 50 per achievable IOPs SATA disk
# Disks required = # Transactions per sec * 5
Achievable IOPs
Optimize Performance
Data
Warehouse
© 2010 Oracle Corporation
• Key metric is I/O per second (IOPs)
• Assume for sizing purposes:
– 5 IOPs per transaction
– 80-110 achievable IOPs per SAS disk
– 50 per achievable IOPs SATA disk
# Disks required = # Transactions per sec * 5
Achievable IOPs
• Key metric is I/O bandwidth (MB/s)
• Assume for sizing purposes:
– 1 core requires ~ 200 MB/s to be kept busy
– Drives today do around 20-30 MB/s
# Disks required = # Cores * 200/20
Optimize Performance
Data
Warehouse
OLTP
© 2010 Oracle Corporation
• Double disks for mirroring
• Add extra for back-up, test, etc.
• Size HBA and switches to keep throughput balanced
• Plan for linear performance scalability as data
volumes increase
Today, database performance is limited by storage
Optimize PerformanceDon’t Forget the Rest
Sun Oracle Database MachinePerfectly Balanced Environment
• Oracle Database Server Grid
– 8 Database Servers
– 400 GB DRAM
• Exadata Storage Server Grid
– 14 Storage Servers
– 5TB Smart Flash Cache
– 336 TB Disk Storage
• Unified Server/Storage Network
– 40 Gb/sec Infiniband Links
– 880 Gb/sec Aggregate Throughput
• Completely Fault Tolerant
• Extreme Performance out-of-the-box
© 2010 Oracle Corporation
Pre-built Database CloudOracle Exadata
• Best for Database Cloud
– Only database machine that runs and scales all workloads
– Lower total cost of ownership
– Faster Deployment
– Lower Risk
– Higher Quality Implementation
– Supports all Database Cloud capabilities
© 2010 Oracle Corporation
Exadata Storage ServersBreaks Data Bandwidth and Random I/O Bottleneck
• Sun Fire™ X4275 Server
• 2 Quad-Core Intel®
Xeon® E5540 CPUs
• 24GB RAM
• Dual-port 40Gb/s InfiniBand card
• Disk options:– 12 x 600 GB SAS disks (7.2 TB total)
– 12 x 2TB SATA disks (24 TB total)
• 4 x 96 GB Sun Flash PCIe Cards– 384GB total
Hardware by
Software by
© 2010 Oracle Corporation
Exadata Database Machine Breaks Data Bandwidth and Random I/O Bottleneck
• Removes Random I/O bottlenecks– Up to 75,000 IOPS with Flash storage
• Queries run in storage
– Offloading from database server CPUs
– Return query results sets
– Up to 1.5 GB/sec data bandwidth per cell
• Completely scalable infrastructure
– Storage capacity
– Processing power
– Data bandwidth
© 2010 Oracle Corporation
• Transparently extends buffer cache with flash storage
• Increases caching and eliminates most I/Os
• Faster response times using less power
• Available on Solaris and Unbreakable Linux servers
Database and Storage Smart Flash Cache
© 2010 Oracle Corporation
Integrated Solid State Storage Devices
2009
© 2010 Oracle Corporation
20102003 - 2008 2009
Q: What was the
total sales revenue
for Q3 in 2009?
Only the relevant
partitions are
accessed
Partition PruningImproves Performance
1 TB
with compression
10 TB of user data
Requires 10 TB of IO
100 GB
with partition pruning
20 GB
with Storage Indexes
5 GB Smart Scan on
Memory or Flash
Subsecond
On Database
Machine
Data is 10x Smaller, Scans are 2000x faster
Less Storage = Better PerformanceUsing Partitioning, Compression Benefits Multiply
© 2010 Oracle Corporation
“TUI chose the Sun Oracle Database Machine because it was the only platform that would meet both our needs for all of our database requirements, including OLTP, as well as be the best platform for a high performance data warehouse.”
Eli Lysen
Senior Manager, ICT
TUI
© 2010 Oracle Corporation
Storage Goals
MitigateRisk
Reduce Cost
Efficient Management
Critical Storage Challenges
Storage
Optimize Performance
Manage Better
Reduce Costs
Data Loss Protection
© 2010 Oracle Corporation
Traditional Computing Environments
• Silos of dedicated
hardware and software
• Single application per silo
• Inefficient and expensive
to size for peak load
• Inflexible and
unresponsive to changing
business needs
• Expensive to manage
© 2010 Oracle Corporation
Cloud Computing Environments
• Resource pooling
• Rapid provisioning
• Elasticity
• Dynamic QoS
• Self-service
• Pay-for-use pricing
© 2010 Oracle Corporation
• Virtualizes and shares storage resources
• Online addition and migration of storage
• Advanced data striping for maximum I/O performance
Automatic Storage ManagementLowers the Cost of Storage Management
© 2010 Oracle Corporation
• General purpose clustered or local file system
• Optimized disk layout, online rebalance, mirroring
• Volume management, read-only snapshots
ASM Cluster File System
© 2010 Oracle Corporation
Database Files Oracle BinariesOS Files
Manage Data Growth Partition for Better Management
2009
© 2010 Oracle Corporation
20102003 - 2008 2009
• Full partition autonomy
– Partitions are visible and usable for database administration
– Optimized local indexing technique
• Full partition-aware maintenance operations
– Online maintenance capabilities without user impact or interference
ArchivalBulk of management
operations, queries etc.Data loading
“Using partitioning with Oracle Database gives us a lot of
advantages…we get the performance and management
characteristics of a much smaller table within a larger data set."
Sean WileyCTO & Director EDS Applications ServicesEDS
© 2010 Oracle Corporation
Storage Goals
MitigateRisk
Reduce Cost
Efficient Management
Critical Storage Challenges
Storage
Optimize Performance
Manage Better
Reduce Costs
Data Loss Protection
© 2010 Oracle Corporation
Information Lifecycle ManagementManaging Data During its Lifetime to Reduce Storage Cost
Storage Networking Industry Association (SNIA) Data Management Forum
$ $$Total Cost of Ownership (TCO)
$$$
HighValue
MediumValue
LowValue
Valu
e a
t R
isk
© 2010 Oracle Corporation
Information Lifecycle ManagementManaging Data during its Lifetime to Reduce Storage Cost
Storage Networking Industry Association (SNIA) Data Management Forum
$ $$Total Cost of Ownership (TCO)
$$$
HighValue
MediumValue
LowValue
Va
lue
of
Info
rma
tio
n
© 2010 Oracle Corporation
30
kWh
2
kWh
Save on power, heating, cooling by moving data from High End to
Lower Cost storage devices
Manage Data Growth Partition to Reduce Cost
95% Less Active 5% Active
20102003 - 2008
2009
• Distribute tables across multiple storage tiers
• Scale-out storage at 2-3x less cost per terabyte
• No changes to existing applications
© 2010 Oracle Corporation
2009
Traditional Data Lifecycle
© 2010 Oracle Corporation
ActiveLess Active
HistoricalArchiveData Lifecycle
Less
ActiveHistorical ActiveArchive
High Performance
Storage Tier
$$$$
Offline
Archive
$
Information Lifecycle ManagementLower Cost by Matching Data to Storage
ActiveLess Active
HistoricalArchiveData Lifecycle
Less
ActiveHistorical ActiveArchive
© 2010 Oracle Corporation
High Performance
Storage Tier
$$$$
Low Cost
Storage Tier
$$$
Online Archive
Storage Tier
$$
Offline
Archive
$
SSD/Flash
Storage Tier
$$$$$
Information Lifecycle ManagementTaking Advantage of Flash Storage (R)evolution
© 2010 Oracle Corporation
ActiveLess Active
HistoricalArchiveData Lifecycle
Less
ActiveHistorical ActiveArchive
Hyper
Active
High Performance
Storage Tier
$$$$
Low Cost
Storage Tier
$$$
Online Archive
Storage Tier
$$
Offline
Archive
$
• Compress large OLTP and Data Warehouse tables
• Improve query performance for table scans
• No changes to existing applications
• Cascade storage savings throughout data center
Reduce Storage RequirementsAdvanced OLTP Compression
4XUp to
Compression
© 2010 Oracle Corporation
• 3x storage saving on production database– 4x table compression
– 2x index compression
– 2.3x LOB compression
• Savings cascade across test, backups & mirrors
Oracle’s Global Single Instance215 TB of Total Storage Savings!
LOBs
Indexes
Tables
Original
Compressed
© 2010 Oracle Corporation
50XUp to
• Data stored by column and then compressed
• Query mode for data warehousing tables– Typical 10x compression ratios
• Archival mode for old data– Typical 15-50x compression ratios
Oracle ExadataHybrid Columnar Compression
© 2010 Oracle Corporation
Other Compression Techniques
COMPRESSION TYPE: SUITABLE FOR:
Basic Compression Read only tables and partitions in Data
Warehouse environments or “inactive” data
partitions in OLTP environments.
OLTP Compression Active tables and partitions in OLTP and
Data Warehouse environments.
SecureFiles Compression Non-relational data in OLTP and Data
Warehouse environments.
Index Compression Indexes on tables in OLTP and Data
Warehouse environments.
Backup Compression All environments.
Hybrid Columnar Compression –
Data Warehousing
Read only tables and partitions in Data
Warehouse environments.
Hybrid Columnar Compression –
Archival
“Inactive” data partitions in OLTP and Data
Warehousing environments.
© 2010 Oracle Corporation
Feeling the Storage Squeeze?
© 2010 Oracle Corporation
“Our Chief Financial Officer likes the Advanced Compression
option of Oracle Database 11g because with it we won't need
two thirds of the disks we have right now.”
Mike Prince
Chief Technology Officer
Burlington Coat Factory
© 2010 Oracle Corporation
Storage Goals
MitigateRisk
Reduce Cost
Efficient Management
Critical Storage Challenges
Storage
Optimize Performance
Manage Better
Reduce Costs
Data Loss Protection
© 2010 Oracle Corporation
Protect Against Data Loss ASM Mirroring
• Efficient 3-way mirroring and striping
• Flexible redundancy choices
• Complements hardware RAID mirror and parity protection
ASM Disk Group
© 2010 Oracle Corporation
Oracle Secure Backup
• Unified backup management
• Comprehensive tape data protection:
– Unix / Linux / Windows / NAS file systems
– Oracle Databases: Oracle9i forward
• Secure inter-domain communications
• Central administration for distributed backups
• Supports over 200 tape devices
• Read-only Tables & Tablespaces reduce the need
to backup
© 2010 Oracle Corporation
Comprehensive Oracle Data Validation
• Oracle Database checks to detect and repair corruptions– In data and redo blocks using checksum validation
– Detects writes acknowledged, but actually lost by the I/O subsystem
• Various checks can be configured by the administrator– Choose the desired protection level
– Can be configured for data blocks / data + index blocks
• Specific technologies provide additional validation– Recovery Manager
– Automatic Storage Management
– Data Guard
© 2010 Oracle Corporation
Recovery Manager
Active Data Guard
Automatic Storage Management
Real Application Clusters
Data Guard
Secure Backups to Cloud and Tape
© 2010 Oracle Corporation
Efficiently Backup and Restore Data Utilizing Integrated Tiered Storage
Revolution in Error RecoveryFlashback Operates on Changed Data Only
• Reduces correction time from hours to minutes
– No longer a factor of database size
• Applies to all types of user errors
– End users
– Developers
– Administrators
• Simple to use
– Single command instead of complex procedures
– Much faster and easier than traditional recovery
Correction Time = Error Time + f(DB_SIZE)
© 2010 Oracle Corporation
© 2010 Oracle Corporation
• Less expensive than remotely mirrored storage
• Less network bandwidth required
• Data corruptions not propagated
• Standby database can be utilized
Production
Database
Standby
Database
Protect Against Loss Through Disaster Oracle Data Guard
“With Oracle Active Data Guard we maintain 24 by 7
availability to client application services while also making
available our physical standby database to customers for
read-only access for reports and queries.”
Sue MerriganDirector, Information ManagementIntermap Technologies
© 2010 Oracle Corporation
© 2010 Oracle Corporation
Storage Management What Customers Think…
Storage Goals
MitigateRisk
Reduce Cost
Efficient Management
Critical Storage Challenges
Storage
Optimize Performance
Manage Better
Reduce Costs
Data Loss Protection
© 2010 Oracle Corporation
Summary
• Many customers are successfully deploying
Private Database Clouds today
• They are benefiting from high quality of service,
low cost, reduced complexity and increased
agility
• Private Database Clouds consolidate servers,
storage, operating systems, databases, and
workloads
• Exadata is a pre-integrated, highly optimized
platform for deploying Private Database Clouds
that maximizes ROI
© 2010 Oracle Corporation
For More Information
http://search.oracle.com
or
oracle.com/database
storage management
© 2010 Oracle Corporation
© 2010 Oracle Corporation