28

Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

Embed Size (px)

DESCRIPTION

Presentation from conference "Oracle Day 2011" in Estonia 11.03.2011 Nordic Hotel Forum

Citation preview

Page 1: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

1

Page 2: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

<Insert Picture Here>

The Power of Automated Tiered Storage Jan Okrasinski Oracle Day, Tallinn 11.03.2011

Page 3: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

3

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 4: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

4

The Storage Challenge… Reduce Cost, Improve Access, Retain Forever

VARIED DATA ACCESS 80% of data never used after 90 days. 72% state it is harder to find info within their company. 1

DATA DIVERSITY Multi-application/OS data sources stored in many repositories. Only 5% structured. 2

LENGTHY RETENTIONS Severe penalties for data loss with over half of companies requiring 100-year archives.

ENVIRONMENTAL LIMITS Storage consumes ~40% of datacenter power. Growing at 20% CAGR. 3

Massive Data Growth

Resource Constraints

Page 5: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

Drivers for Tiered Storage

Reduce Cost •  Match Data

Value to Storage

•  Actively Manage Data Lifecycle

5

Customer Financial Products People

Reduce Risk •  Satisfy Legal / Audit

Requirements •  Reduce Compliance risk •  Improve Business

Continuity •  Improve Service Levels

Increase Performance •  Leverage new

technologies without disrupting production environment

•  Remove stale data from production resources

•  Ease upgrades

Page 6: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

6

Is Tiered Storage Relevant for Me?

•  Capacity Growth Assumptions –  100 GB per day created –  3 copies made •  Copy 1 for real time use •  Copy 2 for local redundancy •  Copy 3 for Disaster Recovery

–  Annual Data Growth = 50% (IDC estimates it at 60%)

Data  Crea(on  

One  Week  

One  Month  

Six  Months  

One  Year  

Seven  Years  

One  Day  

100GB

300GB 2.1TB 9.0TB 54TB 109TB 1.25PB

Page 7: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

7

The Important Role of Tape

•  Economical “green” storage – superior for data at rest

–  Tape consumes 290x less energy than disk over 5 years1

•  Data growth makes disk too costly and too risky – even with deduplication –  Tape is 100,000 time more reliable then disk (bit error rate

1014 vs. 1019) –  Tape requires fewer technology refreshes –  RAID adds more components to fail

•  Tape provides the maximum –  Portability –  Capacity –  Security

•  Performance

Page 8: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

8

Exadata Smart

Flash Cache in Storage

Nodes

Database Smart Flash Cache

Flash Disks in Storage Array

•  Higher latency •  HW RAID/SAN bottlenecks •  Extra DRAM required •  Manual data placement •  Can be used as shared storage or

for mixed workloads

•  InfiniBand: low latency, high throughput

•  Smart cache, or mirrored flash storage

•  Write cache •  Flash cache shared by all cluster

nodes •  Uses F20 flash cards

Flash Use Cases Comparison

•  Lowest latency •  Linear scalability •  DAS flash array or PCIe

card •  Smart cache, read-only •  Node-specific

Page 9: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

9

Tiered Storage Foundation Cost Optimized

Single Tier of Disk Storage

Modern Multi-tiered Storage

Multi-tiered Disk Storage

Performance Disk $7 - $22/GB

100%

38%

62%

Flash Storage $40 - $54/GB

32%

6%

Capacity Disk $1 - $6/GB

Tape Drives $0.25 - $1/GB

Average ~$15,000/TB

Average ~$8,000/TB

Average ~$4,000/TB

60%

Page 10: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

10

Oracle Tiered Storage Industry-leading Cost, Capacity and Performance

Modern Multi-tiered Storage

Performance Disk

Flash Storage

32%

6%

Capacity Disk

Tape Drives 60%

Oracle Sun Flash Storage •  100x more power efficient than disk •  2x higher performance than disk

• Equals 4000 FC disks in only 1RU

Oracle StorageTek Tape •  290x more energy efficient and 3x

longer lasting than disk

•  5x better TCO then de-duplication1

•  #1 in Scalability, Quality and Reliability

Oracle Sun 6000 Storage Arrays •  Integrated SSDs •  4x cheaper than EMC

•  2x higher performing than EMC

Oracle Sun ZFS Storage Appliance •  Integrated DRAM and flash cache •  1.6x higher density than competition

•  1/3 less CapEx & OpEx vs. competition

Page 11: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

11

The Tiered Storage Challenge… •  Siloed –  Each tier managed separately

•  Inefficient –  Multiple resources over-provisioned

•  Complex to manage –  Manual intervention for data movement between tiers –  Numerous storage hardware resources to patch/manage/

maintain

AUTOMATED TIERED STORAGE Dynamically Access Optimal Storage Resources

Page 12: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

Where Does Tiered Storage Management Fit?

Storage Archive

Manager

Flash Tape

Content Management Applications

Business or Industry Application

Disk

4. Storage Tiered Storage Devices.

Page 13: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

13

How Does SAM Move Data Around Tiers of Storage Provides 4 Core Processes

•  Policy Based (keep up to 4 copies)

•  Non-Disruptive

•  Dynamic

•  Sustainable

•  Data ALWAYS available

Archiver

Stager

Releaser R

ecyc

ler

Page 14: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

14

SAM QFS: Manages Data on Tiered Storage

14

• Two integrated technologies − Quick File System (QFS): posix compliant

− Storage Archive Manager (SAM): Automated Tiered Storage Manager

• Access via standard interfaces including FC, iSCSI, NFS, CIFS

• Policy based dynamic archiving − Right information, right tier, right time

• Simplify storage management • Sustainable throughout the data lifecycle • Cost effective long term data protection

Page 15: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

15

Business Ready

Storage Systems

Future

Evolving Tiered Storage Environments Siloed > Consolidated > Optimized

© 2010 Oracle Corporation – Proprietary and Confidential

Past Today

Disk

Tape

Tape

Flash

FC/SAS/SATA

Unified Storage Exadata

NAS

Tape

FC / SAS / SATA

Increasing Simplicity, Efficiency, Cost Effectiveness

Software

Page 16: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

16

Tiered Storage Evolution Software Optimized Across Hardware Platforms

Modern Multi-tiered Storage

Performance Disk

Flash Storage

32%

6%

Capacity Disk

Tape Drives 60%

Oracle Database • Flash optimized • Automatically place data within

tiers of storage

• Policies to alert you to migrate data

• Built-in data protection

• Reduces storage costs by up to 10x

Oracle Sun Storage Archive Manager (SAM)

• Policy-based data management across all storage media

• Seamless disk/tape data protection for database environments

• Future protection from technology changes

Page 17: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

17

Tiered Storage Evolution Software Optimized Hardware

Modern Multi-tiered Storage

Performance Disk

Flash Storage

32%

6%

Capacity Disk

Tape Drives 60%

Oracle Exadata Database Machine

• Extreme performance for OLTP, Data Warehousing and Consolidation

• Performs up to 1,000,000 IOPS

• Up to 50 GB/s raw I/O bandwidth

Oracle Sun ZFS Storage Appliance

•  Intelligent data placement across flash and disk

• Highest levels of data integrity

• Advanced DTrace analytics •  Integrated data services and

storage management at no extra cost

Page 18: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

18

Tiered Storage Automation

Tier 0/1

Tier 2

WAN

Data Creation

One Week

One Month

Six Months

One Year

Seven Years

Forever One Day

Tier 3

•  Policy-based •  Dynamic •  Non-disruptive •  Seamless

heterogeneous integration

•  Transparent to applications

•  Open •  Built-in data

protection

Page 19: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

19

Not All Data is Created Equal

Source: ESG Research Brief, Implementing the Right High Availability and Disaster Recovery Plan for Your Business, August 2010.

Page 20: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

20

Not All Data is Created Equal

Source: ESG Research Brief, Implementing the Right High Availability and Disaster Recovery Plan for Your Business, August 2010.

Protection Classes Availability Objectives

Recovery Point Objective (RPO)

Recovery Time Objective (RTO)

Mission Critical Data •  Near zero downtime, most

valuable 99.999% •  Continuous to 1

minute •  Instantaneous to

1.5 minutes

Business Critical •  Important data, good availability

99.999% •  1 to 10 minutes •  2 minutes to 15 minutes

Archive Online Data •  Cost sensitive, low access, online

performance 99.99% •  10 minutes to 2

hours •  15 minutes to 2

hours

Archive Nearline Data •  Cost sensitive, low access

99.9% •  2 hours to 1 day •  2 hours to 1 day

Offline Data •  Most cost sensitive, compliance

related, ~72-hr recovery Offline •  1 day to 1 week •  1 day to 1 week

Page 21: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

21

Oracle Recovery Manager (RMAN)

•  Oracle-preferred method for efficient database backup and recovery –  Reduces exposure to data loss –  Ensures transaction integrity and manages all info for database

recovery at any point in time –  Backup to disk preferred for faster restore

•  Built-in –  Cost-effective, no extra licenses –  No third party technology to purchase and coordinate

•  Copies only database blocks changed since previous backup –  Up to an order of magnitude reduction in backup and recovery times –  Significantly improved Recovery Time Objectives (RTO)

Page 22: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

22

Oracle Secure Backup (OSB) Enterprise Tape Backup Management – Database Backup

Oracle Database

RMAN Integration

Oracle Secure Backup File System Data

Oracle Enterprise Manager

•  Oracle database backup / recovery management –  Utilize RMAN command line restoring

to original or alternate location

•  Provides media management layer for RMAN –  Built-in integration – No additional

licensing costs –  Exclusive performance optimizations –  Achieving 25 – 40% faster backup

to tape than comparable products

•  More than 75% less expensive than comparable products

Page 23: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

23

Creating an Infinite Disk Repository Using Sun Storage Archive Manager (SAM)

•  Shared infrastructure

•  Each database instance has it’s own “virtualized” disk

•  Policy based data movement with SAM

•  Tiered Disk and Tape

•  Data read direct from storage

Sun Storage Archive Manager Metadata Server

Individual Fast Recovery Areas

Sun Storage Archive Manager Infrastructure

Tier 1 – Sun

Storage 6000 or

ZFS Storage

Appliance $$

Tier 2 – ZFS

Storage Appliance

$

Tier 3 – StorageTek

Tape Storage

SAM Policy

$$$

Oracle 10g/11g Database Servers

New price per processor licencing

model

Page 24: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

24

Benefits of an Infinite Disk Repository •  Infinite disk repository for each Oracle instance

•  All Data Protection data looks like it resides on disk

•  Faster recovery time objectives and better recovery point objectives

•  Mitigates need for redundant backup application

•  Retention policies in database control

•  Provides continuous fast direct access to the data

•  Transparent migration of files

Page 25: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

25

Example Use Case : Disk-to-Disk-to-Tape Using Sun Storage 6000 Series Fast Recovery Area

Oracle Database

Sun Storage 6000 Series

RMAN backups, archived redo logs

stored in Fast Recovery Area

SATA Disk Fast Recovery Area

FC Disk Indexes, Tables,

Redo logs

SSD Indexes, Tables, Temp,

Undo, Redo logs

Media Manager

StorageTek Tape Storage

Media manager backs up recovery area files to tape for longer-term

storage

Page 26: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

26

Comprehensive & complete •  Visibility from data creation to deletion

•  Fewer boundaries between hardware and software

•  Single-vendor service & support

Open •  Data placement abstracted from hardware

•  Open formats for forever data access

•  Heterogeneous

Drive Down Complexity •  Visibility from application to archive

•  Policy-based

•  Dynamic

Tiered Storage Considerations Complete, Open and Automated

Page 27: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

27

Additional Resources

•  Tiered Storage Resource Kit: –  White Paper: Tiered Storage Takes Center Stage –  White Paper: Optimizing Information with a Tiered Storage Architecture –  White Paper: Tape Technology Leaps Forward in the 3rd Era –  Archive and Storage Videos –  Special Offers, Customer Success Stories and More! –  https://landingpad.oracle.com/webapps/dialogue/ns/dlgwelcome.jsp?

p_ext=Y&p_dlg_id=8691050&src=6965184&Act=36 •  Product Documentation

–  http://www.oracle.com/us/products/servers-storage/storage/index.html

Page 28: Using multi tiered storage systems for storing both structured & unstructured data - Jan Okrasinski

28