24
<Insert Picture Here>

- Oracle · Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

  • Upload
    others

  • View
    30

  • Download
    0

Embed Size (px)

Citation preview

Page 1: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

<Insert Picture Here>

Page 2: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

<Insert Picture Here>

Exadata Hybrid Columnar Compression:

The Next-Generation Compression Technology

Page 3: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Program Agenda

• Data Growth Challenges

• Oracle Compression Overview

• Exadata Hybrid Columnar Compression

• Warehouse Compression

• Archive Compression

• Questions and Answers

Page 4: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Data Growth Challenges

• IT must support exponentially growing amounts of data

• Explosion in online access and content

• Government data retention regulations

• Performance often declines as data balloons

• IT budgets are flat or decreasing

• Need to grow data

• Without hurting performance

• Without growing cost

• Powerful and efficient compression is key

Page 5: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Oracle Database Compression OverviewCompress All Your Data

Exadata V2

• All Applications

• Cold / Historical DataOnline Archival Compression

Availability

Database 11g

Advanced Compression

Exadata V2

Database 11g

Advanced Compression

Database 11g

Advanced Compression

Database 11g

Advanced Compression

Database 11g

Advanced Compression

• All Applications

• Unstructured (File) DataSecureFiles Compression

Warehouse Compression• Data Warehouses

• Scan Oriented Access

Backup Compression• RMAN Compression

• Data Pump Compression

SecureFiles Deduplication

• All Applications

• Actively Updated DataOLTP Table Compression

Application FitCompression Feature

Network Compression

• All Applications

• Unstructured (File) Data

• Data Guard Redo

Transport Compression

Warehouse Compression Built on Exadata Hybrid

Online Archival Compression Columnar Compression Technology

Page 6: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Why Hybrid Columnar Compression

• Traditionally, data has been organized within a database block in

a „row‟ format, where all column data for a particular row is

stored sequentially within a single database block

• An alternative approach is to store data in a „columnar‟ format,

where data is organized and stored by column.

• Storing column data together, with the same data type and similar

characteristics, drastically increases the storage savings achieved

from compression

• Oracle‟s Exadata Hybrid Columnar Compression (EHCC) utilizes

a combination of both row and columnar methods for storing

data

• This hybrid approach achieves the compression benefits of columnar

storage, while avoiding the performance shortfalls of a pure

columnar format

Page 7: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Hybrid Columnar Comparisons

• Exadata Hybrid Columnar Compression is a second generation

columnar technology combining the best of row and column formats

• Best compression – matching full columnar

• Excellent scan time – 93% as good as full columnar

• Good single row lookup – no full columnar “cliff”

• Row format remains best for workloads with updates or trickle feeds

0

500

1000

0

500

1000

0

50

100

Table Size Scan Time Row Lookup Time

Uncompressed

OLTP

HybridPure Column

Pure Columnar

Cliff

Uncompressed

OLTP Compress

Hybrid & Pure Column

Page 8: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

About Exadata Hybrid Columnar Compression

• Hybrid Columnar Compressed Tables

• New approach to compressed table storage

• Compressed tables can still be modified using conventional DML operations, such as INSERT and UPDATE

• Useful for data that is bulk loaded and queried

• Update activity is light

• How it Works

• Tables are organized into Compression Units (CUs)

• CUs are larger than database blocks

• Within Compression Unit, data is organized by column instead of by row

• Column organization brings similar values close together, enhancing compression

Compression Unit

10x to 15x Reduction

Page 9: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Compression Units

• Compression Unit

• Logical structure spanning multiple database blocks

• Data organized by column during data load

• Each column compressed separately

• All column data for a set of rows stored in compression unit

CU HEADER

BLOCK HEADER BLOCK HEADER BLOCK HEADER BLOCK HEADER

C3

C4C1

C2

C7C5

C6 C8

C8

Logical Compression Unit

Page 10: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Decompression

• Queries run directly on Hybrid Columnar Compressed data does

not require the data to be decompressed

• Data that is required to satisfy a query predicate does not need

to be decompressed; only the columns and rows being returned

to the client are decompressed in memory

• The decompression process typically takes place on the Oracle

Exadata Storage Server in order to maximize performance and

offload processing from the database server

Page 11: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Exadata Hybrid Columnar CompressionWarehouse and Archive Compression

Warehouse Compression

• 10x average storage savings

• 10x reduction in Scan IO

Archive Compression

• 15x average storage savings

• Up to 70x on some data

• For cold or historical data

Optimized for Speed Optimized for Space

Smaller Warehouse

Faster Performance

Reclaim 93% of Disks

Keep Data Online

Can mix OLTP and hybrid columnar compression by partition for ILM

Page 12: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Warehouse Compression Levels

• Warehouse Compression provides two levels of compression:

LOW and HIGH.

• HIGH typically provides a 10x reduction in storage

• LOW typically provides a 6x reduction

• Both levels have been optimized to increase scan query

performance by taking advantage of the fewer number of blocks

on disk

• To maximize the storage savings and query performance

benefits of Warehouse Compression, the default level is HIGH.

• LOW should be chosen for environments where load time service

levels are more critical than query performance

Page 13: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Warehouse Compression

• 10x average storage savings

• 100 TB Database compresses to 10 TB

• Reclaim 90 TB of disk space

• Space for 9 more „100 TB‟ databases

• 10x average scan improvement

• 1,000 IOPS reduced to 100 IOPS

100 TB

10 TB

Page 14: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Archive Compression

• Compression algorithm optimized for max storage savings

• Benefits any application with data retention requirements

• Best approach for ILM and data archival

• Minimum storage footprint

• No need to move data to tape or less expensive disks

• Data is always online and always accessible

• Intended for tables or partitions that store data that is rarely accessed

• Run queries against historical data (without recovering from tape)

• Update historical data

• Supports schema evolution (add/drop columns)

Page 15: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Archive Compression

• Optimal workload characteristics for Archive Compression

• Any application (OLTP, Data Warehouse)

• Cold or Historical Data

• Data loaded with bulk load operations

• Minimal access and update requirements

• 15x average storage savings

• 100 TB Database compresses to 6.6 TB

• Keep historical data online forever

• Up to 70x savings seen on production customer data

Page 16: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Archive CompressionILM and Data Archiving Strategies

• OLTP Applications

• Table Partitioning

• Heavily accessed data

• Partitions using OLTP Table Compression

• Cold or historical data

• Partitions using Online Archival Compression

• Data Warehouses

• Table Partitioning

• Heavily accessed data

• Partitions using Warehouse Compression

• Cold or historical data

• Partitions using Online Archival Compression

Page 17: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Table Compression Syntax

Warehouse Compression Syntax:

CREATE TABLE emp (…)

COMPRESS FOR QUERY [LOW | HIGH];

Online Archival Compression Syntax:

CREATE TABLE emp (…)

COMPRESS FOR ARCHIVE [LOW | HIGH];

Page 18: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Compression Advisor

• New Advisor in Oracle Database 11g Release 2

• DBMS_COMPRESSION PL/SQL Package

• Estimates Hybrid Columnar Compress storage savings on non-

Exadata hardware

• Requires Patch # 8937922

Page 19: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

© 2009 Oracle Corporation - Confidential 19

Exadata Hybrid Columnar CompressionCustomer Success Stories

• Data Warehouse Customers (Warehouse Compression)

• Top Financial Services 1: 11x

• Top Financial Services 2: 24x

• Top Financial Services 3: 18x

• Top Telco 1: 8x

• Top Telco 2: 14x

• Top Telco 3: 6x

• Scientific Data Customer (Archive Compression)

• Top R&D customer (with PBs of data): 28x

• OLTP Archive Customer (Archive Compression)

• SAP R/3 Application, Top Global Retailer: 28x

• Oracle E-Business Suite, Oracle Corp.: 23x

• Custom Call Center Application, Top Telco: 15x

Page 20: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

20

Oracle’s Production EBS Dataset

• Archive High

• Overall: 23x

• Largest Table: 52x

• Query High

• Overall: 15x

• Largest Table: 35x

• OLTP Compression

• Overall: 3.6

• Largest Table: 4x10 10 10 11

1619 19 19 20 21

29

4352

0

5

10

15

20

2530

35

40

45

50

GL_B

ALA

NCES

AP_A

E_LINES

_ALL

FND_D

OCUM

ENTS

_TL

FND_C

ONCURRENT_A

RCH

REPORT_T

ABLE

_TEMP

OE_O

RDER_L

INES_A

LL

AP_I

NVOIC

E_D

ISTR

I_ALL

OKS_K

_LIN

ES_TL

CUSTO

MER_LIN

ES_A

LL

CN_C

OMM

ISSIO

N_LI

NES_A

LL

RA_C

UST_G

L_DIS

T_ALL

GL_I

MPO

RT_R

EFERENCES

HZ_PA

RAM

_TAB

Siz

e R

ed

ucti

on

Facto

r b

y T

ab

le

Query High Archive High

Up to 52x reduction in table size for EBS

Page 21: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Summary

• Average storage savings can range from 10x

to 15x

• Need to grow data

• Without growing cost

• Without hurting performance

• Exadata Hybrid Columnar Compression

• Extreme Storage Savings

• Warehouse Compression

• Archive Compression

• Improve I/O Scan Rates

Page 22: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Oracle Products Available Online

Oracle Store

Buy Oracle license and support online today at

oracle.com/store

Page 23: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program
Page 24: - Oracle ·   Exadata Hybrid Columnar Compression: The Next-Generation Compression Technology. Program

Oracle Confidential