View
335
Download
1
Embed Size (px)
Citation preview
BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH
Oracle 12cEmiliano Fusaglia Principal Consultant LS-IMSInformation Lifecycle Management
Agenda
2 11/26/2015
1. Introduction to ILMData ExplosionILM DefinitionILM ChallengerExisting ILM SolutionsOverview Oracle 12c ILM
2. Oracle 12c ILMHeat MapAutomatic Data Optimization
Oracle 12c ILM
Oracle 12c ILM3 11/26/2015
Introduction to ILM
Data Explosion
4 11/26/2015
Where did the data explosion come from?
Longer data retention driven by business need and new law enforcement.The more and more customer data becomes valuable and saved on CRM, ERP, DWH and Big Data systems.IoTCurrent trend shows that data doubles every 18 months!
Oracle 12c ILM
Information Lifecycle Management - Definition
5 11/26/2015
What does Information Lifecycle Management mean?
Information Lifecycle Management (ILM) refers to a wide-ranging set of strategies for administering storage systems on computing devices.
ILM comprises the policies, processes, practices, and tools used to align the business value of information with the most appropriate and cost effective IT infrastructure from the time information is conceived through its final disposition
Oracle 12c ILM
Information Lifecycle Management - Challenger
6 11/26/2015 Oracle 12c ILM
Information Lifecycle Management - Challenger
7 11/26/2015
More Data to manage without additional cost
Define ILM processesCompress Data without impacting performance
Distribute the data on multi-tiers devices
Oracle 12c ILM
Existing ILM solutions
8 11/26/2015
Application consolidationData compressionStorage TieringOffline ArchivesData Retention/Deletion
Which are the existing ILM solutions?Increase data density but probably not enough.Efficient, but can penalize the performance.Difficult for the Storage to identify the correct data to move. To query offline data can become highly inefficient.Loss of historical information.
Oracle 12c ILM
9 11/26/2015
Oracle 12c ILM
Oracle 12c ILM
Review of what was already possible in Oracle 11g
10 11/26/2015
Source: Oracle Corporation ILM Webpage
Oracle 12c ILM
Overview Oracle 12c ILM
11 11/26/2015
Source: Oracle Corporation ILM Webpage
Oracle 12c ILM
Overview Oracle 12c ILM
12 11/26/2015
Data Classification
Rules for data movement and compression
ILM Automatization
Oracle 12c ILM
Oracle 12c ILM
13 11/26/2015
Heat MapAsynchronously analyze the I/O issued on the database, and resource efficiently (<5% cost) it maintains the Data Heat Map.Recognize application I/O requests from system I/O requestsCan collect statistics at database, tablespace, segment and row level.
Automatic Data Optimization (ADO)Part of the Advanced Compression Option.Permits to define the data lifecycle policies using SQL and PL/SQL functions. Supports automated compression and storage tiering.Automated solution which enforces the defined policies .
Oracle 12c ILM rely on the following components:
Oracle 12c ILM
Oracle 12c ILM: Heat Map
14 11/26/2015
Enable Hot/Cold data classification :
PL/SQL API for querying Heat Map statistics:
ALTER SYSTEM SET HEAT_MAP = ON;
ALTER SESSION SET HEAT_MAP = ON;
SELECT tablespace_name, min_writetime, min_ftstimeFROM table(dbms_heat_map.tablespace_heat_map('EXAMPLE'))
Oracle 12c ILM
Oracle 12c ILM: Heat Map on Enterprise Manager
15 11/26/2015
Hot Data Warm Data Cold Data
Oracle 12c ILM
Oracle 12c ILM: Automatic Data Optimization (ADO)
16 11/26/2015
0101000011110101010101000010101010010000101010100101010101010010100011110101010101101
01001101101110100101010010101010101010101010101010101010101010101010101010101010101010101010101010101010011010100110100101010101010010101010101010101010101001110100101010100101010101010011010101011100101010100101001100101010101010010110011010101010010101010101010110100101010100101
0101010101011010101001010101010101010101010010101010010100101010100101010010101101011010100110101011111100101010010000000000001111110111111111111010100101000010100010100100110011111101000101001001010000001001111111010101111111110010000010100010100101001010010100101011011111010101001001010101001011110101011111110101010010101010010100111111111110101001010101000000000010101010001010101001010101010111010101001010101010010101010010101010101010101010101010101010101001010010101010101010101010101010101010010101010101010101010101010101010101010101010101010100101010101010101010101010101011111101000000110101010111010101010010101010101010010101001010101010001010101001010101010111010101001010101010010101010010101010101010101010101010101010101001010010101010101010101010101010101010010101010101010101010101010101010101010101010101010100101010101010101010101010101011111101000000
Hot Data Warm Data Cold Data
Advanced Row Compression 3x
ADO & Data Compression
*Columnar Query Compression 10x
*Columnar Archive Compression 15x
*Columnar Compression available on Exadata and other Oracle Storage (ZFS, Pillar, etc..) only.Oracle 12c ILM
Automatic Data OptimizationAdd compression and tiering policies to tables
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
Compress Partitions with Advanced Compression if they haven’t been modified in 30 days
Compress Partitions with Hybrid Columnar Compression if they haven’t been modified from in 180 days
Oracle 12c ILM
Automatic Data OptimizationA heat map tracks the activity of segments and blocks
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
Oracle 12c ILM
Automatic Data OptimizationPolicies are automatically applied to tables
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
If after 30 days partitions haven’t be modified they will be compressed using advanced row compression
Oracle 12c ILM
Automatic Data OptimizationPolicies are automatically applied to tables
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
After 180 days of no modification, the oldest partition is identified to be compressed using Hybrid Columnar compression
Oracle 12c ILM
Automatic Data OptimizationPolicies are automatically applied to tables
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
Oracle 12c ILM
Automatic Data OptimizationReduce storage footprint, read compressed data faster
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
Oracle 12c ILM
Automatic Data OptimizationAutomatically tier data to lower cost storage
Oldest Data Most Recent Data
Policy 1Policy 1
Policy 2Policy 2
Policy 3Policy 3
If the tablespace is nearly full then compress the oldest partition with Archive Hybrid ColumarCompression and move it to Tier 2 Storage
Oracle 12c ILM
Automatic Data OptimizationCompress data over it’s lifecycle
Oldest Data Most Recent Data
No CompressionAdvanced RowCompressionHybrid Columnar QueryCompression
Hybrid Columnar ArchiveCompression
3XCompressionOLTP10XCompressionReporting
15XCompressionCompliance
Oracle 12c ILM
Oracle 12c ILM: Automatic Data Optimization (ADO)
25 11/26/2015
COMPRESS BASIC (alias Batch Compression)COMPRESS ADVANCED (alias OLTP Compression)
CREATE TABLE sales (prod_id NUMBER NOT NULL,cust_id NUMBER NOT NULL, ...)
PARTITION BY RANGE (time_id) ( PARTITION sales_2012 VALUES LESS THAN(TO_DATE(...))
ROW STORE COMPRESS BASIC,PARTITION sales_2013 VALUES LESS THAN (MAXVALUE)
ROW STORE COMPRESS ADVANCED);
ADO & Data Compression
Oracle 12c ILM
Oracle 12c ILM: Automatic Data Optimization (ADO)
26 11/26/2015
Add row-level compression policy after 14 days of no modificationsCOMPRESS ADVANCED (alias OLTP Compression)
ADO & Data Compression
ALTER TABLE empILM ADD POLICY ROW STORE COMPRESS ADVANCED ROW AFTER 14 DAYS OF NO MODIFICATION;
ALTER TABLE sales MODIFY PARTITION sales_2011 ILM ADD POLICY COMPRESS FOR ARCHIVE HIGH SEGMENT AFTER 6 MONTHS OF NO ACCESS;
Add segment-level compression policy after 6 months of no modifications
Oracle 12c ILM
Oracle 12c ILM: Automatic Data Optimization (ADO)
27 11/26/2015
ADO & Storage Tiering
2009 2010 2011 2012 2013 2014 CurrentYear
Sales TablePartitioned by Year
High End SSD DisksMid-Tier Storage DisksLow End Storage Disks$ $$ $$$$
Oracle 12c ILM
Oracle 12c ILM: Automatic Data Optimization (ADO)
28 11/26/2015
Add Storage tier policyADO & Storage Tiering
ALTER TABLE sales MODIFY PARTITION sales_2011 ILM ADD POLICY TIER TO low_end_tablespace;
ALTER TABLE sales MODIFY PARTITION sales_2015 ILM ADD POLICY TIER TO high_end_tablespace;The partition movement occurs when the source tablespace has reached a capacity threshold. The threshold for activating tiering policies is based on two parameters: TBS PERCENT USED and TBS PERCENT FREE, which are controlled by the DBMS_ILM_ADMIN package, (default values 85% and 25%).
Oracle 12c ILM
Oracle 12c ILM - Summary
29 11/26/2015
All ILM features are Application Transparent.Heat Map statistics provide fine grained I/O classification. ADO policies permit to automate data movement and compression.Support to complex business rules for data archiving actions. Oracle Advanced Compression option is required.
Oracle 12c ILM
Emiliano FusagliaPrincipal ConsultantTel. +41-79-909 7213 [email protected]
11/26/201530 Oracle 12c ILM