Oracle Database In-Memory - DOAG Deutsche · PDF fileOracle Database In-Memory: ... Product Managers, Oracle Oracle Database In-Memory Schedule for DOAG. ... instruction Loadmultiple

Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|

OracleDatabaseIn-Memory

AndyRivenesDatabaseIn-MemoryProductManagerSystemsTechnologyGroupDOAG- November2016

EnablingReal-TimeAnalytics

Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|

SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

3


Date Title Location SpeakerTuesdayNov15th11:00-11:45

OracleDatabaseIn-MemoryOption

Seoul AndyRivenesProductManager,Oracle

WednesdayNov16th08:00-08:45

OracleDatabaseIn-Memory:ADeepDiveandaFuturePreview

Tokio TirthankarLahiri–VicePresident,Oracle

WednesdayNov19th11:00-11:45

UsingADOwithDatabaseIn-MemoryandStorage-Based Tiering

Tokio GreggChristmanAndyRivenesProductManagers,Oracle

OracleDatabaseIn-MemoryScheduleforDOAG


WhatisDatabaseIn-Memory

5


OracleDatabase In-MemoryGoals

6

Real-TimeAnalytics TrivialtoImplement

NoApplicationChangesNotLimitedbyMemory

100X

AccelerateMixedWorkload

AnalyticsTransactions

RunanalyticsonOperationalSystems

EnableReal-TimeBusinessDecisions

Real-TimeAnalytics100X

Risk-Free

ProvenScale-Out,Availability,Security


Breakthrough:DualFormatDatabase

• BOTH rowandcolumnformatsforsametable

• Simultaneouslyactiveandtransactionally consistent

• Analytics&reportingusenewin-memoryColumnformat

• OLTPusesprovenrowformat

7

BufferCacheNewIn-MemoryColumnStore

SALES SALESRow

FormatColumnFormat

SALES


Howeasyisittogetstarted

8


OracleDatabase12c• DatabaseIn-MemoryisanoptionforOracleDatabase12cEnterpriseEdition

• DatabaseIn-Memoryisincludedinthefirstpatchset (12.1.0.2)for12.1

• UsethelatestDatabaseProactiveBundlePatch–NotPSUsorCPUs

• Noadditionalstepsrequired

9

Note:DatabaseIn-Memoryisnot enabledbydefault


Oracle Database In-Memory: Simple to Implement

1. Configure Memory Capacity• inmemory_size = XXX GB

2. Configure tables or partitions to be in memory• alter table | partition … inmemory;

3. Later drop analytic indexes to speed up OLTP

10


OracleIn-MemoryAdvisor• NewIn-MemoryAdvisor• AnalyzesexistingDBworkloadviaAWR&ASHrepositories

• ProvideslistofobjectsthatwouldbenefitmostfrombeingpopulatedintoIMcolumnstore

Note:Diagnostic&TuningPacksrequired


Howdoesitwork

12


OracleIn-MemoryColumnarTechnology

13

SALES

SALES

PureIn-MemoryColumnar• Purein-memorycolumnformat

• Enableforsubsetofdatabase

• Cheaptomaintain– nologgingorIO• AllowsefficientOLTP

• Nochangetodiskformat

• Builtseamlessly intoOracleDatabase• Appearsasanewstoragetype• Transparent toApplications• AllEnterpriseFeatureswork..

• Availability– RAC,Flashback,DataGuard,etc.• Security– Encryption,Auditing,etc.


In-MemoryArea:NewStaticAreawithinSGA

SystemGlobalAreaSGA

BufferCache

SharedPool

LogBuffer

LargePool

In-MemoryAreaOther

• ContainsdatainthenewIn-MemoryColumnFormat

• ControlledbyINMEMORY_SIZEparameter- Minimumsizeof100MB

• SGA_TARGETmustbelargeenoughtoaccommodatethisarea

14


CompositionofIn-MemoryArea

• Containstwosubpools:– IMCUpool:StoresInMemoryCompressionUnits(IMCUs)

– SMUpool:StoresSnapshotMetadataUnits(SMUs)

• IMCUscontaincolumnformatteddata

• SMUscontainmetadataandtransactionalinformation

SMU SMU

SMU SMU

SMU SMU

SMU SMU

IMCU IMCU

IMCUIMCU

IMCU IMCU

IMCUIMCU

InMemoryArea

ColumnFormatData

Metadata

15


CompositionofIn-MemoryCompressionUnit(IMCU)

• Unitofcolumnstoreallocation– Columnarrepresentationofalargenumberofrowsfromanobject

– Rowsfromoneormoretableextents

• Actualsizedependsonsizeofrows,compressionfactor,etc.

• EachcolumnstoredasaseparatecontiguousColumn CompressionUnit(columnCU)– Rowids alsostoredasaColumnCU

IMCUheader

Extent#13Blocks20-120



ROWIDEMPID NAME

DEPT SALARYColumnCUs

16


Population:Compression• Objectscompressedduringpopulation

• ControlledbyMEMCOMPRESSsubclause

• 2xto20xcompressiontypical

• Multiplelevelsofcompression

- FORDML

- FORQUERY(Default)

- FORCAPACITY

17


• OrderinwhichobjectsarepopulatedcontrolledbyPRIORITYsubclause:ALTER TABLE sales INMEMORY PRIORITY HIGH;

• Levels:- CRITICAL>HIGH>MEDIUM>LOW

- Controlsorder(notspeed)ofpopulate

• DefaultPRIORITYisNONE- Populateonlyonfirstaccess

• Populationcompletedbynewsetofbackgroundprocesses

ora_w001_orcl

• Numberofprocessescontrolledbyparameter:INMEMORY_MAX_POPULATE_SERVERS

18

Population:Priority


WhyAreAnalyticQueriesFasterInTheIn-MemoryColumnStore?


ScanningandfilteringdatamoreefficientlyReal-TimeAnalytics

StorageIndexesCompression

Scan&filterdataincompressedformat

Accessonlythecolumnsyouneed

ColumnarFormat SIMDVectorProcessing

ProcessmultiplecolumnvaluesinasingleCPUinstruction

VectorRegister

Loadmultipleregionvalues

VectorCompareallvaluesan1cycle

CPUCA

CACA

CA

Min1Max3

Min4Max7

Min8Max12

Pruneoutanyunnecessarydatafromthecolumn

20


• Speedofmemory• ScanandFilteronlytheneededColumns

• VectorInstructions

Real-timeAnalyticsImprovesallaspectsofanalyticqueries

DataScans

VectorRegisterCPU

CA

CACA

CA

In-MemoryAggregation

•CreateIn-MemoryReportOutlinethatisPopulatedduringFastScan

•RunsReportsInstantly

Joins

•ConvertStarJoinsinto10XFasterColumnScans

•Searchlargetableforvaluesthatmatchsmalltable

HASHJOIN

TableA TableB

SALES

STATE=CA

21


What’sNew

22


• Availablenow– Exadata ExpressCloudService

• Comingsoon– DatabaseCloudServices– Exadata CloudMachine

23

Announcing OracleDatabase12cRelease2onOracleCloud

OracleispresentingfeaturesforOracleDatabase12cRelease2onOracleCloud. WewillannounceavailabilityoftheOn-Prem releasesometimeafterOpenWorld.


• Analyticquerieshavecomplexjoinswithnofilterpredicatesspecified

• JoinGroupspecifiescolumnsusedtojointables– Columnsharecompressiondictionary– Joinsoccuron dictionaryvaluesratherthandata

• Enables2-3xfasterjoinprocessing

Real-TimeAnalytics:FasterIn-MemoryJoins

Sales

VEHICLENAM

E

Example:FindsalespriceofeachVehicleSalesVehicle

NAMEisjoincolumnN

AME

CREATE INMEMORY JOIN GROUP V_name_jg(VEHICLES(NAME),SALES(NAME));

24


• Analyticqueriescontaincomplexexpressions– Originallyevaluatedforeveryrow

• Expressions pre-computedandcachedin-memory–Userdefinedviavirtualcolumns–Or expressionsautomaticdetected

• AllIn-Memoryoptimizationsapply• 3-5x fastercomplexqueries

Real-TimeAnalytics:In-MemoryExpressions

Net=Price+Price*Tax

In-MemoryColumnStore

Sales

Example:ComputetotalsalespriceTax

Price

25

Price

Price+PriceXTax

Price+Price*Tax


• FullJSONdocumentspopulatedusinganoptimizedbinaryformat

• AdditionalexpressionscanbecreatedonJSONcolumns(e.g.JSON_VALUE) &storedincolumnstore

• QueriesonJSONcontentorexpressionsautomaticallydirectedtoIn-Memoryformat- e.g.Findmovieswheremovie.name

contains“Jurassic”

• 60x performancegainsobserved

Multi-ModelAnalytics:In-MemoryJSON

Relational

In-MemoryColumStore

In-MemoryVirtualColumns

In-MemoryJSONFormat

{"Theater":"AMC 15","Movie":”Sully","Time“:2016-09-09T18:45:00","Tickets":{

"Adults":2}

}

Relational Virtual JSON

26


• AutomaticDataOptimizationextendedtoIn-Memory

• In-Memorypoliciesallowoptimaluseofcolumnstorebasedonheatmap- Requiresonlyinmemory option,not

advancedcompression

• Policiescanbedefinedto:- BringdataintotheIMcolumnstore- Increasecompressionlevelsasdatacools

- EvictcolddatafromIMcolumnstore27

Sales_Q3

Sales_Q2

Sales_Q4

In-MemoryColumnStore

Sales_Q1

Automation:In-MemoryDataAutoPopulationPolicies


HowdoesitimpactOLTPenvironments

28


• ComplexOLTPisSlowedbyAnalyticIndexes

• Insertingonerowintoatablerequiresupdating10-20analyticindexes:Slow!

• ColumnStoreReplacesAnalyticIndexes

• Fastanalyticsonany columns

• ColumnStorenotpersistentsoupdatecostismuchlower

29

DatabaseIn-MemoryAcceleratesMixedWorkloads

Table1– 3OLTP

Indexes

10– 20AnalyticIndexes

REPLACE


DatabaseIn-MemoryandotherOracleDatabasefeatures

30


DatabaseIn-Memory:ScalestoAnySize

31

Scale-Up

•Scale-UponlargeSMPs•NUMAOptimized

•Scale-OutAcrossServerstoGrowMemoryandCPUs

• In-MemoryQueriesParallelizedAcrossServers

Scale-Out CombinewithFlashandDisk

DISKPCIFLASHDRAM

ColdDataHottestData

ActiveData

•Easilyplacedataonmostcosteffectivetier

•SimultaneouslyAchieve:•Speed ofDRAM• I/OsofFlash•Cost ofDisk

Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.| 32

RAC

ASM

RMAN

Data Guard & GoldenGate

• Pure In-Memory format does not change Oracle’s storage format, logging, backup, recovery, etc.

• All Oracle’s proven availability technologies work transparently

• Protection from all failures- Node, site, corruption, human error, etc.

DatabaseIn-Memory:IndustrialStrengthAvailability


• Similar to storage mirroring

• Duplicate in-memory columns on another node- Enabled per table/partition

• e.g. only recent data

- Application transparent

• Downtime eliminated by using duplicate after failure

33

OnlyAvailableonEngineeredSystems

DatabaseIn-Memory:UniqueFaultTolerance


DatabaseIn-Memory:TrivialtoImplement

34

SimpletoConfigure

NocomplexsetupSetcolumnstoresize

DeclareIn-Memorytables

FullFunctionality

NoSQLrestrictions

100%Compatible

Noapplicationchanges

Nodatamigration

EasytoDeploy


HowarecustomersusingOracleDatabaseIn-Memory


AT&TWiFi – DataWarehouse• BusinessObjectsreports100X faster

• ETLprocessesimprovedby50% faster

• NochangestoSAPBusinessObjectsreports

Villeroy &Boch – SAPBW• SAPBWCOPAqueries30– 33X faster

• SAPTransactionlistqueries4– 4,800Xfaster

• Avoidedexpensive&riskyupgradetoS4/Hana

36

BOSCH – SAPCRM• Dropped allcustomindexes

• Analyticqueries2-20Xfaster,DML2-3X faster

• Nochangestoapplicationrequired

DieMobiliar – MixedWorkload• RemovalofNetezza system

• Analyticqueries50-200X faster

• Databasesizereduced considerably

DatabaseIn-MemoryReferences


In-MemoryUseCasesOLTP

• Real-timereportingdirectlyonOLTPsourcedata

• RemovesneedforseparateODS• Speedsdataextraction

DataWarehouse• Staging/ETL/Tempnotacandidate

• Writeonce,readonce• AllorasubsetofFoundationLayer

• Fortimesensitiveanalytics• PotentialtoreplaceAccessLayer

37


WherecanIgetmoreinformation

38


JointheConversation

39

https://twitter.com/TheInMemoryGuyhttps://blogs.oracle.com/in-memory/

WhitePapers(otn.com)• OracleDatabaseIn-MemoryWhitePaper• OracleDatabaseIn-MemoryAggregationPaper• WhentouseOracleDatabaseIn-Memory• OracleDatabaseIn-MemoryAdvisor

Videos• OracleDatabaseIn-MemoryYouTubeChannel• oracle.com- PoweringtheReal-TimeEnterprise- IndustryExpertsSharePerspectivesoracle.com/us/corporate/events/dbim/index.html

• YouTube- JuanLoaiza:SoftwareinSilicon

AdditionalQuestions• In-Memoryblog:blogs.oracle.com/In-Memory• Myemail:[email protected]

https://www.facebook.com/OracleDatabasehttp://www.oracle.com/goto/dbim.html

AdditionalResources

Documents

Oracle Database In-Memory - DOAG Deutsche · PDF fileOracle Database In-Memory: ... Product Managers, Oracle Oracle Database In-Memory Schedule for DOAG. ... instruction Loadmultiple