Transforming Data Management - NYOUGnyoug.org/wp-content/uploads/2016/12/TransformingDataManagem… · Machine Learning • Massively-scalable R processing ... New in 12.2 on Oracle

Copyright©2016,Oracleand/oritsaffiliates.Allrightsreserved.|

TransformingDataManagementwithOracleDatabase12cRelease2


SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirecIon.ItisintendedforinformaIonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncIonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andImingofanyfeaturesorfuncIonalitydescribedforOracle’sproductsremainsatthesolediscreIonofOracle.

3


• Availablenow– ExadataExpressCloudService– EnterpriseCloudService– ExadataCloudService• AvailableDecember– ExadataCloudMachine

4

OracleDatabase12cRelease2onOracleCloud


TransformingDataManagement

Ø FromDisk-basedtoIn-MemoryDatabases

Ø FromDataWarehousetoBigDataØ FromOn-PremtoDatabaseOpImizedCloud

5

Whilepreservingcustomer’sinvestments





6



In-MemoryDatabases

FromDisk-Based

• OpImizedfordiskI/O• Rowformat• BuffercacheinDRAMplusdiskstorage

ToIn-MemoryDatabases

• OpImizedformemoryaccess• Dualrow/columnformat•  IntegratedDRAM,FlashandNVRAMstorage

7


CostofmemoryconInuestodecrease

8

Demandforreal-ImeanalyIcsconInuestoincrease

Non-volaIlememoryindevelopment

EvoluIonofIn-Memory

Copyright©2016,Oracleand/oritsaffiliates.Allrightsreserved.| 9

In-MemorywithOracleDatabase12cRealTimeAnaly?cs Performance SimpletoImplement

OLTP&AnalyIcsonsamedatabase Sub-secondreporIng&analyIcs NoapplicaIonchanges


• Real-ImeanalyIcswithnoimpactonproducIondatabase• MakeproducIveuseofstandbydatabaseresources• CanpopulatewithdifferentdatafromproducIondatabase

10

Newin12.2onOracleCloudIn-MemoryrunsonAcIveDataGuardstandby

MonthIn-Memory

ProducIon Standby

YearIn-Memory


• Upto3Xfasterjoins– Usingin-memoryjoingroups

• Upto10Xfastercomplexqueries– Usingin-memoryexpressions

• Upto60XfasterJSONqueries– UsingnewopImizedbinaryformat

11

Newin12.2onOracleCloudPerformanceEnhancements

{! "Theater":"AMC 15",! "Movie":”SULLY",! "Time“:2016-09-09T18:45:00",! "Tickets":{! "Adults":2! }! }!

RelaIonal Virtual JSON

In-MemoryColumnStore


•  In-MemoryformatnowusedinSmartColumnarFlashCache

•  Enablesin-memoryopImizaIonsondatainExadataFlashCache

•  In-memoryperformanceseamlesslyextendedfromserverDRAMmemoryto10xlargerflashinstorage

12

Newin12.2onOracleCloudIn-MemoryColumnFormatinExadataFlashCache

In-MemoryColumnarscans

In-FlashColumnarscans


TheCustomer’sViewv

OracleDatabaseIn-Memory






16



TransformingtoBigData

FromDataWarehouse

• RelaIonal– On-Premises

•  TransacIonaldata• AnalyIcs+DataMining

ToBigData

• RelaIonal+HadoopandNoSQL– On-Premises+Cloud

•  TransacIonal+Social,WebandIoT• AnalyIcs+DataMining+MachineLearning

17


DataWarehouseEvoluIon

Transac?onal

DataWarehouse

SQL

Social,Web

DataLake

IoT

FastData


OracleBigDataPlajorm

Dataofanytype

Anydatasource

AnalysisofanytypeSQL GraphSpark SpaIal MachineLearning

SQLAccesswithanylanguage

node.jsJavaREST Python ScalaR


FastSQLaccessforRelaIonal,HadoopandNoSQL

• UnifiedSQLlanguageforalldatasources– WithfullpowerofOracleSQL

• Massivelyparallel,distributedqueryprocessing– Localprocessingusing‘SmartScan’technology– Scalablejoinsbetweendatasources

•  Securedataaccess– RedacIonandrow-basedsecurityonalldatasources

20

UsingOracleBigDataSQL

BigDataSQL


BigDataSQL

FastSQLaccessforRelaIonal,HadoopandNoSQL

•  IntuiIveSQLsyntaxoverJSON SELECT c.json_column.address.city FROM customers c;

• UseJSONdatainanySQLquery– JoinJSONwithanyotherdatasource– ApplyanySQLanalyIcstoJSON

• NewinBigDataSQLonOracleCloud– DataGuide:AutomaIcallyunderstandJSONstructure

21

UsingOracleBigDataSQLonJSONdata


MachineLearning•  Massively-scalableRprocessing

•  In-DatabaseandSparkalgorithms

•  EnhancesandextendsSparkML

Graph•  Massively-scalableGraphDatabase

•  40+in-memoryparallelalgorithms

•  Simplestandardinterfaces

22

Spa?al•  Massively-scalableVectorandRasterprocessing:50+funcIons

•  SpaIaldataenrichment,filtering,andcategorizaIon

Mul?-media•  Massively-scalableopenframeworkforimageandvideoprocessing

•  Use-cases:facerecogniIon;OCR;licenseplaterecogniIon

ComprehensiveDataScienceCapabiliIesAnyanalysisacrossrelaIonal,HadoopandNoSQL



OracleBigData



BigDataCloudService

• BigDataCloudServiceincludes:– ClouderaEnterpriseDataHub– EmbeddedanalyIcsincludingRandPropertyGraphanalyIcs– EmbeddeddataintegraIontools

•  Startwith3-nodecluster,scalesto100’sofnodes• BigDataSQLCloudServicecomingsoon

26

Comprehensive,high-performanceserviceforHadoop,Spark,andNoSQL




Ø FromDataWarehousetoBigDataØ FromOn-PremtoDatabaseOp?mizedCloud

27



Exadata SuperCluster

BigDataAppliance

RecoveryAppliance

DatabaseAppliance

EngineeredSystemsforDataManagementStartyourjourneytothecloudwithdatabase-opImizedinfrastructure


•  LowerCosts– Managemanydatabasesas-one

• Agility– Rapidprovisioning,cloning,movement

•  ElasIcScaling– Scale-up,scale-outandscale-down

29

TransformingtoDatabase-OpImizedCloud


LoweringCosts

FromOn-Prem

• Payup-front– forpeakcapacity

• Manualdeploymentandupgrade• HighoperaIonalcost– ManageManyDatabases

ToDatabase-Op?mizedCloud

• Payasyougo– forcapacityon-demand

•  Self-servicedeploymentandupgrade•  LowoperaIonalcost– ManageMany-as-One

30


•  VirtualizedatabasesintoContainerDatabase– ApplicaIonsrununchanged

•  LowerOperaIonalExpenses– ManagemanyPluggableDatabasesasone

•  LowerCapitalExpenses– MorePluggableDatabasesperserver

•  MoreAgile– Fastprovisioning,movementandcloning

31

OracleDatabase12cMulItenantArchitecture

ERP CRM

DW

ContainerDatabase


• Upto4,096PDBspercontainer• Memory,CPUandI/OresourceprioriIzaIon• ConfigurableisolaIonbetweenprivateandpublicclouds

32

Newin12.2onOracleCloudGreaterConsolidaIonandIsolaIonatScale

Retail

Pricing

ContainerDatabase


• PDBsshareapplicaIonobjects– Code,metadataanddata

•  Furthersimplifiesmanagement– ManagetenantapplicaIonsasone

•  SuitableformanyapplicaIons– SaaS,franchise,divisional,etc.

Newin12.2onOracleCloudConsolidaIonwithApplicaIonContainers

33


Agility

FromOn-Prem

• ManualdatabaseconfiguraIon– DesignHW/SWstackfromscratch

• Monthstodeploy,upgrade•  Singletenantdatabases


•  Self-servicedatabaseprovisioning– ChoosefromlistofCloudservices

• Minutestodeploy,upgrade• MulItenantcontainerdatabases– HotcloningandrelocatePDBs

34


• PDBHotClone– FastertestmasterinstanIaIon

• PDBRefresh– SimpleoperaIonforlatestdata

• PDBRelocate– RelocatewithnodownIme

35

Newin12.2onOracleCloudOnlinePDBOperaIons

35

CRM

HR

OracleCloud

Pricing Retail

On-Premises

CRM



Mul?tenantonOracleCloud


Copyright©2016Oracleand/oritsaffiliates.Allrightsreserved.

ElasIcScaling

FromOn-Prem

• Manualscale-upofsingleserversandscale-outRACclusters– WithnobursIng

• Provisionforpeak-demand• Massivescalability&reliability– Manualdatabasesharding


•  Self-servicescale-upofsingleserversandscale-outRACclusters– WithbursIng

• Provisioncapacityon-demand• Massivescalability&reliability– Automateddatabasesharding

39


Uniquescale-outandfaulttolerancewithOracleRACNoapplicaIonchangesrequired

• Protectsdatabasesfromserverfailure•  Scale-outdatabaseperformance– WithbursIngasrequired

•  Supportstheworld’slargestOLTPandDataWarehouseworkloads• Newin12.2onOracleCloud– OpImizedformulItenantdatabases– Scale-outtohundredsofnodes

40


Newin12.2onOracleCloud

41

NaIveDatabaseShardingformassivescalabilityandreliabilityforOLTPapplicaIons

OnegiantdatabaseparIIonedintomanysmalldatabases(shards)

CustomersAmericas

Customers

CustomersEurope

CustomersAsia

•  RACandDataGuardmeetneedsofover99%ofapplicaIonswhilepreservingapplicaIontransparency

•  SomeGlobal-ScaleOLTPapplicaIonsprefertoshardmassivedatabasesintoafarmofsmallerdatabases

•  RequiresdesigningapplicaIonssothatworkloadsareautomaIcallyroutedtospecificshardsinthefarm

•  SQLforshardedtablesacrossupto1000Shards


OracleExadataCloudService#1databaseononlycloudinfrastructureopImizedfordatabase• OracleDatabasewithallopIons• OnfastestandmostreliableDatabaseCloudPlajorm– Scale-OutCompute,Scale-OutIntelligentStorage,ElasIcExpansion– CompleteIsolaIonoftenantswithnooverprovisioning

• AllbenefitsofPublicCloud– Fullymanagedinfrastructure– Rapid,elasIc,databaseprovisioning– NoCapExwithpay-perusesubscripIon

42


Pay-as-you-goExadataCloudServiceMonthlysubscripIonratesandburstOCPUsondemand

43

Month1 Month2 Month3 Month4

Burst16OCPUsasrequired

OCP

Us

032

24

16

8

EndofQuarter


100%CompaIbleHybridCloudGracefulco-existenceandmigraIonbetweenprivateandpublicclouds

45

OracleCloudSameArchitectureSameSoTwareSameSkills

SameSupport

Automatedmovementofapplica?ons&databetweenon-premises&publiccloud

On-Premises


Oracle‘CloudatCustomer’Helpsconformtobusinessandgovernmentsecurityandcompliancerequirements

•  SamePaaSandIaaShardwareandsoswareasOraclePublicCloud• ManagedbyOracleanddeliveredasaservicebehindyourfirewall•  Samecost-effecIvesubscripIonpricingmodelasOracleCloud

46

IaaS BigData

Database


CustomerDataCenter

Purchased

CustomerManaged

47

ChoiceofExadataDeploymentModels

ExadataDatabaseMachine

CustomerDataCenter

SubscripIon

OracleManaged

ExadataCloudMachine

OracleCloud

SubscripIon

OracleManaged

ExadataCloudService


IntroducingExadataExpressCloudService

§  #1Database,includingopIons,onExadata§  FullymanagedbyOracle§  Lowcost,starIngat$175permonth

48

Simpletouse,lowestcostDatabaseCloudService,running12.2


• ApplicaIondevelopment•  TesIngandqualityassurance•  Short-term,ImesensiIveprojects• AnalyIcsandsandboxes• ProducIondepartmentalworkloads

49

UseCases:ExadataExpressCloudService


• Allpopularlanguagessupported•  Fulldatabasesupportfor– JSON– Rest• Developmenttoolsincluded– ApplicaIonExpress– SQLDeveloper

50

DevelopmentontheOracleCloud

andmore…


OracleApplicaIonExpress(APEX)CompleteApplicaIonPlajormasaService(aPaaS)

51

Develop Customize DeployProvision

IncludedwithALLOracleDatabaseediIonsandCloudServices

100%compaIbilitybetweenon-premisesandOracleCloud

•  RADbrowserbasedtool•  Createandmanagedatabaseobjects•  RobustvisualizaIoncomponents•  300K+developers,100’sofpartners


ProducIvityAppsincludedinAPEX

52

andmore…


DatabaseDevelopment

SpectrumofOracleDatabaseCloudServices

53

Scalefromentry-leveltothelargestmissioncriIcaldatabaseworkloads

ExadataEnterpriseExadataExpress

Highestavailability,scalabilityandperformance

SMB&DepartmentalApplicaIons

EnterpriseApplicaIons




Ø FromDataWarehousetoBigData

Ø FromOn-PremtoDatabaseOpImizedCloud

54



SafeHarborStatementTheprecedingisintendedtooutlineourgeneralproductdirecIon.ItisintendedforinformaIonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncIonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andImingofanyfeaturesorfuncIonalitydescribedforOracle’sproductsremainsatthesolediscreIonofOracle.

55


Documents

Transforming Data Management - NYOUGnyoug.org/wp-content/uploads/2016/12/TransformingDataManagem… · Machine Learning • Massively-scalable R processing ... New in 12.2 on Oracle