Upload
others
View
3
Download
0
Embed Size (px)
Citation preview
AccelerateMySQL®forDemandingOLAPandOLTPUseCasewithApache®Ignite™
December7,2016
NikitaIvanovCTOandCo-FounderGridGainSystems
PeterZaitsevCEOandCo-FounderPercona
©2016Percona2
AboutthePresentation
Problems
ExistingSolutions
NikitaIvanovwillshowthepowerofApacheIgnite
©2016Percona3
AboutPercona
WeExisttohelpyoutosucceedwithMySQLandMongoDB
©2016Percona4
SupportBroadEcosystem
PerconaServerforMySQL
MySQL MariaDB
AWSforMySQLandAurora
MongoDBPerconaServerforMongoDB
GoogleCloudSQL
©2016Percona5
Percona Software– 100%OpenSource
PerconaServerforMySQL
PerconaServerforMongoDB
PerconaXtraDBCluster
PerconaXtrabackup PerconaToolkit
PerconaMonitoringandManagement
©2016Percona6
Services
• Support • More than Support (Percona Care)• Managed Services (Percona Care Ultimate)• Consulting, Training
©2016Percona7
MyConviction
Thereisnosilverbulletintechnology!
©2016Percona8
Why?
Alldesigndecisionscomeswiththeirownbenefitsanddrawbacks
©2016Percona9
TechnologiesnotTechnology
LargeScaleapplicationstendtousemorethanonetechnologyondata
layer
©2016Percona10
WorksespeciallywellwithOpenSource!
AdditionalComponentsdonotrequireheftylicensefees
Easytoprototypeandtestout
OpenSourceCommunityisgoodatbuildingbridges
©2016Percona11
BalanceisNeeded
Useasmanytechnologiesasyouneed,butnomore
©2016Percona12
MySQL
MySQLisnoException.ItisnotGreatfor
Everything.
©2016Percona13
SomeoftheProblems
HotData
HighlyVolatileData
LargeDataVolume
AnalyticalProcessing
FullTextSearch
©2016Percona14
HotData
Forexample“Cache”
Largevolumeofsimplerequests
HighoverheadduetoSQL
NogoodMemoryfocusedEngine
NotDesignedforveryhighConcurrency
©2016Percona15
Solutions
MySQL
••MemcacheDinterface
••ThreadPool
External
••MemcacheD••Redis
©2016Percona16
HighlyVolatileData
Lotsofupdates,especiallytoasinglerow
DesignaroundfullTransactionalACIDsemantics
DiskLogbaseddurability
PessimisticLogging
©2016Percona17
Solutions
MySQL
••DataDesign••ConfigurationTuning
••ParallelReplication
External
••MemcacheD••Redis
©2016Percona18
LargeDataVolume
MySQLisdesignedassinglenodesystem
LimitedinCPU,Memory
Manual“Sharding”solutionsarepainful
Especiallywithcomplexqueries
©2016Percona19
Solutions
MySQL
••ManualSharding
••Vitess••ProxySQL
External
••ShadingforMemcacheDandRedis
••MongoDB••Cassandra
©2016Percona20
Analytics(OLAP)
MySQLdoesnotsupportcolumnbasedstorage
MySQLoptimizerislimitedforcomplexqueries
MySQLdoesnotdoparallelqueryexecution
MySQLdoesnotdodistributedqueryexecution
©2016Percona21
Solutions
MySQL
••ConfigurationandSchemaDesign(Limited)
External
••Hadoop&Spark
••Vertica••ClickHouse
©2016Percona22
FullTextSearch
CanhandlebasicFullTextSearch
Doesnotscalewellwithdatavolume
Noparallelprocessing
Limitedsearchrelevanceoptions
HardTodoGISsearches;Facets
Nolanguageprocessing
©2016Percona23
Solutions
MySQL
••SmallScalesearchapplicationsonly
••SupportedwithInnodbtablessinceMySQL5.6
External
••Elastic••Solr••Sphinx
©2016Percona24
NewSolutionsconstantlyappear
Alwaysbeonlookoutforabettersolutions!
©2016Percona25
ApacheIgnite
NikitaIvanovwillshowwhatyoucandowith
ApacheIgnite!
AccelerateMySQL®forDemandingOLAPandOLTPUseCaseswithApache®Ignite™
December7,2016
NikitaIvanov
Founder&CTO,GridGainSystemsApacheIgnitePMC
WhyIn-MemoryComputingNow?DecliningDRAMCost
Costdrops30%every12months8zettabytesin2015growingto35in2020
DRAM
DataGrowthDrivingDemand
Disk
Flash0
5
10
15
20
25
30
35
2009 2010 2015 2020
GrowthofGlobalData
Zettab
ytesofD
ata
©2014GridGainSystems,Inc.
In-MemoryDataFabricIdealacceleratorforSQLdatastoresandapps
ApacheIgniteisaleadingopen-source,cloud-readydistributedsoftwaredelivering100xperformanceandscalabilitybystoringandprocessingdatainmemoryacrossscaleoutorscaleupinfrastructure.
©2014GridGainSystems,Inc.
In-MemoryDataFabricMaincomponents
©2014GridGainSystems,Inc.
• DistributedIn-MemoryKey-ValueStore• ReplicatedandPartitioneddata• TBsofdata,ofanytype• On-HeapandOff-HeapStorage• HighlyAvailableIn-MemoryReplicas• AutomaticFailover• DistributedACIDTransactions• SQL99 queriesandJDBC/ODBC driver• CollocationofComputeandData
In-MemoryDataGrid
©2014GridGainSystems,Inc.
• DirectAPIforMapReduce• ZeroDeployment• Cron-likeTaskScheduling• StateCheckpoints• LoadBalancing• AutomaticFailover• FullClusterManagement• PluggableSPIDesign
In-MemoryComputeGrid
SmartMeteringandUtilities– deliversacomprehensiveIoTplatform
50+ Million Meters
• SilverSpring Requirements:– 100xspeedupofDB-basedops– Addscalability&elasticity– Useopensourcetechnologies
• WhyGridGainUsed:– Strongcomputecapabilities
• Co-locatedin-memoryprocessing– Demonstratedbest
• On-demandelasticity&scalability• ANSI-99SQLSupport• Transactionalconsistency
SilverSpring IoT Platform
GridGainSecurity
©2016Percona33
JoinUsatPerconaLive!MySQL,MongoDB,OpenSourceDatabases▪April24-27,2017▪SantaClara,CA▪Tutorials,keynotesandsessionsfromtechnicalexperts
Use“WebinarPL”codetoreceivea10%discount▪SaveevenmorewithearlybirdpricinguntilJanuary8th▪https://www.percona.com/live/17/register
Sponsorshipopportunitiesavailable▪https://www.percona.com/live/17/be-a-sponsor
©2014GridGainSystems,Inc.
MoreInformationPerconahttps://www.percona.com/• PeterZaitsev:[email protected]• Consulting:https://www.percona.com/services/consulting
GridGainSystemshttps://www.gridgain.com/• NikitaIvanov:[email protected]• GridGainProfessionalorEnterpriseEditionfor30-DayTrial:https://www.gridgain.com/resources/download
• ApacheIgnite:https://ignite.apache.org/
THANKYOU!!!