Galera Cluster New Features Deep Dive webinar

©"MariaDB"Corpora,on"Ab"

Galera"Cluster"Deep"Dive"Webinar"

"Seppo"Jaakola,"CEO"–"seppo.jaakola@codership.com"

Ralf"Gebhardt,"Sales"Engineer"I"ralf.gebhardt@mariadb.com"""

*" *"27.11.14 1

Agenda"

• Introduc,on"• MariaDB"Galera"Cluster"Essen,als"• Partner"presenta,on:"Codership"• MariaDB"Enterprise"and"MariaDB"Enterprise"Cluster"

27.11.14 2

MariaDB"Corpora,on"and"MariaDB"

• MariaDB"Corpora,on,"formerly"SkySQL"•  Strong"team"of"MariaDB/MySQL"experts"•  Provides"support"and"services"for""

MariaDB,"MySQL"and"derived"databases"•  Strong"Supporter"of"MariaDB"Founda,on"

• MariaDB"•  Compa,ble"with"MySQL"•  Superior"replica,on"and"scalability"for"cloud"•  Addresses"Big"Data"and"IoT"needs"•  MariaDB"is"becoming"the"leading"database"plaVorm"for"cloud"•  MariaDB"is"adopted"by"key"open"source"communi,es"

27.11.14 3

mariadb.com

MariaDB"Enterprise"An"Architecture"Of"Collabora,on"

27.11.14 4

Partner'Products'

Availability"

Management"

Scalability"

Backup"

Applica1on'

Storage Engines

Plug-Ins

Documentation

MaxScale'Proxy'

Connectors'

MariaDB'Enterprise'

Community'

Data"Redundancy"with"MariaDB"

• MariaDB"Internal"Replica,on"•  Asynchronous"•  SemiISynchronous"

• Storage"based"redundancy"(Ac,ve/Passive)"•  DRBD"(Distributed"Replicated"Block"Device)"•  SAN"(Storage"Area"Network)"

• VMWare"replica,on"• MariaDB'Galera'Cluster'

27.11.14 5

HA"using"MariaDB"Replica,on"

• This"is"in"many"cases"a"good"enough"solu,on,"but"it"has"some"issues"

• The"cluster"is"very"loosely"coupled,"not"all"nodes"are"aware"of"all"the"other"nodes"for"example"

• Replica,on"is"asynchronous,"so"failing"over"is"more"difficult"than"usually"

• Adding"a"slave"is"difficult"

27.11.14 6

●  Clustered MariaDB nodescooperate to remain in sync.

●  With multiple master nodes,reads and updates both scale.

●  Synchronous replication withoptimistic locking delivers high availability with little overhead.

●  Fast failover because all nodes remains synchronized.

●  Integrated and tested binaries. ●  Supported by MariaDB.

MariaDB Availability: Galera Cluster Synchronous HA Replication

Load Balancingand Failover

Application / App Server

RW Scalability, HA Failover: Galera Cluster + Connection Load Balancing

●  Applications can be simple, use one connection for reads and updates.

●  Using connection load balancing, MaxScale load balances connections to each node in the Galera Cluster, round-robin.

●  MaxScale monitors the cluster, routing requests only to fully synchronized nodes.

MaxScale

Technology Preview

Partner"Presenta,on:"Codership"

G a l e r a C l u s t e rNew Features

Seppo JaakolaCodership

www.galeracluster.com

Agenda

● Galera Cluster Release History

● Galera project

● Release 3.0 Features● WAN Replication● MySQL Replication Support

● Towards Galera 4

Galera Cluster

wsrep provider

GCS framework

replication

wsrep hooks wsrep

Replication API

certification

vsbes gcommspread

Galera Plugin

dlopen

Galera Cluster

wsrep provider

GCS framework

replication

wsrep hooks wsrep API

certification

vsbes gcommspread

Galera Plugin

Replication Plugin

Replication plugin is runtime loadable● Set global wsrep_provider=none;

● Set global wsrep_provider='/usr/lib/libgalera_smm.so';

With no replication plugin speci'ed, server should work as vanilla MySQL server

Galera Cluster Releases

Galera Cluster projects:

● Replication Interface (wsrep API)● De'nes the interface between DBMS and replication plugin

● Versioned by API level #1-25. Galera 3.0 uses #25

● Galera Replication Plugin● Latest API #25 version is 3.7

● Replication API implementation in MySQL server● 5.5.39-25.11 for MySQL 5.5

● 5.6.20-25.6 for MySQL 5.6

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

0.6GTID

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

0.7DDL support

0.6GTID

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

0.7DDL support

0.6GTID 0.8

Parallel replicationSST script API

mysqldump

xtrabackup

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

0.7DDL support

0.6GTID 0.8

1.0Foreign keys

gcache

mysqldump

xtrabackup

1.1 ...1.2

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

0.7DDL support

0.6GTID 0.8

1.0Foreign keys

gcache

2.0IST

TOI & RSUmysqldump

xtrabackup

1.1 ...1.2

2.1 ...2.7

Roadmap to 3.0

20092009 20102010 20112011 2013201320122012 20142014

0.7DDL support

0.6GTID 0.8

1.0Foreign keys

gcache

2.0IST

TOI & RSU

3.0WAN

Async compatibility 3.1 ...3.7

mysqldump

xtrabackup

1.1 ...1.2

2.1 ...2.7

20 Galera Replication Plugin Releases since 2009

35 Galera Cluster for MySQL Releases since 2009

Galera Project

WSREP API

MySQLCommunity edition

Galera Replication Plugin

Galera Cluster for MySQL

Galera Project

WSREP API

PerconaServer

Percona XtraDB Cluster

Galera Project

WSREP API

PerconaServer

WSREP API

MariaDB

MariaDB Galera Cluster

Galera Project

WSREP API

PerconaServer

WSREP API

MariaDB

MariaDB Galera Cluster

R&DR&D

Galera R&D Community

A network of companies working around Galera technology

With Percona and MariaDB we have joint:● R&D, QA co-operation

● Roadmaps

● Feedback, feature requests

● Bug systems

Galera Cluster Community

● Steady growth for 3 years time span

● Monthly download rates constantly raising

● Presence in Linux distros makes community estimates fuzzy

● Good adoption in cloud installations, AWS, Openstack

Galera 3.0

Released Nov 2013, Featuring:

● Optimization for WAN replication● Cluster can be divided in segments based on location

● Asynchronous replication topologies● Async replication can be interleaved with Galera replication

● Support for MySQL 5.6 GTID

● New write set key format● Makes certi'cation faster

● A step towards huge transaction support

● A number of bug 'xes and minor improvements

WAN Replication 3.0

A-2 A-3

B-2 B-3

Data center A Data center B

● Replication between cluster segments go over one link only● Replication events will be distributed within each segment p2p

WAN Replication 3.0

A-2 A-3

B-2 B-3

Data center A Data center B

● Replication between segments go over one link only● Replication events will be distributed within each segment p2p● Segment gateways can change per transaction

Segment per Data Center

Segment 1 Segment 2

Segment 4Segment 3

Galera + MySQL Replication

Galera Cluster can operate both as MySQL master and MySQL slave

● MySQL master fail over in Galera Cluster has been challenging until now

● MySQL Slave operation has performance bottleneck

Galera 3.0 solves both these problems

MySQL Replication – Multi Source

Node1MySQL slave

MySQL replicationMySQL

master1

Node2MySQL slave

Node3MySQL master

MySQLmaster2

MySQL replication

MySQLslave

MySQL replication

GaleraReplication

MariaDB Multi Source Replication

All Galera nodes can replicate individually their local transactions to MariaDB slave

Multi Source replication interleaves the replication streams in the slave

Losing a node in cluster, does not trigger any needs for fail over

Zero admin solution for fan-out

Node1 Node2Node3

MariaDBslave

MariaDB replication

GaleraReplication

Client transactions

Node1 Node2Node3

MariaDBslave

MariaDB replication

GaleraReplication

Client transactions

Cluster remains healthySlave receives all transactions

Towards 4.0

1. 3.x Improvements● we will have constant back log of 3.0 issues to sort

out while 4.0 will be under development

2. Test system development● MySQL test suite integration

3. New Features● Some new features going in for 3.* releases

● Major uplift for 4.0 , feature set 'xed

● Feedback from community & partners

Galera Cluster QA

● Percona and MariaDB have QA teams testing PXC and MGC respectively

● PXC, MGC and GC QA have slightly diDerent methodologies and focus areas

● Codership has established QA team for testing the upstream Galera Cluster

● Philip Stoev (Random Query Generator) joining Codership QA

Galera Cluster QA

● Traditional cluster testing framework for testing failures and various “scenarios” in a cluster as a whole

● Regression testing for lessons learned with 'xed bugs

● MySQL Test Run (mtr) for feature testing

● Performance regression testing

● Code reviews

● Co-operation with Percona and MariaDB QA teams

New Features...

● Non Blocking DDL● Huge transactions by streaming replication● Optimized consistency alert shutdown

Galera 4.0

● Intelligent Donor selection● Cluster crash recovery● TokuDB support

Galera 3.*

Better Donor Selection Support

● SST donor is selected in random

● 4.0 SST “handshake” makes intelligent choice for donor picking:

● Favor donor who can provide IST● Favor proximity (segment)● Present already in Galera 3.6

● SST donor can be forced by wsrep_sst_donor

Engine Room Power Out

Node A Node CNode B

Node C

? ? Service mysql start –wsrep-new-cluster

Node A Node CNode B

Service mysql startService mysql start

Cluster Crash Recovery

● Engine room power out – use case

● If all nodes shutdown● New cluster must be started and 'rst node to elected

● This is manual operation

● Other nodes can join back automatically, either through IST or SST

Cluster Crash Recovery

● pc.recovery=ON

● Nodes maintain the group information in persistent storage

● After shutdown, the full group can start with same con'guration

Node A Node CNode B

PC PC PC

reconcile

Node A Node CNode B

PC PC PC

Node A Node CNode B

PC PC PC

TokuDB Support

Initial TokuDB support has been pushed to MGC-10

● But: this is experimental only!● Master-slave model only (no conLict resolution)● Not safe for parallel applying

Benhmarking shows good performance for tokuDB, 3 node installation

Complete tokuDB support with Multi-Master capabilities requires more work in tokuDB lock manager

Huge Transaction Support

● Currently transaction processes in master node until commit time

● For large transactions, the write size will be big, and is hard to handle

● There are means to prevent too large transactions● wsrep_max_ws_rows

● wsrep_max_ws_size (not enforced atm)

Huge Transaction Replication

Huge transaction

Galera Replication

Node A Node B

Huge trx

Huge transaction

Galera Replication

Node A Node B

Huge trx

Huge transaction

Galera Replication

Node A Node B

Huge trx

commit

Huge transaction

Galera Replication

Node A Node B

Huge trx

Huge transaction

Galera Replication

Node A Node B

Huge trx

WS WS WS

Huge Transaction Support

● In Galera Cluster 4.0 ● Possible to replicate transactions of any size

● Transaction size limits will remain, cluster can still reject too large transactions

Optimizing Consistency Shutdown

● Current Policy for Inconsistency:

● For suspected inconsistency, cluster node will do emergency shutdown

● However, DDL failures are logged only as warnings

● Injected inconsistency in one node can cause all other nodes to shutdown

Inconsistency Shutdown

Galera Replication

Node A Node B Node C

Create table t1 (i int)

Galera Replication

Set wsrep_on=OFFInsert into t values (8)

t1 t1 t1

Set wsrep_on=ONDelete from t;

t1 t1 t1

Set wsrep_on=ONDelete from t;

Optimizing Consistency Shutdown

● Galera Cluster 4.0 will optimize shutdowns due to suspected inconsistency

● Target is to shutdown minimal number of nodes

Non-Blocking DDL

Current DDL replication blocks whole cluster for the duration of DDL statement processing

Galera Cluster 4.0 has two developments:

1. Through TOI, but locking only aDected table

2. Rolling Schema Upgrade (RSU) optimized

Non-Blocking DDL - RSU

Galera Replication

Node.BNode.A Node.C

Non-Blocking DDL - RSU

Galera Replication

Node.BNode.A Node.C

desync

ALTER TABLE...

● High priority DDL● Not replicated

Non-Blocking DDL - TOI

ALTER TABLE t1

Node A Node B

ALTER TABLE t1

WSseqno

Node A Node B

ALTER TABLE t1

Node A Node B

ALTER t1ALTER t1

ALTER TABLE t1

Node A Node B

ALTER t1ALTER t1

UPDATE t2

ALTER TABLE t1

Node A Node B

ALTER t1ALTER t1

UPDATE t1

ALTER TABLE t1

Node A Node B

ALTER t1ALTER t1

UPDATE t1

UPDATE t3

ALTER TABLE t1

Node A Node B

ALTER t1ALTER t1

UPDATE t1

UPDATE t4

Node A Node B

Happy Clustering :-)

Thank you for listening!

MariaDB"Services"

MariaDB"Enterprise:"Integra,ng"the"Complete"Solu,on"

MariaDB Enterprise

24/7 Support,Technical Services

Partner Products

Enterprise Products

MariaDB"Enterprise:""Choose"From"Two"Product"Subscrip,ons"

MariaDB Enterprise Everything you need: a packaged, enterprise RDBMS product based on the popular MariaDB open source project, along with robust technical services and support.

MariaDB Enterprise Cluster A highly available database cluster product that combines MariaDB with advanced, multi-master clustering, along with expert support for demanding production applications.

MariaDB"Enterprise"Subscrip,on"Offers"

27.11.14 13

MariaDB'Enterprise' MariaDB'Enterprise'Cluster'

Summary' Powerful"enterprise"data"management." Highly"available"database"cluster"for"the"most"demanding"use"cases."

Supported'Database'Pla=orms'

●  MariaDB"(Included)"●  MySQL"

●  MariaDB"Galera"Cluster"(Included)"●  MySQL"+"Galera"

Comprehensive'Benefits:'●  30'min.'support'response'

●  Unlimited'incidents'

●  Updates'and'bug'fixes'

●  Security'patches'

●  Advice,'hotHfixes'

●  Installa1on,'configura1on'help'

●  Email,'web,'remote'login'

●  Exclusive'content'

●  Roadmaps'

●  Op1onal'enterprise'products'

●  Op1onal'services'including'

Remote'DBA,'Consul1ng,'Training,'

Custom'Development'

✔' ✔'

Included'ThirdHparty'Products'

●  Monitoring:"MONyog"●  Query"Editor:"SQLyog"●  Backup:"XtraBackup,"Zmanda"Backup"

●  Cluster"Deployment,"Management""&"Monitoring":"SeveralNines"ClusterControl"

●  Monitoring:"MONyog"●  Query"Editor:"SQLyog"●  Backup:"XtraBackup,"Zmanda"Backup"

●  MariaDB Portal ○  https://mariadb.com/resources/mariadb-portal

●  MariaDB Enterprise ○  mariadb.com/products/mariadb-enterprise

●  MariaDB Enterprise Cluster ○  mariadb.com/products/mariadb-enterprise-cluster

●  Guides and White Papers ○  mariadb.com/resources/guides-whitepapers

●  Downloads ○  https://mariadb.com/resources/downloads

●  Contact Us ○  mariadb.com/about/contact

MariaDB Resources

Ques,ons?"

www.mariadb.com"www.facebook.com/mariadb.dbms"

www.twider.com/mariadb""

Galera Cluster New Features Deep Dive webinar

Documents

High-availability with Galera Cluster for MySQL... 1 / 21 High-availability with Galera Cluster for MySQL FromDual Company Meeting 10. September 2014, Barcelona by oli.sennhauser@fromdual.com

KiKxxl Chooses Galera Cluster...KiKxxl Chooses Galera Cluster for Highly Available Communication Services KiKxxl is a German communications company with over one thousand service center

Webinar - Manage Galera Cluster with Puppet

Plny12 galera-cluster-best-practices

MySQL always-up with Galera Cluster - FromDual · MySQL always-up with Galera Cluster SLAC 2014 May 14, 2014, Berlin by oli.sennhauser@fromdual.com . 2 / 31 About FromDual GmbH

Migration Workshop PXC 5.5 to MariaDB 10 - FromDual · 2012 – Percona XtraDB Cluster 5.5/Galera v2 2013 – MySQL 5.6/Galera v3 2013 – MariaDB Galera Cluster 5.5/Galera v2 2013

Galera Cluster Documentation€¦ · Galera Cluster Documentation, Releases 3.x and 4.x • Flow Control (page 22) Galera Cluster manages the replication process using a feedback

MariaDB Europe Roadshow 2015 - Galera Cluster 4.0 New Features

Case study: MariaDB Galera Cluster powering the Ingenico Financial e-money solution

Galera Documentation - Galera Cluster for MySQLgaleracluster.com/documentation-webpages/galera-documentation.pdf · Galera Documentation, Release Galera Cluster is a synchronous multi-master

MercadoLibre Chooses Galera Cluster · SQLAlchemy to interact with MySQL. The Galera Cluster consists of 9 nodes (8 actives – 1 NOR) balanced by an F5 bigIP load balancer with more

MySQL always-up with Galera Cluster - Heinlein Support · PDF file 1 / 31 MySQL always-up with Galera Cluster SLAC 2014 May 14, 2014, Berlin by oli.sennhauser@fromdual.com

MySQL always-up with Galera Cluster 1 / 31 MySQL always-up with Galera Cluster SLAC 2014 May 14, 2014, Berlin by oli.sennhauser@fromdual.com 2 / 31 About FromDual GmbH FromDual provides

Plmce2k15 15 tips galera cluster

High-availability with Galera Cluster for MySQL · · 2014-05-09High-availability with Galera Cluster for MySQL LinuxTag 2014 10. Mai 2014, ... High-Availability :- ... Read scalability

Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster

Become a MySQL DBA - Webinars - Schema Changes for MySQL Replication & Galera Cluster (slides)

Galera Cluster Best Practices for DBA's and DevOps Part 1

Galera Cluster DDL and Schema Upgrades 220217

Taking Full Advantage of Galera Multi Master Cluster