Download pdf - Picking the Right Clustering for MySQL - Cloud-only Services or Flexible Tungsten Clusters?

©Continuent 2014

Picking the Right Clustering for MySQL : Cloud-only Services or

Flexible Tungsten Clusters?

Robert Hodges, CEO

©Continuent 2014

Introducing Continuent

2

• The leading provider of clustering and replication for open source DBMS

• Our Product: Continuent Tungsten

• Clustering - Commercial-grade HA, performance scaling and data management for MySQL

• Replication - Flexible, high-performance data movement

©Continuent 2014

Quick Continuent Facts

• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data

• Largest installation by transaction volume handles up to 8 billion transactions daily

• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop in production

• Cross-site topologies widely deployed

3

©Continuent 2014©Continuent 2014

Continuent Tungsten Customers

4

1

©Continuent 2014 5

The Cloud Data Stampede

©Continuent 2014

Enterprise IT: The Race to the Cloud

6

©Continuent 2014

Important Questions for Data

• What are the real features required for enterprise data management?

• How do you preserve full control over the environment and upgrades?

• How do you integrate cloud and on-premises operation?

• What is the right level of support for your business?

7

©Continuent 2014

Amazon RDS Is An Obvious Solution

8

©Continuent 2014

How Amazon RDS Works

9

DRBD Replication

(Synchronous)

Read Replicas

MySQL Native Replication (Async)

Active Primary

Inactive Standby

Applications

DNS CNAME

©Continuent 2014

Amazon RDS vs Enterprise Requirements

• Operates only in Amazon cloud

• DBMS clusters tied to a single AWS region

• Connectivity to RDS is a user problem

• No direct control/access in DBMS

• Cumbersome maintenance model

• Weak integration with other DBMS types

• No enterprise-level support

10

©Continuent 2014 11

Tungsten Cloud Clusters for MySQL

©Continuent 2014

Tungsten Database-as-a-Service

12

Tungsten clusters combine off-the-shelf open source DBMS servers into data services with: !

• 24x7 data access • Scaling of load on replicas • Simple management commands !...without app changes or data migration

Amazon US West

apache /php

GonzoPortal.com

Connector Connector

©Continuent 2014

Cluster Architecture

13

Application

Tungsten Connector

Application

Tungsten Connector

Replicator

Db2

Replicator

Db3Db1

Replicator

Slave SlaveMaster

Manager Manager Manager

Monitoring and Control

Monitoring and Control

Data Service: sjc

©Continuent 2014

Tungsten Connector Basics

• Any MySQL client can connect

• Initiates connections using JDBC

14

App Native protocol

!COM_QUERY

COM_INIT_DBCOM_DROP_DB

Connector

©Continuent 2014

Tungsten Connector Basics

• Pass-through operation after connection

• Full transparency & low overhead for clients

15

App

Protocol packet COM_QUERY

select * from t

ConnectorProtocol packet

OKResultSet Rows:1

©Continuent 2013

Tungsten Primary/DR Deployment

16

Warm data and apps in secondary region(s)

ApplicationApplications ApplicationApplications

Amazon Region Amazon Region

Live data and apps

in primary region only

Multi-AZ deployment

Async replication between sites

Run in Amazon or on-premise

©Continuent 2013

Tungsten Multi-Master Deployment

17

No app or data coupling across regions



Live data and apps

in all regions

Multi-AZ deployment




Demo: Cross-Regional Multi-Master Clusters

in Amazon


Top-to-Bottom Control of DBMS Services

©Continuent 2014

Rolling SQL Schema Upgrade

20

Final UpgradeSwitchSlave Upgrade Slave Upgrade

• Shun slave 1, run upgrade, and return to cluster. Discard and recover on failure

• Upgrade old master. Cluster schema is now fully upgraded

• Repeat for additional slave(s)

• Switch master to promote an upgraded slave

©Continuent 2014

Rolling MySQL Parameter Changes

21

Final UpgradeSwitchSlave Upgrade Slave Upgrade

• Shun slave 1, change parameter, and restart. Reverse and restart on failure

• Change parameter on old master. All DBMS are now fixed.

• Repeat for additional slave(s)

• Switch master


Exploring Hybrid Cloud Operation

©Continuent 2013

Cloud vs. On-Premises Operation

23

©Continuent 2014

Perils of a Single Vendor

24

Date Duration Amazon Failure Description

Apr 2011 2 days US-East EBS failure - “Cloudpocalypse”

Aug 2011 1 day EU-West power outage causes multi-AZ EBS, EC2, and RDS failures

Jun 2012 1-2 days US-East AZs fail due to weather, EBS & other services down

Oct 2012 6+ hours US-East EBS failure triggered by bug brings down RDS and ELB

Aug 2013 1+ hours US-East EC2 networking failure

Dec 2013 3 hours US-East EC2 connectivity failures (again)

©Continuent 2013

Hybrid Primary/DR Is a Common Pattern

25

Use Amazon as DR

location


On-Prem Primary Cloud DR

Establish primary in

existing data center

Hardware- based cluster

Async replication between locations

Multi-AZ in Amazon

©Continuent 2013

Hybrid Data Integration

26

No app or data coupling across regions



Live data and apps

in all regions

Multi-AZ deployment




Demo: Cross-Regional Multi-Master Clusters

in Amazon

©Continuent 2014

Further Cross-Site Topologies

28

Data Warehouse

All Masters

Fan-In


Enterprise Support with Fingerspitzengefühl

©Continuent 2014

What Do We Mean by That?

30

Fingerspitzengefühl: finger tips feeling !

• Ability to respond appropriately and tactfully

• A superior ability to respond to an escalated situation

!

Wikipedia

©Continuent 2014

Enterprise-Class Support from Continuent

• Worldwide support team with 24x7 response

• Advice, workarounds, and bug fixes

• 1st line staffed by MySQL/clustering experts

• Fast escalation to engineering for problems

• Collaborative support model using Zendesk and GotoMeeting

• Implementation services for new deployments and upgrades

31


Wrap-Up

©Continuent 2014

Tungsten clusters offer an enterprise alternative to pure cloud services

• Even the best cloud-only MySQL services do not meet enterprise requirements fully

• Tungsten clusters have enterprise-ready features that function equally well in cloud and on-prem

• Continuent offers software and support necessary to manage business-critical data for the most demanding enterprises

33

©Continuent 2014

www.continuent.com Follow us on Twitter @continuent

!

Tungsten Replicator: http://code.google.com/p/tungsten-replicator

Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]