Download pdf - Sneak Peek: Continuent Tungsten 3.0

©Continuent 2014

Continuent Tungsten 3.0 Sneak Peek

Robert Hodges, CEO Ari Valtanen, VP of Products

©Continuent 2014

Continuent Tungsten 3.0 Sneak Peek

Robert Hodges, CEO Ari Valtanen, VP of Products

©Continuent 2014

Presentation Topics

• What are the big data management problems of business critical applications?

• How have Continuent products evolved to solve those problems?

• What is Continuent Tungsten 3.0 and what does it do for users?

• Wrap-up and Questions

3

©Continuent 2014

A Quick Intro to Continuent

4

• The leading provider of clustering and replication for open source DBMS

• Our Product: Continuent Tungsten

• Clustering - Commercial-grade HA, performance scaling and data management for MySQL

• Replication - Flexible, high-performance data movement

©Continuent 2014©Continuent 2014

Continuent Tungsten Customers

5

1

©Continuent 2014

Quick Continuent Facts

• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data

• Largest installation by transaction volume handles up to 8 billion transactions daily

• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop are in production now

• Amazon Redshift is the newest data warehouse target

6

©Continuent 2014 7

Data Management Needs of Business-Critical

Applications

©Continuent 2014

Business Critical MySQL Circa 2010

8

ApplicationApplicationApplications

RAIDed Storage

with BBU

No data over distance

Self-managed bare metal

servers

Home-grown management

scripts

Analytics on MySQL

©Continuent 2014

What are the big trends in the market?

• High performance transaction processing with 24x7 availability

• Data distribution across sites

• Cloud and on-premises operation

• Real-time reporting on all corporate data

9

©Continuent 2014

Growth of Analytics Capabilities

10

©Continuent 2014

Most Valuable Features According to Continuent Customers

11

Automatic Failover

Zero-Downtime Maintenance

Load Balancing

Performance

Multi-Site Ops

Disaster Recovery

Percentage of Respondents

0% 20% 40% 60% 80%

25%

29%

30%

36%

53%

72%

©Continuent 2014

Customer Growth Trends

12

Increasing Clusters

Adding Analytics

Adding Both

Percentage of Respondents

0% 10% 20% 30% 40%

14%

32%

38%

50%

©Continuent 2014

Business Critical MySQL 2014

13


Elastic Block

Storage

Cross- Region

DR Sites

On-Demand Cloud

Instances

Puppetized Host

Management

Analytics on Hadoop Cluster


Elastic Block

Storage

©Continuent 2014 14

Evolution of Tungsten to support business-critical

data management

©Continuent 2014

Continuent Tungsten 1.3

15

ReplicatorReplicator Replicator

Master SlaveSlave

Manager Manager Manager

Connector Connector Connector Connector

ApplicationApplication ApplicationApplication ApplicationApplication

High Availability with Read/Write Splitting

©Continuent 2014


16

Cross-Site Disaster Recovery

©Continuent 2014


17

Optimized Cloud Ops !

Parallel Replication !

Multi-Site Multi-Master

©Continuent 2014

Tungsten Replicator 2.0

18

Multi-master Heterogeneous

MySQLOracle

OracleMySQL MySQL

Fan-In

Advanced Replication Topologies

©Continuent 2014

Tungsten Replicator 3.0

19

Expanded Data Warehouse

Support

MySQL Master

Scalable row store with star schema and materialized view support

CSV files stored on HDFS with access via Hive/MapReduce

Column storage with compression and full SQL query

Amazon Redshift


What is Continuent Tungsten 3.0?

©Continuent 2014

Continuent Tungsten 3.0 Features

21

Clustering Local HA Scaling

Primary/DR

Replication Advanced Topologies

Data warehouse loading

Continuent Tungsten 3.0 Certified hybrid multi-site operation

Cloud-optimized Puppet/Chef provisioning Certified HA / analytics integration

©Continuent 2014

Hybrid Multi-Master and Primary/DR

22

No app or data coupling across regions

ApplicationApplications ApplicationApplications

Amazon Region On-Premises

Live data and apps

in all regions

Clustering over AZs

Async replication between sites

Data in cloud or on-premises

OR

©Continuent 2014

Cloud-Optimized Provisioning

• Continued improvement of Puppet classes

• Addition of Chef recipes

• Dev/test install driven by Vagrant

23

(Provision Host) Step 1: Install pre-requisites Step 2: Unpack Tungsten software from RPM Step 3: Call tpm to install cluster

©Continuent 2014

Real-time Loading from Clustered MySQL to Data Warehouses

24

Tungsten Replicator

cluster1 Amazon Redshift

cluster2

©Continuent 2014

Certified Data Warehouse Loading

25

HP Vertica 6.0+

Amazon Redshift

Oracle EE/SE 10G-11G

• Bi-directional

Hadoop

• Cloudera Data Hub

• Hortonworks Data Platform

• MapR

• IBM Infosphere BigInsights

• Pivotal HD

• Apache Hadoop

©Continuent 2014

Demo

26

Transaction Processing and Analytics Integration


Roadmap for Continuent Tungsten 3.0 Availability

©Continuent 2014

Roadmap for CT 3.0 release

28

• All features described here are working with anchor customers

• We are polishing integrations and improving documentation

• We are looking for 3.0 beta customers now

• Full product release will occur during Q4


Future Roadmap

©Continuent 2013

Complete the Data Fabric Vision!

30

Web Application

Web Application

Proprietary RDBMS

Packaged Applications

Bridge

Bridge

Fabric Connector

Fabric Connector

OLTP Primary

Data Marts

Bridge

Bridge Hadoop Analytics

Data Streams Data Streams

Fabric Connector

Fabric Connector

Fabric Connector

OLTP DR

Bridge

SQL Column Store

Bridge

Amazon Redshift

©Continuent 2014

CT 3.0 Offers Complete Management for Business-Critical Data

• Continued 24x7 transaction processing based on economical MySQL DBMS

• Certified hybrid multi-site operation

• Cloud-optimized Puppet/Chef provisioning

• Certified HA / analytics integration

31

©Continuent 2014

www.continuent.com Follow us on Twitter @continuent

!

Tungsten Replicator: http://code.google.com/p/tungsten-replicator

Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/

560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]