Upload
ted-wennmark
View
214
Download
1
Tags:
Embed Size (px)
Citation preview
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Introduction to MySQL Ted Wennmark, consultant and cluster specialist
Copyright © 2014, Oracle and/or its affiliates. All rights reserved.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
2
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Major milestones in history
• 2001 MySQL 3.23 GA
• 2004 MySQL 4.0 InnoDB new SE
• 2005 MySQL 5.0 GA and Oracle acquired Innobase OY
• 2008 SUN acquired MySQL AB for $1 Billion
• 2010 Oracle acquires SUN
• 2010 MySQL 5.5 GA “InnoDB default”
• 2013 MySQL 5.6 GA “Best release ever”
3
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Open Source LAMP Stack
Operating
System
Application
Server
Database
Scripting
L
A
M
P
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
World’s Most Popular Open Source Database
• Over 15 million estimated installations
• Used by 9 of top 10 web sites in the world
• Embedded by 8 of the top 10 ISVs
• #1 database in the Cloud
• Integrated w/Hadoop in 80% of Big Data platforms
• Facebook: 175K fans, +35% YoY Growth
• Twitter: 28K followers, +67% YoY Growth
• Numerous Awards: Linux Journal, CRN, PHP Architect...
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Cloud
Web & Enterprise OEM & ISVs
Industry Leaders Rely on MySQL
6
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Powers The Web
Over 500 million Tweets/day. 143,200 Tweets/sec in Aug 2013
”Many petabytes” of data. 11.2 Million Row changes & 2.5 billion rows read /sec handled in MySQL
6 billion hours of video watched each month
Globally-distributed database with 100 terabytes of user-related data based on MySQL Cluster
7
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MyISAM
• Default Storage Engine before MySQL 5.5
• Table level locking
• Small footprint on disk
• Read Only during backups
• GIS and FTS indexing
9
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
InnoDB
• Default Storage Engine since MySQL 5.5
• ACID compliant transactions, MVCC
• Row level locking
• Clustered primary key index
• Foreign keys and and native partitioning
• Online backup and DDL operations
• SQL and NoSQL access to data
10
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Cluster aka NDB
• Clustered database
• ACID compliant
• Row level locking
• Shards data automatically, transparent for application
• Foreign keys and and native partitioning
• Online backup and DDL operations
• SQL and NoSQL access to data
• Max 2TB
11
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL 5.5
• InnoDB default SE
• InnoDB multiple BP, splitting and removing mutexes
• InnoDB 10X improvemet in InnoDB recovery speed
• Replication semi-synchronous replication
• Replication heartbeat
• Partitioning on more data types and more partition functions
• Performance Schema released
12
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL 5.6 GA “Best release ever”
• InnoDB scales up to 48 (60) cores
• InnoDB NoSQL access using memcached API
• Optimizer improvements for sub-queries
• Optimizer Explain on all type of statements
• Replication safer and more robust
• Replication multi threaded slaves
• Partition pruning in DML
13
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL 5.7 DM
• InnoDB for better transactional throughput, availability, IO
• Security with new encryption functions
• Replication for better scalability and availability
• Fabric for high availability and sharding
• Performance Schema for new and improved performance metrics
• Optimizer for better EXPLAINing, parsing, query performance
• GIS with native InnoDB spatial indexes and Boost.Geometry integration
Available Now! dev.mysql.com/downloads/mysql/
14
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
0
100 000
200 000
300 000
400 000
500 000
600 000
700 000
8 16 32 64 128 256 512 1 024
Qu
eri
es
pe
r Se
con
d
Connections
MySQL 5.7: Sysbench Read Only (Point Select)
MySQL 5.7
MySQL 5.6
MySQL 5.5
MySQL 5.7: Sysbench Benchmark
Intel(R) Xeon(R) CPU E7-4860 x86_64 4 sockets x 10 cores-HT (80 CPU threads) 2.3 GHz, 512 GB RAM Oracle Linux 6.5
2x Faster than MySQL 5.6 3x Faster than MySQL 5.5
645,000 QPS
15
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Future Focus on Web, Cloud, Embedded
• Architecture Improvements
– Improved Modularity
– Refactoring Optimizer, Parser, Runtime
• Web Scale Performance & Scalability
– Optimizer Cost Model
– InnoDB & Replication Improvements
• Management & Security
– Data Dictionary
– MySQL Enterprise Encryption
– Oracle Enterprise Manager for MySQL
16
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Replication
MySQL Fabric
DRBD
Windows/Solaris/Clusterware Clustering or Oracle VM
MySQL Cluster
MySQL HA Solutions
19th February 2015
9 9 . 9 9 9 %
Copyright 2015, Oracle and/or its affiliates. All rights reserved 17
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Mapping Uptime to Availability
Replicated Systems
• SPs & Line of Business
Clustered & Virtualized Systems
• Web & Cloud Services
Shared Nothing, Geo-Replicated Clusters
• eCommerce, Telecoms & Military
19th February 2015
9 9 . 9 9 9 %
Co
st &
Co
mp
lexi
ty
Copyright 2015, Oracle and/or its affiliates. All rights reserved 18
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Fabric 1.5
• High Availability
– Server monitoring with auto-promotion and transparent application failover
• Optionally scale-out through sharding
– Application provides shard key
– Range or Hash
– Tools for resharding
– Global updates & tables
• Fabric-aware connectors rather than proxy: Python, Java, PHP, .NET, C (labs)
– Lower latency, bottleneck-free
• Server provisioning using OpenStack etc.
High Availability + Sharding-Based Scale-out
MySQL Fabric
Connector
Application
Read-slaves
SQL
HA group
Read-slaves
HA group
Connector
Application
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 19
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 20
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Oracle Clusterware unifies servers in a server farm to form a cluster
– At the core of Oracle RAC
• Oracle Cluster 12c includes MySQL Server 5.6 agent
• Planned migration and failover of MySQL database
– Hidden from the application
19th February 2015
MySQL on Oracle Clusterware
21 Copyright 2015, Oracle and/or its affiliates. All rights reserved
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Native Windows HA clustering with MySQL
• Quorum (3rd vote), data (InnoDB + schema) & binaries (optional) stored in shared storage (iSCSI & FCAL)
• Loss of service = couple of seconds + InnoDB recovery time
• Cluster managed through MS Failover Cluster Management snap-in GUI
Windows Server Failover Clustering
App
Virtual IP
Data Bin
Slave App App
Vote
19th February 2015 22 Copyright 2015, Oracle and/or its affiliates. All rights reserved
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Kernel based heartbeating and monitoring
• SPARC and x86. Solaris Virtualization-aware
• MySQL agent included with Oracle Solaris Cluster
• Learn more: http://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/index.html
Oracle Solaris Clustering
19th February 2015 23 Copyright 2015, Oracle and/or its affiliates. All rights reserved
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Based on distributed storage
– NOT physical shared storage
• Synchronous replication at block device level eliminates risk of data loss
• Open source, mature & proven
• Certified and supported by Oracle
Oracle Linux and DRBD Stack
Hosts
Oracle Linux Oracle Linux
Active Standby
Corosync
Pacemaker Cluster s/w
DRBD DRBD
MySQL MySQL
Application
VIP
sync
Services
19th February 2015 24 Copyright 2015, Oracle and/or its affiliates. All rights reserved
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Pre-Installed & Pre-Configured
• Full Integration & QA Testing
• Single Point of Support
Oracle VM Template for MySQL
Oracle VM Servers
Oracle VM Server Pool
ocfs2
Oracle VM
Manager
iSCSI / FC-AL
Oracle VM
Secure Live
Migration (SSL)
Oracle VM
Automatic Fault
Detection &
Recovery
19th February 2015 25 Copyright 2015, Oracle and/or its affiliates. All rights reserved
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Cluster Overview
• Auto-Sharding, Multi-Master
• ACID Compliant, OLTP + Real-Time Analytics HIGH SCALE, READS +
WRITES
• Shared nothing, no Single Point of Failure
• Self Healing + On-Line Operations 99.999% AVAILABILITY
• In-Memory Optimization + Disk-Data
• Predictable Low-Latency, Bounded Access Time REAL-TIME
• Key/Value + Complex, Relational Queries
• SQL + Memcached + JavaScript + Java + HTTP/REST & C++ SQL + NoSQL
• Open Source + Commercial Editions
• Commodity hardware + Management, Monitoring Tools LOW TCO
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 26
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Cluster Architecture
MySQL Cluster Data Nodes
Clients
Application Layer
Data Layer
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 27
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Cluster Scaling
MySQL Cluster Data Nodes
Clients
Application Layer
Data Layer
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 28
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
MySQL Cluster HA
MySQL Cluster Data Nodes
Clients
Application Layer
Data Layer
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 29
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Who’s Using MySQL Cluster?
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 30
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle MySQL HA & Scaling Solutions MySQL
Replication MySQL Fabric
Oracle VM Template
Oracle Clusterware
Solaris Cluster
Windows Cluster
DRBD MySQL Cluster
App Auto-Failover ✖ ✔ ✔ ✔ ✔ ✔ ✔ ✔
Data Layer Auto-Failover ✖ ✔ ✔ ✔ ✔ ✔ ✔ ✔
Zero Data Loss MySQL 5.7 MySQL 5.7 ✔ ✔ ✔ ✔ ✔ ✔
Platform Support All All Linux Linux Solaris Windows Linux All
Clustering Mode Master +
Slaves Master +
Slaves Active/Pas
sive Active/Passi
ve Active/P
assive Active/Pas
sive Active/P
assive Multi-Master
Failover Time N/A Secs Secs + Secs + Secs + Secs + Secs + < 1 Sec
Scale-out Reads ✔ ✖ ✖ ✖ ✖ ✖ ✔
Cross-shard operations N/A ✖ N/A N/A N/A N/A N/A ✔
Transparent routing ✖ For HA ✔ ✔ ✔ ✔ ✔ ✔
Shared Nothing ✔ ✔ ✖ ✖ ✖ ✖ ✔ ✔
Storage Engine InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ NDB
Single Vendor Support ✔ ✔ ✔ ✔ ✔ ✖ ✔ ✔
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 31
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Best Choice for Next Generation Web & Cloud Applications
World’s Most Popular Open Source Database
Leading Open Source Database for Web
Applications
#1 Open Source Database in the Cloud
Integrated with Hadoop in Big Data Platforms
Strong MySQL Momentum
32
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Getting Started
19th February 2015
MySQL Enterprise Edition • http://www.mysql.com/news-and-events/web-seminars/why-relying-on-mysql-enterprise-edition/
• http://www.mysql.com/news-and-events/web-seminars/the-mysql-sys-schema/
MySQL Security and Upgrading to 5.6 • http://www.mysql.com/news-and-events/web-seminars/mysql-security-whats-new-in-mysql-5-7-best-practices/
• http://www.mysql.com/news-and-events/web-seminars/upgrading-to-mysql-5-6-best-practices/
MySQL Availability • http://www.mysql.com/why-mysql/white-papers/#en-22-16
• http://www.mysql.com/news-and-events/on-demand-webinars/#en-20-16
Copyright 2015, Oracle and/or its affiliates. All rights reserved 33