50
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | The State of the Dolphin & Penguin Sanjay Manwani Ramesh Srinivasan MySQL India Director Sr. Director, Linux & VM Copyright © 2014, Oracle and/or its affiliates. All rights reserved.

MySQL & Oracle Linux Keynote at Open Source India 2014

Embed Size (px)

Citation preview

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

The State of the Dolphin & Penguin Sanjay Manwani Ramesh Srinivasan MySQL India Director Sr. Director, Linux & VM

Copyright © 2014, Oracle and/or its affiliates. All rights reserved.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle’s View on Open Source

• Oracle is primarily driven by customer demand, and committed to offering choice, flexibility, and lower cost of computing for end users

• Open Standards are crucial

• Oracle is investing significant resources in developing, testing, optimizing, supporting and promoting open source technologies - offering leading open source solutions as a viable choice for development and deployment

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

30+ Years of Open Standards Leadership Integrating Real-World Heterogeneous Environments

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle’s Investment in Open Source

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Nearly 5 Years of Oracle Stewardship

6

More Investment, More Innovation

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL 5.7: Innovation & Quality

• Worklogs Implemented in 5.7: 244

• New MTR Tests for 5.7: 497

• Total Bugs Fixed in 5.7: 1263

• Total Bugs Fixed since 5.5: 8259

– Since MySQL 5.5 GA Dec 15, 2010

7

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Best Choice for Next Generation Web & Cloud Applications

World’s Most Popular Open Source Database

Leading Open Source Database for Web

Applications

#1 Open Source Database in the Cloud

Integrated with Hadoop in Big Data Platforms

Strong MySQL Momentum

8

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL Architecture Focus on Web, Cloud, Embedded

• Architecture Improvements

– Improved Modularity

– Refactoring Optimizer, Parser, Runtime

• Web Scale Performance & Scalability

– Optimizer Cost Model

– InnoDB & Replication Improvements

• Management & Security

– Data Dictionary

– MySQL Enterprise Encryption

– Oracle Enterprise Manager for MySQL

9

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

0

100,000

200,000

300,000

400,000

500,000

600,000

700,000

8 16 32 64 128 256 512 1,024

Qu

eri

es

pe

r Se

con

d

Connections

MySQL 5.7: Sysbench Read Only (Point Select)

MySQL 5.7

MySQL 5.6

MySQL 5.5

MySQL 5.7: Sysbench Benchmark

Intel(R) Xeon(R) CPU E7-4860 x86_64 4 sockets x 10 cores-HT (80 CPU threads) 2.3 GHz, 512 GB RAM Oracle Linux 6.5

2x Faster than MySQL 5.6 3x Faster than MySQL 5.5

645,000 QPS

10

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL 5.7: InnoDB, NoSQL With Memcached 6x Faster than MySQL 5.6 Thank you, Facebook

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

8 16 32 64 128 256 512 1,024

Qu

eri

es

pe

r Se

con

d

Connections

MySQL 5.7 vs 5.6 - InnoDB & Memcached

MySQL 5.7

MySQL 5.6

1 Million QPS

11

Intel(R) Xeon(R) CPU E7-4860 x86_64 4 sockets x 10 cores-HT (80 CPU threads) 2.3 GHz, 512 GB RAM Oracle Linux 6.5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL 5.7: Connections per Second 1.7x Faster than MySQL 5.6 2.5x Faster than MySQL 5.5

67,000 Connections/Sec

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

80,000

MySQL 5.5 MySQL 5.6 MySQL 5.7

Co

nn

ect

ion

s/Se

con

d

Connections Per Second

MySQL 5.5

MySQL 5.6

MySQL 5.7

12

Intel(R) Xeon(R) CPU E7-4860 x86_64 4 sockets x 10 cores-HT (80 CPU threads) 2.3 GHz, 512 GB RAM Oracle Linux 6.5

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Improving Cloud Operations

• MySQL Fabric

– HA & Sharding

• Provisions machines & MySQL

– OpenStack Nova

– Coming Soon: Trove, AWS

• Server setup

– Clones slave

– Sets up replication

13

MySQL Fabric: OpenStack Server Provisioning

labs.mysql.com

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL Fabric 1.5: High Availability & Sharding

• OpenStack Integration

• High Availability

– Server monitoring; auto-promotion and transparent application failover

• Sharding for Scale-out

– Application provides shard key • Integer, date or string

– Range or Hash

– Tools for resharding

• Fabric-aware connectors rather than proxy: Python, Java, PHP, .NET, C (labs)

– Lower latency, bottleneck-free

MySQL Fabric

Connector

Application

Read-slaves

SQL

HA group

Read-slaves

HA group

Connector

Application

14

GA

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Consolidate updates from multiple Masters into one Slave

– Consolidated view of all shards

– More flexible topologies

– Centralized point for backups

• Compatible with Semi-Sync Replication & enhanced MTS

• Master-specific slave filters

MySQL 5.7: Multi-Source Replication

Binlog

Master 1

Binlog

Master 2

Binlog

Master N

IO 1

Relay 1

Coordinator

W1 W2 … WX

IO 2

Relay 2

Coordinator

W1 W2 … WX

Coordinator

W1 W2 … WX

IO N

Relay N

Coordinator

W1 W2 … WX

Slave

15

labs.mysql.com

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Shared-nothing virtually synchronous database system

• Multi-master update anywhere

– Conflict detection and resolution (transaction rollback)

– Optimistic State Machine Replication

• Automatic group membership management and failure detection

– No need for server fail-over

– Elastic scale out/in

– No single point of failure

– Automatic reconfiguration

• Well integrated

– InnoDB

– GTID-based replication

– PERFORMANCE_SCHEMA

MySQL 5.7: Group Replication

Application

MySQL Masters Replication

Plugin

API

MySQL Server

Group Comms (Corosync)

16

labs.mysql.com

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

HTTP Plugin for MySQL

• Server Plugin adds HTTP(S) endpoints to MySQL

• Results are serialized to JSON format encoded as UTF8

• Provides 3 choices of User Endpoint Types

– SQL

– CRUD - Key-Value

– JSON - Document

17

labs.mysql.com

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL SYS Schema Simplified Views on Performance Schema & Information Schema

• Driven from positive feedback on ps_helper

– Over 80 views, server version aware

• Supporting MySQL 5.5, 5.6, and 5.7

• SYS is similar to:

– Oracle V$ catalog views

– Microsoft SQL DMVs (Dynamic Mgmnt Views)

– IBM DB2 SYSIBM catalog

18

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Replaced custom code

– For spatial calculations

– For spatial analysis

• Provides OGC compliance – With improved performance

• Boost.Geometry contains

– Field and domain experts

– Bustling and robust community

• We’re also Boost.Geometry contributors!

MySQL 5.7: GIS - Integrating Boost.Geometry

19

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL on Windows

• MySQL Installer for Windows

• MySQL Workbench

• MySQL Migration Wizard

– Microsoft SQL Server

– Microsoft Access

• MySQL for Visual Studio

• MySQL for Excel

• MySQL Notifier

• MySQL Connector/.Net

• MySQL Connector/ODBC

20

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Simple and convenient way to install & update MySQL products

• Supports the following distributions

– Oracle, Red Hat, CentOS

– Fedora

– Ubuntu, Debian

• Coming Soon

– SUSE

– Preconfigured Containers

– Improved support for popular DevOps deployment tools

• The latest releases of

– MySQL Database

– MySQL Workbench

– MySQL Connector/ODBC

– MySQL Connector/Python

– MySQL Connector/NET

– MySQL Utilities

MySQL Community Repositories: Yum, APT, NuGET

21

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL Source Code Available on GitHub • Git for MySQL Engineering

– Fast, flexible and great for a distributed team

– Great tooling

– Large and vibrant community

• GitHub for MySQL Community

– Easy and fast code availability to the community and to downstream projects

– Beta repo available today at https://github.com/mysql

– More info at http://mysqlrelease.com

22

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

MySQL Cluster: Active-Active Geo-Replication

• Asynchronous replication between MySQL Clusters

• Active-Active

– Update anywhere

– Conflict detection • Application notified through exception tables

• Can opt to have conflicts resolved automatically

– Auto-conflict-resolution • Conflicting transaction and dependent ones are rolled-back

• No required changes to app schema

23

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

State of The Penguin

Ramesh Srinivasan Senior Director, Open Source GBU, Oracle Corporation

Oracle Confidential – Internal/Restricted/Highly Restricted

Oracle’s Open Source Journey

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Linux Distributions

• Nobody owns Linux

....not Oracle

….not Red Hat

….not SUSE

• Linux receives contributions from a variety of sources for a number of different workloads

• Oracle Linux focuses on features important to enterprise customers

For the record…

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle & Open Source

Oracle is primarily driven by customer demand, and committed to offering choice, flexibility, and lower cost of computing for end users • Oracle’s Commitment to Open Source • Oracle's contributions to Open Source? • What is meant by Oracle's "commitment to Open Source"?

Oracle Confidential – Internal/Restricted/Highly Restricted 26

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

1998 2006 2002 2004 2000

Lin

ux D

ata

cen

ter

Wo

rklo

ad

s

Lin

ux H

isto

ry

at

Ora

cle

2008 2010 2012

1998

First Commercial RDBMS for Linux

2000

First x64 Linux Port

2002

Launch of Unbreakable Linux

Asynch I/O, OCFS v1

2005

On Demand Adopts x64 Linux

OCFS2 Accepted Into Mainline

9,000 Developers Switch to Oracle Supported Linux

2007

Validated Configurations Launched

2008-9

Btrfs, Xen Contributions

42,000 Oracle Linux Servers Deployed at Oracle

2010

Oracle Linux Enhanced with Mainline-based Kernel

Oracle Linux Undergoes 80,000 QA Hours Per Day

Exadata Engineered with Oracle Linux

2011

7,000 Oracle Linux Support Customers

Oracle Buys Ksplice

2012 Support Lifecycle

Extended to 10 Yrs

DTrace GA

2006

Oracle Linux Support Announced

Oracle Joins Linux Foundation as Board Member

Development Systems

Single Use Production

Deployments

General Purpose

ERP/CRM

Data Warehouse

Cloud

Computing Big Data

2014

2014

12,000 customers

OpenStack announced

Oracle and Linux Over 15 Years of Investment

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Why is Linux Important to Oracle

• Because Linux is important to our customers

• Initially all about taking advantage of commodity systems

• Now its about real production application workloads

• Oracle Engineered systems are built using Oracle Linux

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Linux: The Best Linux for the Enterprise

• Features the Unbreakable Enterprise Kernel

• Compatible with Red Hat Enterprise Linux

• Free source code, binaries and patches

• Runs in Oracle’s Engineered Systems

• Oracle’s base Linux development platform

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Linux Powers Oracle Engineered Systems Hardware and Software Engineered to Work Together

Oracle Exadata Database Machine

Virtual Compute Appliance

Oracle Exalogic

Elastic Cloud

Oracle Database Appliance

Oracle Exalytics In-

Memory Machine

Oracle Big Data

Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 31

Oracle Linux - a wining theme

Innovate Collaborate Create

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Linux: Innovate, Collaborate, Create

• Developed and tested to support mission critical workloads

• Featuring Ksplice, DTrace, Docker, Linux Containers, and more

• The Linux development platform standard at Oracle

• Runs Oracle’s most powerful x86 based Engineered Systems

• Integrated with Oracle VM

• Always free to use, free to distribute, and free to update

• Compatible with Red Hat Enterprise Linux

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Oracle Linux and Oracle VM developed together

• Oracle Linux can run as a supported guest on:

– VMware

– Microsoft Hyper-V

– Xen or KVM hypervisors

• Easily distribute Oracle Linux as a guest in virtual templates for simplified deployment

Physical, Virtual or Hybrid

Oracle Linux Engineered for the Cloud

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Free to download

• Free to distribute

• Free to use

• Choose your support level individually per server

• Only buy support for the servers you need

• Free updates (errata) - use the same errata across all systems (production, QA, development)

• Open development – all changes recorded and accessible in the public git repository

Offering Choice, Not Lock-In

Oracle Linux: Freedom to Choose

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

More Than 12,000 Customers…and Growing Rely on Oracle Linux Support

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Major IHVs support Oracle Linux

Rev.9

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Many ISVs Support Oracle Linux

• Acronis

• Aithent

• Alachisoft

• Allgress

• Application Security Inc.

• Arkeia Software

• Autodesk

• Bearing Point

• BitDefender

• Carrier Call

• Centrify Corporation

• Confio Software

• cVidya Networks

• Data Advantage Group

• dynaTrace

• ej-technologies

• Halcyon Software

• Informatica

• Ingram Micro

• Kroll Ontrack

• Kronos

• Lanamark

• LINBIT

• LogMatrix

• McAFee

• MENTIS Software

• MicroFocus

• Microsoft

• MicroStrategy

• PerfCap Corporation

• Qualys Inc.

• Quest Software

• RealNetworks

• SAP

• SIOS

• Storix

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• OEM 12c for Manageability

• Ksplice for Security and Zero Downtime

• Validated Configuration and Pre-Install RPM for Rapid &Tested deployment

The Best Solutions, the Most Choice

Solutions for Managing Oracle Linux

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Server Virtualization

39

Private

Cloud

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Have We Really Transformed IT?

40

Business Applications

Oracle Database

Commodity x86 Servers

VMware, Hyper-V

App Server OpenStack

Management

Console

• Applications & Lifecycle not fully integrated

• Network layer in physical configuration

• Multi management consoles

• Complex combination of multi vendors solution and support

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Virtualization

Foundation for Private Cloud

• At the core of Oracle’s cloud strategy

• Integrated VM lifecycle & cloud management solution with Oracle Enterprise Manager

• Supports both x86 and SPARC

• Certified for Oracle products

• Cloud platform for Oracle & Non-Oracle applications – Supports Linux, Oracle Solaris, Microsoft Windows

41

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Cloud Infrastructure

• Multi OS support

• SPARC & x86 servers

• Flash, disk, tape storage

• Networking fabric

SaaS

PaaS

IaaS

Oracle VM for x86

Oracle Linux Oracle Solaris

Oracle VM for SPARC (LDom) Solaris Zones

Virtual Compute Appliance, Sun Servers, SuperCluster, Exalogic Elastic Cloud

Storage

Networking & Data Center Fabric

Enterprise Manager

Private

Cloud

42

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle VM Templates Simplify Application Deployment

DM-0

Pre-Built by Oracle Download Deploy

43

Oracle & Non-Oracle

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle VM in Challenger Position in Magic Quadrant

Get the full report Source: Gartner 2014 “Magic Quadrant for x86 Server Virtualization Infrastructure” report

(July 2014)

• Oracle is unique vendor to test and tune the hypervisor for optimal application performance • Oracle goes beyond the hypervisor to provide full integration across software portfolio (hardware, database & applications) • Full stack management and IaaS using Oracle Enterprise Manager 12c • Ready-to-use VM Templates for Linux, DB, RAC and Applications

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Feedback form

• Please fill the feedback form (Its there in your kit!)

• Give us back the feedback form – we are waiting for you near the Exit / Entrance gate!

• Meet our experts – They will be happy to talk to you!

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Appendix

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle VM Response Time vs. Bare Metal & other VM Side by Side Average Response Times

In Bench load test: On average the Virtual setup outperformed the Physical setup.

“Why Use OVM For Oracle Databases” By: Francisco Munoz Alvarez , Revera – Oracle Professional Services Manager

47

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

OpenStack With Oracle Linux and Oracle VM

48

Interoperability

• Help make OpenStack a first class solution for enterprise customers

• Work with the OpenStack community to support enterprise applications in an OpenStack cloud

• Provide choice for managing hypervisors with Oracle Linux and Oracle VM

• Ensure Oracle Linux and Oracle VM can work with any OpenStack solution customers choose

• Work with third party vendors to offer joint solutions

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Open Universities – Customer Benchmarks Oracle Database Virtualized with Oracle VM

0%

5%

10%

15%

20%

25%

Cu

sto

me

r R

eg

Bro

wse

Pro

du

cts

Ord

er

Pro

du

cts

Pro

cess

Ord

ers

Bro

wse

Ord

ers

Sale

s R

ep

Qu

ery

Virtual DB compared to Physical DB Load test. SwingBench - 50 user test

Virtual Speed

Physical Speed

In Bench load test: The Virtual setup outperformed the Physical setup in every test.

-25%-20%-15%-10%

-5%0%5%

10%15%20%

Cu

sto

me

r R

egis

trat

ion

Bro

wse

Pro

du

cts

Ord

er

Pro

du

cts

Pro

cess

Ord

ers

Bro

wse

Ord

ers

Sale

s R

ep

Qu

ery

Virtual DB compared to Physical DB Load test. SwingBench - 100 user test

Virtual Speed

Physical Speed

In Bench load test: On average the Virtual setup outperformed the Physical setup.

“Oracle VM on Oracle Database 11g Real Application Clusters (RAC) Physical versus Virtual Database” by Anthony Russo, Director ICT, Open Universities, Australia

49