VMware vFabric Data Director

© 2010 VMware Inc. All rights reserved

Confidential

VMware vFabric Data DirectorPowering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric Postgres

2

Traditional IT

Application Team

System Admin

Storage Admin

Network AdminDBA

Days - weeks to provision a development environment

3

Database Infrastructure Challenges

Postgre

Production

Postgre

Development

Postgre

Test

Postgre

UAT Shadow IT

Enterprise DBA

Security Routine TasksCompliance

http://www.google.com/imgres?q=mY+SQL&num=10&hl=en&biw=1024&bih=581&tbm=isch&imgrefurl=http://w3resource.com/mysql/mysql-tutorials.php&tbnid=iKD7EGeAVvZDxM&docid=E0mkpAQVLLqeQM&ved=0CEsQhRYoAA&ei=65sYUL6NEKeRiAL_t4DoAw&dur=2150





4

vFabric Data Director Powers Database-as-a-Service for your Cloud

Enables database-aware virtualization on VMware vSphere and provides database-as-a-service for heterogeneous databases and Hadoop

Reduce capex through database-aware

virtualization

Save cost through database and Hadoop

virtualization

Increase IT agility

Automate database and Hadoop lifecycle

management

Accelerate analytics and application

development

Through self-service and automation

5

vFabric Data Director Platform Architecture

Cloud Infrastructure Platform

Enterprise Services

vCloud Director

Cloud Foundry

EMC Chorus

EMCData Domain

Cloud Infrastructure Platform

.

.

.

Integration Gatew

ay (AP

I)vFabric Data Director

Provisioning Backup/Restore Clone One click

HA

ResourceMgmt

Security Mgmt

Template Mgmt

Monitor

DBA App Dev

IT Admin

LifecycleServices

InfrastructureServices

DBA

DatabaseCatalog

PatchMgmt

vPostgres

DatabaseIngestion

…

Application Director

…

6

Oracle 10gR2, 11gR2

SQL Server 2008R2, SQL Server 2012

Postgres 9.1.6

Hadoop 1.0 based distributions:• Apache Hadoop 1.0.x

• Cloudera CDH3

• Greenplum HD 1.1 and 1.2

• Hortonworks Data Platform 1.0

• MapR - Soon

Supported Data Engines

7

SQL Server Support - New

Confidential

Data Director now supports SQL Server database• Supports provisioning of SQL Server 2008 R2 and SQL Server 2012 databases

Key features include

• Create SQL Server templates easily with built-in configurations

• Size VMs and configure database settings through a single UI

• Join VMs to domain as part of provisioning

• Compatibility with existing tools

8

Provision Any Database from Same Web Portal

9

Provision and Manage Any Hadoop Distribution with One Click

10

Hadoop Support Powered by Serengeti

Open source project launched in June, 2012 To learn more - projectserengeti.org

Serengeti

http://projectserengeti.org/

11

Why Virtualize Hadoop?

Shrink and expand cluster on demand

Independent scaling of Compute and data

Strong multi-tenancy

Elasticity & Multi-tenancy

High availability for entire Hadoop stack

One click to setup

Battle-tested

High Availability

Rapid deployment

One stop command center

Easy to configure/reconfigure

Operational Simplicity

12 Confidential

Data Director Benefits

Don’t Let Your DBAs Hit the 40 DB Ceiling• Automate provisioning and management• Enforce policies and best practices automatically

Double Your DBAs

Reduce Costs by > 50%• Consolidate servers by 10–15X• Save on Hardware, Software, Power and Cooling

Stretch Your Servers

Use the Right Database for the Job• Use the most cost-effective licensing for your application• Leverage low-cost HA and clustering with vSphere

Liberate Your Licenses

Keep Your Data Secure With Automation• Make security a holistic part of the database lifecycle.• Help admins keep systems patched and up-to-date.

Secure Your Stuff

13 Confidential

vFabric Data Director

Data Director will help you:1. Stretch Your Servers2. Liberate Your Licenses3. Double Your DBA Productivity4. Secure Your Stuff

14 Confidential



15 Confidential

We Looked at 700,000 Servers

The average PRODUCTION Oracle Database Instance uses:•4% of CPU•2MB/second of Network•1200 IOPS

The average SQL Server database only does slightly better (about 5% CPU).

This does not strain a modern server in any way.

16 Confidential

How Can We Do Better?

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

5%

75%

0.95

25%

Used Unused Overhead

Physical Server

Virtual Server

You can consolidate 10-15 databases on a single server without affecting overall performance.

17 Confidential



18 Confidential

How Can We Use fewer Licenses?

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

5%

75%

0.95

25%

Used Unused Overhead

Physical Server

Virtual Server

Oracle and SQL Server are typically licensed by core. If you consolidate by a factor of 10-15x you will need far fewer licenses.

19 Confidential

TEMP SWAP LOG DATA

T

TEMP SWAP LOG DATA

How Can I Virtualize a Physical Database

Linux

DB Management Server

Data Director Application Oracle 11.1 Template

Linux

Oracle 11.1

Monitoring Agents

Shell Virtual Machines

Empty DBVM

Linux

Oracle 11.1

Monitoring Agents

Clone of Physical DBPhysical DB Server

20 Confidential

A Single License Management Pane

Don’t get a million dollar surprise because you couldn’t track your database licenses.

21 Confidential

A Real World Example

EMC is one of the largest Oracle shops in the world and it runs on VMware.

EMC was able to:•Consolidate their servers by a factor of 13:1•Reduce RAC to Single Instance databases•Convert Enterprise to Standard Edition databases•Add HA to single instance databases.•Realize millions of dollars in cost savings

See Whitepaper “EMC IT’s Virtual Oracle Deployment Framework”, November 2011

22 Confidential



23 Confidential

How Many Databases Can a DBA Manage?

40

24 Confidential

After

Self Service

Policy

Foundation

Developers/Administrators

Database Team

IT

Before

Developers

DBAs IT

Tickets

Data Director Accelerates Productivity

25 Confidential

Data Director Architecture

vCenter

ESXi

Linux


Data Director Application

T

TEMP SWAP LOG DATA


Operating System

Database

Monitoring AgentsOperating System

Database

Monitoring Agents

Database Template Library

Operating System

Database

Monitoring Agents

26 Confidential

T

TEMP SWAP LOG DATA

Create Your Own Databases, Virtually

Linux


Data Director Application

TEMP SWAP LOG DATA

Shell Virtual MachinesDatabase Template Library

Operating System

Database

Monitoring Agents

Operating System

Database

Monitoring Agents

New Database Based Linked to Parent Template

27 Confidential

A Data Director Database

Operating System

Database

Monitoring Agents

Stores data locally (inside the VM)

Uses binaries from linked clone disks on the parent template

Has a unique ID and IP address

Runs software and database processes locally (in the VM)

28 Confidential

Linux

Oracle 11.1

Monitoring Agents

DB Based on Oracle 11.1 TemplateDB Based on Oracle 11.2 Template

Upgrading or Patching a Database

Linux



Linux

Oracle 11.1

Monitoring Agents

Oracle 11.2 Template

Linux

Oracle 11.2

Monitoring Agents

Linux

Oracle 11.2

Monitoring Agents

29 Confidential

TEMP SWAP LOG DATA

T

TEMP SWAP LOG DATA

DB Based on Oracle 11.1 Template

Cloning a Database

Linux



Linux

Oracle 11.1

Monitoring Agents


Linux

Oracle 11.1

Monitoring Agents

Empty DBVM

Linux

Oracle 11.1

Monitoring Agents

Exact Clone of DB

30 Confidential

Complex Operations Made Simple

Creating or cloning a database takes about 5 minutes.

31 Confidential

Administrators Are Still In Control

Standards and Best Practices are automatically enforced.

32 Confidential

Users Still Get What They Need

Users can still configure some options and parameters, guided by policy and best practices.

33 Confidential

Why You Should Care

Using Data Director, complex database operations are automated and simplified.1. Database Creation2. Database Cloning3. Data Movement4. Backup and Recovery5. Load Balancing6. Database Retirement Developers and Analysts can

create their own databases without an administrator.

34 Confidential

How Many Databases Can a DBA Manage with Data Director?

80?We break the direct relationship between DBAs and the number of databases under management.

35 Confidential



36 Confidential

Database Security is Baked In

Concepts like database expiration are built into the provisioning process.

37 Confidential

Network Security is Baked In

Network Security is built into the provisioning process as well.

38 Confidential

Centralized DBaaS monitoring

All service level actions are closely monitored, logged, and tracked.

39 Confidential

A Real World Use Case

A Production Finance Database has data quality problems and an analyst needs to examine some highly sensitive data.

This is a very difficult challenge for:1. Security2. Compliance3. Database Operations4. System Administration

40 Confidential

TEMP SWAP LOG DATA

T

TEMP SWAP LOG DATA

DB Based on Oracle 11.1 Template

Linked Clones of a Database

Linux



Linux

Oracle 11.1

Monitoring Agents


Linux

Oracle 11.1

Monitoring Agents

Empty DBVM

Linux

Oracle 11.1

Monitoring Agents

Linked Clone of DB

∆The linked clone is a separate DB that shares the original storage and keeps a local copy of disk block changes.

41 Confidential

A Real World Use Case

Data Director can:•Create a linked clone of the original database that has an identical O/S and DB configuration.

•Ensure changes do not impact original DB.•Automatically discover and mask sensitive data.•Expire and delete the linked clone after 7 days.•Automatically remove any backups or snapshots.•Quickly create and apply a patch any databases with a similar configuration. Security

Compliance Database Operations System Administration

42

Summary

vFabric Data Director enables database-aware virtualization on VMware vSphere and provides database-as-a-service for heterogeneous databases and Hadoop

Reduce cost through database-aware virtualizationIncrease IT agilityAccelerate analytics and application development

Documents

VMware vFabric Data Director