Open Virtualization for Open Clouds

Feb 16, 2011

Open Virtualization for Open Clouds

Introductions

Eric Yeoh Project Consultant Abyres

Syamsul Anuar Abd Nasir Senior Technical Consultant Abyres

Gordon Haff Cloud Evangelist Red Hat Inc.

Paul Weiss Senior Cloud Engineer Eucalyptus Inc.

2/15/2012 Confidential - Open Virtualization Alliance 3

WHERE KVM FITS IN AN OPEN CLOUD

Gordon Haff CLOUD EVANGELIST 15 FEBRUARY 2012

What a cloud provides beyond virtualization

4

Disks Servers Network

Bare Metal • Full access • No abstraction

Virtualization • Hardware abstraction • Maps virtual to physical resources

VM VM VM VM

Cloud • Resource abstraction • Maps cloud to virtual resources

Cloud provides an abstraction

layer to manage scale and

complexity

• Self service

• Abstracted, elastic resources

• Location-independent storage

& services

• Users, Groups

• Accounting

• APIs, Drivers, Tools

• Federation

VIRTUALIZATION: KEY CLOUD ABSTRACTION LAYER

Data

Applications

Middleware

Op System

Virtualization

Storage

Hardware

Network

Conventional

Data

Applications

Middleware

Storage

IaaS

Network

Virtualization

Storage Hardware

Op System

In h

ou

se

ma

na

ge

d a

nd

co

ntr

olle

d

Custo

me

r C

on

trolle

d

Deliv

ere

d S

erv

ice

OPEN CLOUD OPEN VIRTUALIZATION

Traditional

Data Center Virtual Data

Center Private Cloud

PORTABLE

APPLICATIONS

PORTABLE

PROGRAMMING

MODELS

PORTABLE

SERVICES

PORTABLE

COMPUTING

Application portability across diverse clouds

“Our research shows that

80 percent of enterprises cite

the lack of interoperability

standards as a challenge in

adopting cloud computing

services. Red hat is on the

right track with cloud by

accelerating interoperability

and portability

to prevent cloud lock-in.”

GARY CHEN RESEARCH MANAGER

ENTERPRISE VIRTUALIZATION

SOFTWARE AT IDC

Certified Public Cloud

© 2012 Eucalyptus Systems, Inc.

Building Highly Available Clouds with Eucalyptus and KVM Paul Weiss

Senior Cloud Engineer

8


Eucalyptus Overview

• Most widely-deployed software platform for on-premise (private) Infrastructure as a Service (IaaS) clouds

• 25,000+ cloud starts to date and growing

• AWS-compatible, enterprise-deployed

• Deep cloud partner and AWS ecosystem

• Open source developed

• Gartner-recognized as major IaaS provider


Who Uses Eucalyptus?


Why Eucalyptus and KVM

• Eucalyptus has the most experience with KVM in the cloud

• KVM support for over 3 years

• Officially supported in Ubuntu 9.04 (April 2009)

• Eucalyptus 3 fully supports Red Hat 6.x and KVM

• KVM offers lower TCO

• High performance and scalability

• KVM has excellent hardware support

11


Infrastructure-as-a-Service


Eucalyptus IaaS: Compute

13

Features:

Standardized on-demand compute

devices

Elastic pool of compute entities with fast

provisioning

Automatic virtual Instance Configurations

CPU, Memory, Network and storage

Benefits:

Drastically reduced cycle time

Efficient use of compute resources

Disposable compute entities

Self-serviceability


Eucalyptus IaaS Deployment (non HA)

14

•Cloud Controller

• Cloud level - Virtual Resource System

• AWS EC2 Compatible

•Walrus Storage

• Persistent data store

• Bucket-based, like S3

•Cluster Controller

• Node level - Virtual Resource System

• Manage Virtual Network

•Storage Controller

• Block accessed network storage

• Like EBS

•Node Controller

• VM management

• Instance management

•VMware Broker

• ESX, ESXi management

• vCenter server compatible

Cloud Controller

Node Controller

Cluster Controller

Walrus Storage

SAN

VM

Storage Controller

Resource Admin

VM

VM

VM

Node Controller

Cluster Controller

SAN

VM

Storage Controller

VM

VM

VM


Eucalypus IaaS Deployment (HA)

15

• Prevent single point of failure from disrupting Eucalyptus service

• Detection of service failure(s) with cloud administrator notification

• Automated Eucalyptus service component failure recovery

• No changes required to support applications


Cloud Controller HA

Walrus Storage HA

Cluster Controller HA

Node Controllers

V

M

V

M V

M

V

M V

M

V

M

V

M

V

M V

M

V

M V

M

V

M

NAS

SAN Storage Arrays

NAS

SAN Storage Arrays

Storage Controller HA

Storage Controller HA

Cluster Controller HA Node Controllers

High Availability IaaS Flow


Use Cases

Scalable

Web/Content

Services

Big Data

High

Performance

Computing

Development

and Test


Eucalyptus Amazon AWS Compatibility

AWS

EC2

AWS

S3

AWS

EBS

AWS

IAM


Summary – Eucalyptus & KVM

• Provides a highly scalable on-premise IaaS cloud platform

• High Availability

• Excellent ROI

• High performance and scalability

• Secure

• Amazon AWS API compatible

19


Thank you.

[email protected]

LESSONS LEARNT FROM DEPLOYING KVM IN

MALAYSIA GOVERNMENT AGENCIES

Eric H.A. Yeoh & Syamsul Anuar ABYRES GROUP OF COMPANIES

AGENDA

• Technology outlook in Malaysian government • Penetration of virtualization

• Why our customers choose KVM

• Case Studies

• Lessons Learnt

INTRODUCTION

• ABYRES SDN BHD is a Malaysian enterprise FOSS solutions provider. o virtualization/cloud computing o network security

o backup management o DBMS

o messaging and collaboration • Led by experienced and enthusiastic FOSS

people, Abyres is well known in the local industry and has a good rapport with the local FOSS communities.

TECH OUTLOOK IN MALAYSIA GOVT

• Growing usage of IT in the public and private sectors

due to positive government policies and initiatives - e.g.

MSC Malaysia, National Broadband Programme etc

• Malaysian Public Sector OSS Masterplan launched

2004 to encourage and guide public sector on open

source - http://www.oscc.org.my/content/view/103/96/

• Awareness of KVM Virtualisation technology is still low

• Looking for ways to easily manage server and

application spiral in the data centre

PENETRATION OF VIRTUALISATION

• Uptake of cloud computing is still in infancy due to regulation, skill sets and nationwide high speed Internet availability confined to urban areas.

• Virtualisation is growing steadily, both in private and public sectors

• Looking for cost effective solution that is easy to manage, provide good performance and ability to run multiplatform workloads (mostly Linux and Windows).

oFOSS is gaining traction and that is a plus!

WHY CUSTOMERS CHOOSE KVM • Cost

• Most customers in Malaysia run Windows & Linux together in the datacenter; support for running Windows as a guest (with WHQL certified drivers) is a good value.

• Control and Consolidation • Customers want more control and visibility

• High Availability • Ability to run applications & services in

Virtualization HA mode

• Reputation • Growing awareness of KVM at open source conferences every

year in Malaysia - MYGOSSCON, MOSC, Fedora Events, Geekcamp, Barcamp etc

CASE STUDIES

KVM Virtualization Implementation in Malaysia

STATE GOVERNMENT MELAKA

Industry : Government Business Challenge: Datacenter space constrain, frequent hardware failures, server management complexity, planning to have a DRC site

Software : Red Hat Enterprise Linux 6 and Red Hat Enterprise Virtualization (RHEV) 2.2

Hardware : Intel Xeon Processor on 6 Dell Blades modules

Benefits : Lower TCO, Lower utilities bill, increased scalability and performance and High Availability clusters for LAMP and Windows App Stack

MIGRATION TO KVM (RHEV)

• Migration of 30+ physical servers to 6 Dell Blade Modules and FC SAN

• Applications include IIS and .NET, LAMP, MYxchange collaboration, Microsoft Exchange, Oracle, MS-SQL etc

• Considering 3 vendors – Red Hat, Vendor V and Vendor M

• Choose RHEV due to meeting all customer requirements at the best cost possible

AFTER VIRTUALIZATION

• Hardware utilization on Dell Blades around 20%

• Highly Available LAMP – Centralize LAMP clusters with GlusterFS for PHP application and MySQL Multi-Master Replication on RHEL 6 & RHEV

• Highly Available Windows – Windows Failover Cluster for IIS and SQL Server on RHEV platform

• Highly Available Infrastructure – Servers uptime increase with less hardware to manage

• User-friendly interface – Using ISPconfig for managing web application to web developers

DEPT OF WILDLIFE AND NATURAL PARK MALAYSIA

Industry: Government Business Challenge: Microsoft Exchange Email Service frequently unavailable due to multiple reasons

Software : Red Hat Enterprise Virtualization (RHEV) 3.0 B3

Hardware: Intel Xeon Processor on 3 IBM x3650 M3

Benefits: Highly Available (HA) Microsoft Exchange Email Server with VM disk pass through capabilities that mounts the mailbox directly from Windows Server VM. Also maintain current Microsoft Windows and Exchange Server license.

NATIONAL BLOOD BANK

Industry : Government Business Challenge : Data Center space constrain and needs HA for critical Blood Bank application

Software : Red Hat Enterprise Virtualization (RHEV) 2.2 Hardware : Intel Xeon Processor on 3 IBM x3650 Benefits : Highly Available (HA) Blood Bank application based on Microsoft Windows and ASP running on virtual environment. Running multiple other applications (back office, portal, Intranet etc) on virtual environment ensure less server, less utilization of space and carbon footprint.

WHAT WE HAVE LEARNT about common customer concerns

• Agencies are generally conservative

o A long sales cycle

o Require tons of documentations, SLAs, assurances

• Generally do not want to be the "first" o Do not want to be case study for wrong reasons

• Practically everyone will draw blank when mention KVM (or thinking about keyboard, video & mouse)

• Why pay for FOSS?

• FOSS is meant for tinkerers and not for serious work e.g. open source means instability, insecure etc

WHAT WE HAVE LEARNT to mitigate

• Training sometimes needs to be bundled and tailored to

their needs and skills.

• Hand holding is essential - charge too high and you will

end up being the 1st and last

• Getting a well-known principal involved helps

• Will it affect my KPI? FOSS or not doesn't matter

• Education is key!

• Above all - be patient and stick to your guns!

Thank you

contact us at anuar (at) abyres.net and eric (at) abyres.net

Open Door to Open Virtualization

• Submit abstracts to [email protected]

• Follow us on Twitter @OVAorg and on Facebook

• Attend future webinars

2/15/2012 Open Virtualization Alliance 36

mailto:[email protected]