Virtualization for Data Centers of Today Tomorrow

7/31/2019 Virtualization for Data Centers of Today Tomorrow

1/30

2008 IBM CorporationAugust 2008

Virtualization for Data Centers of Today & Tomorrow

Jim Rymarczyk

IBM Fellow, Chief Virtualization Technologist

[email protected]


2/30

2008 IBM CorporationVirtualization for Data Centers of Today & Tomorrow - August 2008

IT Complexity the need for IT transformation


3/30


Accelerated pace of

technology innovations

Operational issues have

IT at a breaking point

Multiple forces are driving a transformation of the data center

Costs & Service Delivery

Rising costs of systems & networking operationsExplosion in volume of data and information

Difficulty in deploying new applications & services

Business Resilience & Security

Growing systems & applications availability needs

Security of your assets & your clients informationLandslide of compliance requirements

Energy Requirements

Rising energy costs & rising energy demand

Power & thermal issues inhibit operations

Environmental compliance & governance mandates

Technology Advances

Service-oriented architectureEnd-to-end service mgmt

Comprehensive virtualization

Converged networks

Flash storage

IT appliances

Ensembles & mgmt. integrationMany cores & threads per chip

Low-cost high-BW fiber optics

Petaflop supercomputers

Cloud computing services

Real-time data streams

Enterprise

Data Center

New

Drivers of Data Center Transformation


4/30


The IT Infrastructure Complexity and Cost Problem

Enterprises report that IT operational overhead = 70% of their IT budgetand growing . . . leaving precious few resources for new initiatives.

Forrester, 2007

Sea of heterogeneous servers, storage, networks and their virtualization

Business processes as services

Businesses spend a large fraction of their IT budgets on data center resourcemanagement rather than on valuable applications and business processes

Topologies of federated services must be mapped onto

large numbers of diverse physical and virtual resources


5/30


6/30


Basic Forces Will Drive Increases In IT Complexity

The numbers of systems deployed will continue to grow rapidly, drivenlargely by:

New applications (Web-based apps, surveillance, operational asset mgmt., etc.)

Improving hardware price/performance

The diversity of IT products will increase as competing suppliers continue to introducenew applications, systems, and management software products

Todays innovations become tomorrows legacy

The coupling of IT components is extensive and increasing, driven by application

tiering, advances in high-performance standard networks,

The virtualization of resources will affect existing IT processes and can leadto virtual server sprawl

Introducing virtualization can have significant hidden costs, and requires considerable

skills, planning, and discipline


7/30


Virtualization its current and expanding IT role


8/30


Sharing

Virtual

Resources

Resources

Examples: LPARs, VMs, virtual disks, VLANs

Benefits: Resource utilization, workloadmanageability, flexibility, isolation

Aggregation

Virtual

Resources

Resources

Examples: Virtual disks, IP routing to clones

Benefits: Management simplification,investment protection, scalability

Emulation

VirtualResources

Resources

Examples: Arch. emulators, iSCSI, virtual tape

Benefits: Compatibility, software investmentprotection, interoperability, flexibility

Insulation

Add, Replace,or Change

VirtualResources

Resources

Examples: Spare CPU subst., CUoD, SAN-VC

Benefits: Continuous availability, flexibility,software investment protection

Virtualization Functions and Benefits

ResourceType Y

ResourceType X


9/30


Server Virtualization Hierarchy

zSeries PR/SM and z/VM

Power Hypervisor

HP vPars, Integrity VM

Sun Logical Domains

VMware, MS Hyper-V,Xen, KVM, Virtual Iron,

Hypervisors

HW partitioning

Virtual I/O Servers

Self-virtualizing I/Oadapters

In-memory VLANs

Virtual servers(virtual machines / LPARs)

Virtual I/O

Virtual networks

Virtual devices (CPUs,memory, I/O adapters, )

z/OS Address Spaces

AIX 6.1 WPARs

Solaris Containers

HP-UX Syst. Res. Part.

MS SoftGrid

OS creates virtual OSenvironment per app.

Each container has itsown name space, files,root,

Virtual operating systems(application containers)

WebSphere VE

Microsoft and Sun JVMs

BEA Liquid VM

Middleware providesJVM, J2EE, or CLRapplication containers

Multiple middlewareinstances act as one

Virtual runtimes(application containers)

ExamplesImplementation

MethodsVirtual Resources

Hardware

Applications

Middleware

OperatingSystems

System Stack

There are three levels in the system stack at which virtualization is often done:(1) hardware virtualization, (2) OS virtualization, and (3) middleware virtualization

Concurrent use of virtualization at these levels requires coordinated management


10/30


Virtualized IT Envisioned Benefits

Virtualization technologies with emerging management software will significantlyimprove the efficiency, resiliency, responsiveness, and greenness of IT data centers.

End Users

Web Servers

App ServersApp Servers

App/DBServers

App/DB Server

App Servers

IT Resources for

a Medium Business

IT Without Virtualization

Rigid configurations

Fixed resources per server

Low server utilization

Wasted energy and floor space

HW changes impact SW assets

Servers managed individually

Physical Environment

Virtual Environment

VirtualStorage

Virtual

Application

Server

Virtual

Application

Server

Virtual

ApplicationServer

VirtualNetworks

VirtualServers

Virtual resources are easier to deploy, grow, move,

Virtual resources, configurations, and workloads aredecoupled and insulated from physical environment

SMP ServersNetwork

HardwareStorage Serversand Storage

Blades

VirtualizationDecouples Virtual and Physical Environments

VirtualClients

Future Virtualized IT

Physical resource changes can be made withoutimpact to running IT workloads

Improved HW utilization and energy efficiency


11/30


A new IT era is dawning in which virtualization will provide major new IT benefits

The industry is investing to make this happen and it will unfold over the next 3-5 years The resulting high value to customers will render non-virtualized IT obsolescent

Expanding IT Role Of Virtualization

Future: Virtual IT Configurations

VirtualWeb

Server

Virtual

WebServer

WebServer

Virtual

Database

Server

DatabaseServer

AppServer

Virtual

App

Server

AppServer

Virtual resources are fullyself-describing objects

Adjustable dynamically Movable while active

Durable over HW generations

Storable and versionablein shared libraries

Distributable as appliances

Pools of physical systems aremanageable as one system

VirtualSystems Emerging Benefits:

Better SW investment protection

Simplified HA\DR/PD solutions

Improved resource optimization

Ready-to-run packaged software

VirtualDisksVirtual

LANs

Emerging: Multi-System Virtualization Mgmt. SoftwareProvides virtual resource mgmt.

and virtualization-based solutionsspanning physical resource pools

SMP ServersNetwork

HardwareStorage Servers

and StorageBlades

VV V V

Maturing: Physical Systems with Local Virtualization

Todays Benefits:

Better hardware utilization

Improved IT agility

Lower power consumption

Virtual Storage Virtual NetworksVirtual ServersVirtual Servers


12/30


Stages of IT Infrastructure Transformation

Integration and Simplification

Ensemble

Ensemble

Ensemble

New Enterprise Data Center

ServiceMgmt.

SOA

CloudComputing

Green IT

TVDC

Resilience

Reduced scale-out complexity

Integrated autonomic mgmt

Dynamic energy optimization

Business resilience foundation

Virtualization has major benefitsbut introduces more complexity

Strategic Imperatives Evolve data centers from ad-hoc to well-architected

Better manage the IT complexity end-to-end service mgmt

Reduce the IT complexity to be managed via ensembles

Continuing Advances

Abstraction and Pooling

Multi-System Virtualization

Virtual Resource Objects(Servers, Storage, Networks)

Storage

Servers

Networks

V

V

VResource

Pools

Better SW investment protection

Simplified HA solutions Improved resource optimization

Ready-to-run packaged software

Continuing Advances (I/O, network, resilience, performance, )

Physical Consolidation

WindowsServer

Linux Server

Mainframe orUnix Server

Networks

Storage

V

VV

V

V

Better hardware utilization

Improved IT agility

Lower power consumption

Local Virtualization


13/30


Applying Simplification First Principles to IT

Virtualize as many resources as possible

Allows the elimination of dependencies between virtual and physical resources

Modularize the data center decouple resources and management roles by type

Decouple servers, storage, and network controllers

Decouple server management from storage management

Decouple data management from physical storage management

Provide compatibility across families and generations of hardware resources

Enable virtual resources to function unchanged despite changes to underlying hardware

Group physical resources into pools of like typesProvide virtual resource mobility within these pools

Make groups of resources look like single resources to users and resource managers

Hide their internal design complexities and their parallelism

Provide a single system management image per pool

Apply the first principles to the management software itself

Decouple management of virtual resources from management of physical resources

Use hierarchy of management software


14/30


Service management software spans the diversity of heterogeneous physical and virtualresources, providing unified cross-platform management in support of SOA

Services registry, service life cycle mgmt., image libraries, multi-tier composition, provisioning,autonomic optimization, network services, security services,

2

Sea of Heterogeneous Servers, Storage, Networks and Their Virtualization

Key Complementary Methods for IT Simplification

Business Processes as Services

Service oriented architecture technologies frame business processes as services,facilitating deployment, composition, reuse, modular change, agility, efficiency,

1

Ensembles and scalable servers replace multitudes of individual servers

An ensemble is a pool of like systems that is manageable as a single system It integrates compatible networked systems, virtualization, and management functions It scales from few to many servers, while having management complexity and cost like that of

a single system essentially independent of the ensemble size

3

Sea of Heterogeneous Servers, Storage, Networks and Their Virtualization

Ensemble

Ensemble

EE


15/30


Ensembles a new integrated systems approach


16/30


Ensemble Components

An Ensemble generally consists of the following components:

A pool of compatible system nodes (e.g., N physical servers; need not be homogeneous)

Virtual resource mobility within an ensemble and with compatible ensembles The networks which interconnect the ensemble nodes (may be local / optimized)

Resource virtualizers (hypervisors, I/O virtualizers, storage virtualizers, )

An ensemble manager appliance that provides platform management for the ensemble virtual andphysical resources

Tools for planning, ensemble creation, P2V migration, image mgmt. & composition,

Ensemble-local automated optimization software of performance, availability, energy usage,security, with intelligent defaults

Multi-system services (locking, caching, message queuing, ) may be integrated with someensembles

OS OS OS

Hypervisor

Server

OS OS OS

Hypervisor

Server

WorkloadMobility

Server Ensemble Example

Ensemble

Manager

Ensemble definition:

a pool of like systems

that is manageable as

a single system


17/30


Built-in optimizations; intelligent defaultsAdd-on software, custom scripts, ManagementAutomation

Standard off the shelf assembliesDo it yourself; few assemblies are alikeCreate, Test,and Maintain

N virtual servers; one physical ensembleN virtual servers; M physical servers# of Thingsto Manage

Hierarchical; pool-level modularityMonolithic; spans d. c. heterogeneityData CenterMgmt. Arch.

Menus of selectable standard behaviorsMany individual knobs and variablesManagement

Interfaces

Single console; in-context functionalitySeparate consoles for physical & virtual# of

Consoles

The Benefits of Server Ensembles

Ensembles will significantly reduce IT resource management complexity and cost,

and improve IT functionality, in consumable data center increments

Individual Servers Server Ensemble

OS OS OS

Hypervisor

Server

OS OS OS

Hypervisor

Server

WorkloadMobility

OS OS OS

Hypervisor

Server

OS OS OS

Hypervisor

ServerEnsembleManager


18/30


Cloud Computing the next phase of Internet-based sharing


19/30


What Is Cloud Computing?

Cloud computing is an emerging style of computing in which applicationsand data are provided as services to users over the Web.

The services provided can be available globally, always on, low in cost,on demand, massively scalable, pay as you grow,

Consumers of the services need only care about what the service doesfor them, not how it is implemented

Service Consumers

ComponentLibrary

CloudAdministrator

DatacenterInfrastructure

Monitor & Manage

Resources

Component Vendors /Software Publishers

Publish & Update

Components

Access

Services

IT CloudExamples: Amazon Elastic Compute Cloud EC2

IBM Research Compute Cloud RC2


20/30


Evolution of Sharing on the Internet

TheGrid

Networks

Multiple regional networks linking computers

Initially at universities and national labs

Inter-Networking and the Internet

Inter-Networking of regional networks with TCP/IP

Began to replace regional alternativesWorldwide adoption

remote resources and collaboration

Mainly used for highly scalable HPC jobs

The World Wide Web

HTML page format, HTTP protocol, and

Mosaic browser for document exchangeInitially in universities; worldwide adoption

Network Sharing

Information Sharing

Grid Computing

Standards and software for sharing of

Resource Sharing

Networking

Cloud Computing

Everything as a service over the Web:

SaaS, utility computing, IT services,

Ubiquitous and always available

Services Sharing


21/30


Cloud Computing Examples

Amazon EC2, S3

Xen / SLES based; 3 basic virtual machine sizes; various applications andapplication build tools

GoogleProprietary; virtualization in OS image

IBM / Google / Hadoop Cloud

Google Map/Reduce application on different infrastructure

IBM Research Compute Cloud (RC2)

Self-service, Web-based cloud for computer science research

Includes System p and System x resources

University of North Carolina, Virtual Compute Lab

Xen / Linux based; used for teaching and computer science research


22/30


The IBM HiPODS Team Building Clouds Today


23/30


Research Computing Cloud RC2 - Overview

A living lab to advance researchstrategies

Provides self service on demanddelivery solution for research

computing resources

Integrates existing assets andproducts using SOA

Leverages Tivoli products

Zero touch support for the full lifecycle of service delivery

Order creation

Approval process

E-mail notification

Automated provisioning

Monitoring

RC2

Virtualized Infrastructure

Business Process Workflow Mgmt

Business Process Workflow Application

SelfService Portal

Provisioning

&

Orchestration

Monitoring

Metering

&

Rating

Capacity

Mgmt


24/30


Summary

S


25/30


Summary

IT data center complexity and costs are continuing to increase and havealready reached a crisis level

A breakthrough in data center architecture and management is needed

Virtualization will become pervasive and play a vital role in enabling the

required data center transformations

Today it improves hardware utilization, energy efficiency, and agilitybut it impacts most IT processes and introduces new complexities / costs

Going forward, virtualization will be used to reduce management costs,

modularize data center architecture, and facilitate ongoing improvement

Integration will be key to achieving IT simplification

Server, storage, and network ensembles will be used as pre-built scalablemodular data center building blocks

Cloud Computing will become widely used for IT services delivery globallyacross the Web and locally within enterprise data centers

It will yield a range of attractive Web-based services platforms

IBM Vi i Th N E t i D t C t


26/30


IBMs Vision: The New Enterprise Data Center

New economics:

Virtualization with optimized systems and networks to break the lockbetween IT resources and business services

Rapid service delivery:

Service management enables visibility, control and automation

to deliver quality service at any scale

Aligned with business goals:

Real-time integration of transactions, information and analytics and delivery of IT as a service

An evolutionary new modelfor efficient IT delivery

N E t i D t C t St f Ad ti


27/30


Green

Business

Resiliency

/ Security

ServiceManagement

New Enterprise Data Center Stages of Adoption

Highly virtualizedresource pools(ensembles)

Integrated IT servicemanagement

Green by design

Virtualization ofIT service

Business-drivenservice management

Service-orienteddelivery of IT

Physical consolidationand optimization

Virtualization ofindividual systems

Systems, network andenergy management


28/30


The end.

Thank you!

Any questions or thoughts?


29/30


30/30

THANK YOU

Documents

Virtualization for Data Centers of Today Tomorrow