Microsoft PowerPoint - SWSOFT heise Open Source meets

DRAFTheise Event 2007:Open Source meets BusinessVirtualizationWhy and What is it?

By Serguei Beloussov, Chairman and CEO SWsoft

September, 2006

heise Open Source meets Business – Virtualization - Why and What is it? DRAFT

Epigraph

"Any problem in computer science can besolved with another layer of indirection.But that usually will create another problem."

David Wheelerhttp://en.wikipedia.org/wiki/David_Wheeler


Agenda• History and Problems of Commodity Architectures

– Virtualization defined and its benefits• Virtualization for Production Workloads and more

– Hardware partitioning – Virtual Machine Monitors– More on VMM - what is Hypervisor; Paravirtualization; Intel VT and AMD V– OS Virtualization– Distributed Virtualization– Application Virtualization and more

• Why Tools, Automation and Resource Management• Virtualization affect on IT

– Does it benefit desktops? – How it changes IT industry and its revenues? – Could Virtualization enable outsourcing?

• Summary and Short Q&A


Problems of Commodity Architecture1000s of Specialized

Computers

• High Cost• High Complexity• Low Flexibility• Low Service Levels

OS

App

1

App

2

App

3

user

user

user

superuser

App

4us

er

user

Management Costs

Software Costs

Hardware Costs

IDCCosts

Operating Systems History and Today

• Per Applications or User Group• Separately Provisioned• Separately Managed• Poorly Utilized <10%

• Single Task Single User• Multi-Task Single User• Multi-Task, Multi-User• One-to-One Environment-to-Box

Inefficient IT Infrastructure

Gartner estimates “Intel servers running at 10 percent to 15 percent utilization are common.” And predicts that using VIRTUALIZATION “Intel server utilization should double.”

Gartner Group, November 2004: Predicts 2004: Server Virtualization Evolves Rapidly


Virtualization – Braking One-to-One Relationship“…A key benefit of the virtualization is the ability to run multipleoperating systems on a single physical server and share theunderlying hardware resources – known as partitioning…”

http://www.vmware.com/pdf/virtualization.pdf

“…Virtualization is a framework or methodology of dividing the resources of a computer into multiple execution environments...”

http://www.kernelthread.com/publications/virtualization/

“…Virtualization is a technique for deploying technologies. Virtualization creates a level of indirection or an abstraction layer between a physical object and the managing or using application…”

http://www.aarohi.net/info/glossary.html

“…In computing, virtualization is the process of presenting alogical grouping or subset of computing resources so that they can be accessed in ways that give benefits over the original configuration. This new virtual view of the resources is not restricted by theimplementation, geographic location or the physical configuration of underlying resources…”

http://en.wikipedia.org/wiki/Virtualization


Virtualization – Simply Better IT Management Model• Cut Cost

– On Management, Hardware, Infrastructure, Power and Software

• Get More out of the Existing Infrastructure Assets– Hardware, Power Capacity, DC Floor Space, Routers, SAN, IT Staff, etc

• Improve Flexibility of IT Infrastructure– Dynamic resource allocation to meet application or business unit needs– Abstract from hardware and other fixed assets, easy capacity planning

• Improve Availability at Lower Cost– Reduce or eliminate downtime for upgrades and updates– Faster Backup/Recovery in case of Hardware and Software Failures– Much easier configuration of clustering or HA deployments

• Enable Much Easier Automation and Management– Reduce Time, Simplify and Improve Reliability of Provisioning, Patch Management,

Configuration Changes, Backup, Security, Audit and Compliance– Enable Self-Management, Delegation, Usage Accounting and Chargeback's


Production Partitioning and Virtualization• Hardware Partitioning • Virtualization of Hardware

– Virtual Machine Monitors (VMM)– Hypervisor – how it improves VMM– Paravirtualization - what is it on top of Hypervisor– Intel VT, AMD SVM (“hardware paravirtualization”)

• Virtualization of Operating System• Distributed Virtualization• Application Virtualization

– Other types of Virtualization, relevant and not


Hardware Partitioning• Defined

– Accomplished on the hardware and chipset level– Control monitor software (BIOS is controlling partitioning)– Enables multiple different OSs to run natively

• Examples– Various IBM machines, Sun, HP, Unisys and more

• Advantages– Very Strong (too?) isolation , native performance/scalability

• Disadvantages– Expensive by nature – special chipsets, high-end hardware– Relatively static, many OS to manage – In many cases effectively looks somehow like rack of blade servers


Virtual Machine Monitors• Defined

– Virtualizes access to hardware, creates “standard” virtual hardware– There is Host OS and each guest has full standard OS

• Examples– VMware, Microsoft Virtual Server, Parallels

• Advantages– Good isolation, different OS on the same box, broad OS support,

good resemblance of separate computer

• Disadvantages– Low manageability – effectively almost as many servers/OS– Performance, especially I/O overhead, double caching– Scalability overhead, limited SMP, data locality/coherency optimizations void– Lots of duplication on disk and in memory > low density

• Could engineering turn water into wine?


More on VMM–“Thin” Hypervisor–new OS• First: Virtual Machine Monitor has higher privilege level

then any of the main OS– Even with broken Host/Main OS “theoretically” system could continue running

• Second: Virtual Machine Monitor runs over specialized proprietary OS

– In case of VMware ESX – VMkernel and cut-down, tuned Linux– In case of XEN – just modified Linux– “Thin” just means that only needed parts are kept in that OS

• Advantage:– Better performance, higher efficiency through “thin”, more security

• Reality:– Proprietary OS to depend on – hardware2 support, security– As performance gets optimized “thin” becomes “thick”– I/O overhead is still significant, caching/locality/coherency issues still exist


ParaVirtualization (demystified) • First: x86 virtualization – unsafe instructions

– VMware, Parallels and Virtual Server solve this in binary compatible way– ParaVirtualization (UML, XEN) simply requires to replace them in the guest

kernel source code and as such requires source recompilation (retest, recertify,repackage) of guest OS

• Second: I/O is not ready to be virtualized– VMware+ solves this through VMtools - variety smart binary compatible ways– ParaVirtualization rewrites device drivers+ in Guest OS and creates backend

support in Host OS

• Advantages– Better performance, better efficiency, nice looking architecture

• Disadvantage– Recompiled Guest OS potentially behaves differently with applications,

and must be separately optimized– Does not really solve density, manageability or scalability problems

• Standards war on “paravirt API proposals”


Intel VT and AMD SVM – HW Paravirtualizaiton• First: no unsafe instructions

– No more of a problem– Note: Still could not be used directly, smart implementations are needed

• Second: I/O is now ready to be virtualized– F.e. DMA tables could be partitioned– With device vendors support “virtualized” devices could be created to be

dedicated to individual VMs with little overhead

• Advantages– Much easier to develop more scalable and better performing VMM,

so newcomers like Parallels are on the market– XEN could now run Windows

• Disadvantage– No real serious disadvantages on its own☺– Does not eliminate need for Virtualization (VMM) software– Does not solve all of hardware virtualization problems – density problems,

optimization problems, cache problems, manageability problems


OS Virtualization• Defined

– Virtualizes access to the Operating System– Single, standard OS (drivers and low level OS services) is running on each computer– Each Environment sees its own “virtual OS” copy/objects

• Examples– SWsoft Virtuozzo, Sun Containers

• Advantages– Native performance and scalability, highest density– Excellent Manageability, no OS/APP sprawl– Lightweight enough for number of unique scenarios

• Disadvantages– Same low level kernel services and drivers (most of patches are not changing them) – No Windows on Linux or Linux on Windows (but multiple distributions are possible)

• Engineering could turn water into wine!?


Distributed Virtualization• Defined

– Abstracting resources group of computers and creating something resembling“single image” execution environment across of them

• Examples– Initial positioning of Virtual Iron, variety of grid computing vendors– Now several vendors like 3tera which try to combine two approaches for better

manageability and flexibility, as well as combine them with clustering

• Advantages– Enables single environment to scale more then resources of any single server– Could improve availability and balance resources more equally

• Disadvantages– Most of applications need to be specially changed and some could not be– Difficult and “unusual” to administer– Typically require expensive low-latency connectivity hardware (Infiniband)

• Connectivity is improving slower then single box CPU power –with multi-core CPU SMP boxes would distributed virtualization be broadly needed?


Application Virtualization and More• Defined

– Virtualizes single application environment

• Examples– Softricity (Microsoft), Citrix, Altiris

• Advantages/Benefits– Enables you to run several versions or instances of the same application

on the same hardware– Enables you to run application anywhere without installing or configuring it

• Not really the same category as above• Other “Virtualizations”

– Storage and Network Virtualization– Java, .NET, other and distributed arch. (Google does not need Virtualization!)– Numerous hardware and API/ABI emulators and simulators– Denali, Disco, ExoKernel, Nemesis, Inferno – research projects (cool names)


Tools, Automation and Resource Management• No physical interfaces in Virtual World

– Lots of things in physical infrastructure are taken for granted– Virtualization creates “too flex” infrastructure? – Management tools are mandatory

• Lots of underutilized servers– And Operating Systems, and Applications, and Users– Key word - lots– Virtualization increases utilization – Virtualization enables automation– But automation is still needed

• Resource Management is now possible– Hardware is virtualized and uniform – still SLM needs to be done somehow– Barrier, share, maximum, guarantee, burstable, affinity– Plan, Configure, Enforce, Control, Monitor, Account, Report– Balance, complex policies, live migration, fairness, dynamic, real-time,

fine tuning, easy, APIs, management tools, GUI


How Virtualization Benefit Desktops?• Share single desktop safely

– Kids could do whatever they want in their environment

• Enable easy desktop management – Server based desktops accessible from any device (home, work, mobile)– Dramatically easier recovery/restore procedures. enable true remote

management, instantaneous provisioning– Improve/unify update management

• Enhance security– Isolate dangerous applications or dangerous uses of safe application

• In order to become truly useful must be very easy andmust not require any sacrifice

– 3d games and many other applications require 100% (+++) performance– Management should not be harder or more with it


Virtualization Effect on the IT Industry• How does it affect vendor revenues

– Would this mean less or more infrastructure needed? – Would this mean less or more hardware needed?– Would this mean less or more software licenses needed? – Would this mean less or more IT people needed?

• Example: software licensing– Was per physical unit (CPU,socket,user,device)>now per virtual unit is attempted– Complex – migration, dynamic resource reallocations, non-started licenses– OS Virtualization – single OS is installed, registered, on disk, started

and running – just more isolation – why pay more? – Imagine distributed Virtualization hurdles– New licensing is needed, licensing should not hold up the usage

• Virtualization makes IT more useful– Should mean that IT budgets are be increased, not decreased– Example: 10,000 servers somehow create 2-5x more VE/VMs– Should mean that how they are apportioned would be changed


Could Virtualization Enable True Outsourcing?

• Virtualization “side effects”– Enables oversell– Make hardware uniform and reusable– Enables fine-grain delegation– Enables full remote management– Decreases costs of achieving measurable high-security

• Server consolidation projects create in-house service providers– Single consolidated datacenter– Departments/business units are “customers”– Usage accounting, chargeback's required

• With high speed secure external networks– Would this mean outsourced Utility Computing– Of course lots of tools and core features to add


Summary• Virtualization is real and will be everywhere

– Every new idea is a forgotten old idea– Just natural evolution related to increased IT usage and computer power– Much more then just consolidation and cost savings– At the end it makes IT more efficient and enables outsourcing

• Hyped-up space– Filter the virtualization noise– There are many different and complimentary types and products– Some are not real today and for all there is lots of work to do

• Which part of Virtualization be part of the Operating Systems and Hardware?

– Certainly not all of it and most certainly not so soon

• The presentation is just my opinion– More about Virtuozzo at SWsoft booth


Questions and Answers

Please ask questions now orlater by email

[email protected]

Technology

Microsoft PowerPoint - SWSOFT heise Open Source meets