Security Agility Reduced Cost Security Agility Reduced Cost Foundation for an agile IT...

Preview:

Citation preview

Security Agility Reduced Security Agility Reduced CostCost

Foundation for an agile IT Infrastructure:

Building the ultimate database container with

Red Hat Enterprise Linux, MySQL, and Virtualization

Jan Mark Holzerjmh@redhat.comConsulting Engineer Emerging Technology GroupCTO Office

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 2

Outline • What is virtualization and how can it help

• Red Hat Enterprise Linux 5 & Virtualization

• Database Appliances

• Use Models and Deployments

• Q&A

Red Hat Enterprise Linux

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 3

Why virtualization ?

It’s fun.

It gets a lot of papers published.

It’s going to change everything. Eventually.

But the customer benefits boil down to just two things…

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 4

Customer BenefitsVirtualization can help to manage cost

Virtualization enables distributed, automated system management Virtualization allows resources to be managed as abstract entities

Independent of physical instantiation, location – even existence Physical servers host multiple virtual servers

Virtual servers are objects that hide underlying complexity Presents a common interface and architecture Simplifies OS and system maintenance Hardware abstraction

Virtual resources can be allocated and managed dynamically Enables more efficient use of existing resources

Manage such things as cost, QoS, power,floor space, cooling and security

Enhances scalability while controlling costs

Virtualization is the fundamental enabling technology for utility computing and utility services, both of which will reduce costs

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 5

Customer BenefitsVirtualization can help to manage risk

Virtual servers run in secure compartments Isolation is comparable to separate physical servers Failures, even user and kernel errors, cannot propagate to other virtual

servers

Individual applications can be mapped to separate virtual servers Enhances security and separation Avoids application incompatibility problems

Separation of virtual and physical resources facilitates availability Transparent hot-swap component replacement and upgrades Live virtual server migration for load management and maintenance Low-cost redundancy

Virtualization provides a risk buffer for capacity planning Under-provisioning to reduce expenses Over-provisioning to ensure adequate capacity Dynamic resource management can mitigate these risks

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 6

Example: Data Center Dilemma

Data center has physical constraints Fixed sized, fixed power, fixed cooling, etc Often physical constraints are cost prohibitive to change

Data centers have excess capacity Volume servers (Intel ISS) 10-15% utilized, mid / high 30-40% (>4

socket) Customers comfortable with single application server

One application per OS instance – optimal unit of management, control, etc.

Application stacking to consolidate on a single OS viewed as higher risk and often more expensive

Need a new service, deploy a new server / storage (ie VM warehouse model)

Dilemma Can no longer afford current paradigm

Can’t afford the $10 million server or storage controller that translates into a new data center or expansion

Can’t afford continual increase in number of administrators or cost / time to deploy new services

Can’t afford power and thermal management e.g. Annual electric bill for Google’s 200K servers greater than

cost of all server hardware

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 7

Example: Server & Storage Virtualization Multiple Views

One or more applications per view One OS per view

Multiple OS versions per server Enable transparent migration of services between hardware

instances – blades, enclosures, etc. Benefits

Increased hardware utilization Avoid the $10 million dilemma

Reduced time to deploy new services Don’t need to purchase new server / storage to deliver Use views to validate service on existing hardware while

maintaining complete isolation and protection Reduced cost

Fewer servers to buy / manage Lower software licensing

Per core rather than unit of work / value delivered Few administrators

Decouple hardware evolution from software No longer legacy software constrained

Virtualization provides legacy view Change customer control point

Virtual and physical management infrastructure drive customer purchase decisions

Motivated to upgrade to virtualization-capable hardware and software

De-motivated to migrate to competitive offerings Those that establish beachhead will be more difficult to

displace

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 8

Multiplex one machine into different “Virtual Machines” VMs; allows running different isolated guest Operating Systems with different applications on same physical hardware.

Allows a “Guest” OS to run

under control of a supervising

master program that is called:

“Hypervisor” or “Virtual Machine Monitor (VMM)”. Hypervisor / VMM Functionality:

Virtualizes System Resources Provides Scheduling of host/guests Intra-guest communication

Common grounding 'Host' also often referred as 'dom0' and/or HyperVisor 'Guest' also known as 'domU'

Hypervisor/VMMHardware

What is Virtualization?

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 9

Red Hat Enterprise Linux Overview

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 10

Red Hat development model• Collaboration with partners and open source contributors to

develop technology• Deliver complete distributions in two stages for two users

− First stage• Fedora: The development vehicle

• New versions approximately twice each year

• Unsupported

• Fast moving, latest technology

− Second stage• Red Hat Enterprise Linux

• New versions approximately every 18 – 22 months

• Supported and certified

• Stable, mature, commerciallyfocused technologies

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 11

What's new in Version 5?

• Enterprise Linux Advanced Platform• Integrated virtualization• Industry leading performance and price/performance• Enhanced and easy to use security• Improved networking and interoperability• Enhanced development tools• New SLAs• Enhanced client

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 12

Red Hat Enterprise Linux Overview

2005 2006 2007 2008 20102009

RHEL 5

RHEL 4

RHEL 3

RHEL 2.1

RHEL 3 in transition from Full Support to Maintenance mode. Final bug-fix-only update 9 Improved para-virtualized drivers planned.

RHEL 4.5 released May 2ndLengthened release cycle to avoid schedule

overlap.Support of RHEL4 para-virt guests on RHEL5.Extended full support phase of approx. 3 yearsRHEL 4.6 in November. Final bug-fix-only release, similar to 3.9 in

August '08.

U7

U8...

U3

U4

U9

4.5 4.6

5.1 5.2

4.7 4.8

RHEL 5 released March 2007 Virtualization and Advanced Platform

intergation Selinux enhancementsNew cluster management infrastructureGFS2 , Statless Linux technology preview

RHEL 6 no schedule yet for next major releasePlanning driven by customers, partners and

technology Fedora 7 released and Fedora 8 in planning

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 13

RHEL Virtualization Roadmap

2007 2008 20102009

RHEL 5

5.1 5.2

RHEL 5.1 HVM Improvements

Performance (Hot-) Migration

32 on 64 bit para-virtualized. Dom0 KDump IA64 Support Libvirt enhancement Security

Post-RHEL 5.1 Para-VIrtualized drivers for HVM RHEL 3, later 4. Para-Virtualized drivers for Windows.

RHEL 5.2 Large System Support

NUMA Memory

Nested Page Table support planned. Path for CIM support on top of libvirt. Virtual Desktop

RHEL 5.0 GA Core Virtualization. Para-Virt RHEL on RHEL, 32/32, 64/64 bit, x86 & x86_64 Libvirt management RHEL 5 guests RHEL 4 guests with 4.5+

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 14

Red Hat Enterprise Linux 5: Product summary• Servers:

− Red Hat Enterprise Linux Advanced Platform for mainstream customers• Unlimited server size and virtualization capabilities

• Maximum flexibility and value

− Red Hat Enterprise Linux available forsmall environments

• Clients:− Red Hat Enterprise Linux Desktop

− Workstation and Multi-OSoptions for special environments

− High volume security and manageability

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 15

Red Hat Enterprise Linux 5 Advanced Platform • Extends the base product to provide a complete solution for

virtualized environments− The ideal solution for the mainstream customers

• Advanced Platform provides− Integrated server and storage capabilities

− Unlimited guest operating systems

− Guest migration with consistent storage

− Application migration*

− Cluster Logical Volume Management &Global File System*

− Seamless expansion across multiple systems

− Enhanced management capabilities

− Easy transition for Red Hat Enterprise Linux AS customers• Provides significantly greater capabilities

* Previously offered as separate layered products:Red Hat Global File System and Red Hat Cluster Suite

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 16

Advanced Platform benefits

• Designed for mainstream customers who seek the advantages of virtualization without complexity or risk

• Provides a full virtualization infrastructure in one complete package

• Eliminates the need to create a solution using multiple products from different vendors

• Reduced solution cost• Reduced deployment time• Integrated installation and

management• Extensive documentation• Training services• Installation and maintenance services

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 17

Red Hat virtualization architecture

• Physical computing and storage components provide a central pool of resources

• Virtual systems with appropriate compute, memory, and data can be dynamically allocated, provisioned, and managed

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 18

Development Approach• Requirements: Stability, reliability, effectiveness• Release focus is on foundational elements

− Innovation rate is high in virtualization technologies

− Stable platform with stable APIs for easy enhancement

• Support for x86, x86_64, UP and SMP at GA

− Support for IA64, PPC tech preview in RHEL5 GA

• Focus is on foundational elements− Priority is to deliver hooks, APIs to enable continued development of rich

management & monitoring tools

• At a minimum, will include: − libvirt – local Virtual Machine (VM) management API

• create, destroy, start, stop, suspend, resume

• basic support for hot and cold migration

− iSCSI, GFS2 (tech preview in RHEL5 GA), NFS containers

− Virtual block, network

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 19

libvirt: Stable and Open API Management of hypervisor(s) Hypervisor agnostic Stable API for application developers Isolation from Xen HV instability Isolation from XenD protocol changes Formalized error reporting/handling XML definitions for Vms Distributed in FC4/FC5/FC6/F7/RHEL5/Debian/OpenSolaris Core API in C, Python/Perl bindings CLI access via virsh

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 20

DatabaseAppliances

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 21

High Level Xen Architecture

Hardware

Hypervisor

Domain 0

Device Driver

Back End

Domain 1

Front end

Domain 2

Front end

Virtual CPU & Memory

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 22

MySQL Database Appliances• Virtual Appliances

− One or more virtual machines packaged and tailored for distribution and deployment

− Pre-defined function and packaging− Pre-configured and optimized for specific use case

• MySQL and OS configuration/tuning

• Benefits of appliances− Ease of Installation, configuration and deployment− Tested as a whole by vendor/supplier− Can be easily replicated− Long term storage and archival− Hardware agnostic and independence− Application isolation (performance, security)− Dynamic workload management− Ability to move workloads online throughout the environment

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 23

Virtual SMP combined with

sub-CPU granularity

text

CPU text

CPUtext

CPU text

CPU

All available in one offering on RHEL5

VM2

VM1

VM4

VM5

VM7 VM8

VM3

VM6

Virtual machine scalability and Higher resource utilization

VMn == domUn

RHEL5 Virt Platform

Virtual Machines

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 24

Memory ballooning

VM 1

VMn == domUn

RHEL5 Virt Platform

Virtual Machines

1GB2GB

Current Memory Size

Max Memory Size

0.5GB

1GB

VM 2Max

MemCurr Mem

MEM

1GB

MEM

1GB

MEM

1GB

MEM

1GB

Guest can be configured to balloon/grow their current memory footprint

Allows for online expansion and growthCan use virt-manager or CLI interface for management

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 25

Memory ballooning

VM 1

VMn == domUn

RHEL5 Virt Platform

Virtual MachinesCurrent Memory Size

Max Memory Size

VM 2Max

MemCurr Mem

MEM

1GB

MEM

1GB

MEM

1GB

MEM

1GB

Growing guest VM2 to 1GB using memory ballooning

Now both guests have increased their available memory onlineResize database SGA Increase available VM for applications etc...

2GB2GB

1GB

1GB

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 26

I/O virtualization

SAN

Virtual Machine 1

Virtual Machine 2

Virtual Machine 3

Physical Disks

Partition(s)

Logical Volumes SAN Storage Arrays

File Containers

CD/DVD DriveISO Images

RHEL5 Virt Platform

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 27

Dynamic I/O Sharing

Virtual server’s I/O packets directed to

I/O cards by the HyperVisor/dom0

Virtual Machine 1

Virtual Machine 2

Virtual Machine 3

I/O card can be “dedicated” to a

virtual machine for performance

isolation

vHBA

vHBA

vHBA

RHEL5 Virt Platform

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 28

Dynamic Network I/O SharingVirtual machine’s network packets

directed to physical NIC by

the HyperVisor/dom0

NIC can be “dedicated” to a virtual machine for performance

isolation

Virtual BridgeNIC 1

Virtual BridgeDMZ

Virtual BridgeNIC 2

Virtual NIC may be defined

without a physical NIC for guest-to-

guest communication

Virtual Machine 1

Virtual Machine 2

Virtual Machine 3

vNIC

vNIC

vNIC

vNIC

vNIC

RHEL5 Virt Platform

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 29

HighAvailability

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 30

Highly Available RHEL5 Host and MySQL instance

RHEL5

Host A

Guest

RHEL5

Host B

Shared

Storage

Guest running as a RHCS serviceGuest 1

Guest 2

Guest X

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 31

RHEL5

Host A

Guest

RHEL5

Host B

Shared

Storage

Guest running as a RHCS serviceGuest 1

Guest 2

Guest X

Automatic failover upon Hypervisor failure

Highly Available RHEL5 Host and MySQL instance

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 32

RHEL5

Host A

Guest

RHEL5

Host B

Shared

Storage

App

Guest 2

Guest XGuest 1Guests running as independent cluster

Hypervisor clustered via RHCS

Highly Available RHEL5 Host and MySQL instance

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 33

RHEL5

Host A

RHEL5

Host B

Shared

Storage

Guest 2

App

Guest XGuest 1Guests running as independent cluster

Hypervisor clustered via RHCSApplication failover upon hosts/guest failure

Highly Available RHEL5 Host and MySQL instance

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 34

RHEL5

Host A

Guest

RHEL5

Host B

Shared

Storage

Guest 2

App

Guest XGuest 1Guests running as independent cluster

Hypervisor clustered via RHCSApplication failover upon hosts/guest failure

Highly Available RHEL5 Host and MySQL instance

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 35

Shared

Storage

App

Guest 2

Guest X

Guests running as independent cluster

RHEL5

Host C

Guest 1 Guest X

Hypervisor and bare metal host clustered via RHCS

Highly Available RHEL5 Host and MySQL instance

RHEL5

Host A

RHEL5

Host B

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 36

Shared

Storage

Guest 2

Guest X

Guests running as independent cluster

RHEL5

Host C

Guest 1 Guest XMySQL can migrate to another Guest/VM

Hypervisor and bare metal host clustered via RHCS

Highly Available RHEL5 Host and MySQL instance

RHEL5

Host A

RHEL5

Host B

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 37

Shared

Storage

Guest 2

Guest X

Guests running as independent cluster

Hypervisor and bare metal host clustered via RHCS

RHEL5

Host C

Guest 1 Guest X

MySQL can migrate to a bare metal system

Highly Available RHEL5 Host and MySQL instance

RHEL5

Host A

RHEL5

Host B

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 38

RHEL5 Disaster RecoveryRHEL5

Site A

RHEL5

Site B

Shared

Storage

Guest 1

Guest 2

Guest XGuestImage

GuestImage

GuestImage

GuestImage

GuestImage

GuestImage

XP/CA, EVA/CA

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 39

RHEL5 Disaster RecoveryRHEL5

Site A

RHEL5

Site B

Shared

Storage

Guest 1

Guest 2

Guest XGuestImage

GuestImage

GuestImage

GuestImage

GuestImage

GuestImage

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 40

RHEL5 Disaster Recovery

RHEL5

Site A

RHEL5

Site B

Shared

Storage

Guest 1

Guest 2

Guest X

GuestImage

GuestImage

GuestImage

XP/CA, EVA/CA

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 41

Solving real business problems

Virtual Machine relocation enables High Availability:

machine maintenance

Load Balancing: statistical multiplexing gain

Live Migration

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 42

Consider the possibilities...

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 43

Resources

• MySQL− http://www.mysql.com/

• Red Hat − http://www.redhat.com/

• Virtualization Infocenter− http://www.openvirtualization.com/

• libvirt− http://www.libvirt.org/

• Virt-Manager− http://virt-manager.et.redhat.com/

• Red Hat Cluster Suite− http://www.redhat.com/solutions/gfs/

• Red Hat Emerging Technology Group− http://et.redhat.com/

RHEL5 & MySQL Database Appliances / August 15th 2007

Product features subject to change prior to availability 44

QuestionsQuestions??

ThanksThanks

Recommended