Storage and Server Storage and Server Virtualization at Seton Virtualization at Seton

HallHall

Matt StevensonMatt StevensonIT ArchitectIT Architect

Seton Hall UniversitySeton Hall Universitystevenma@shu.edu

Copyright Matt Stevenson 2008. This work is the intellectual property of the author. Permission is granted for this Copyright Matt Stevenson 2008. This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permission from the author.republish requires written permission from the author.

OverviewOverview

Storage VirtualizationStorage Virtualization– Heterogeneous virtualization (in-Heterogeneous virtualization (in-

band)band)– Array based virtualization (code on Array based virtualization (code on

controller)controller)

Server VirtualizationServer Virtualization– VMWare ESX/InfrastructureVMWare ESX/Infrastructure

History 2004/2005 - (1)History 2004/2005 - (1)

In 2004 SHU had stand alone In 2004 SHU had stand alone servers and various disk islandsservers and various disk islands

Most storage was direct attachedMost storage was direct attached

Standard “1U” rack servers, one Standard “1U” rack servers, one per applicationper application

History 2004/2005 - (2)History 2004/2005 - (2)

IBM 2105 - ESS “Shark”IBM 2105 - ESS “Shark”– Direct attached via SCSIDirect attached via SCSI

Several stand alone IBM disk unitsSeveral stand alone IBM disk units– Direct attached via SCSIDirect attached via SCSI

Each server had local diskEach server had local disk– Different controllers, RAID replacement Different controllers, RAID replacement

proceduresprocedures

Architecture Changes Architecture Changes (1)(1) Implement SANImplement SAN

– Reduce dependency on direct attached diskReduce dependency on direct attached disk– Provide more centralized management of diskProvide more centralized management of disk

Reduce server sprawlReduce server sprawl– Research Virtual Machine technologyResearch Virtual Machine technology

Focus on Blade technologyFocus on Blade technology– Smaller size, power, and cabling Smaller size, power, and cabling

requirementsrequirements

Systems (Blades)Systems (Blades)

IBM Blade Center IBM Blade Center TechnologyTechnology

– Modular designModular design

– Includes Network, Storage Includes Network, Storage Switch, and Management Switch, and Management in single chassisin single chassis

– Lower power requirements Lower power requirements for serversfor servers

– 70 Servers per rack70 Servers per rack

– Boot from SAN for no Boot from SAN for no moving parts on bladesmoving parts on blades

Architecture Changes Architecture Changes (2)(2) Implement SANImplement SAN Reduce server sprawlReduce server sprawl Focus on Blade technologyFocus on Blade technology

- Storage Virtualization -- Storage Virtualization -

Storage (SAN)Storage (SAN)

SAN StorageSAN Storage– IBM SharkIBM Shark– IBM DS8000IBM DS8000– StorageTek Flex380StorageTek Flex380– InfortrendInfortrend

SAN Switch/InfraSAN Switch/Infra– qLogic SANBox 9000 qLogic SANBox 9000

(Blades)(Blades) Up to 256 PortsUp to 256 Ports Ability to expand Ability to expand

SAN to other SAN to other buildings/long buildings/long distance (DR, etc)distance (DR, etc)

Blade 1 Blade 4Blade 2 Blade 3

SAN Switch 1 SAN Switch 2

IPStor 1 IPStor 2

DS8000 Flex380

Storage Virtualization Storage Virtualization (1)(1)

Storage Virtualization – Storage Virtualization – (2)(2) FalconStor IPStor softwareFalconStor IPStor software

– ““Virtualizes” all storage, allows resize, Virtualizes” all storage, allows resize, assign/remove on the flyassign/remove on the fly

– Allows mirroring/physical disk moves with Allows mirroring/physical disk moves with no downtime (between multiple physical no downtime (between multiple physical storage units)storage units)

– Single “pane of glass” management for all Single “pane of glass” management for all storagestorage

– Freedom from vendor limitations (LUNs, Freedom from vendor limitations (LUNs, sizes, etc)sizes, etc)

– Snapshots of live data possibleSnapshots of live data possible

Storage Virtualization – Storage Virtualization – (3)(3)

FalconStor IPStor software (v5.1)FalconStor IPStor software (v5.1)– In-band solutionIn-band solution– Active/Active clusterActive/Active cluster– Single software interface for all Single software interface for all

management (Linux/Windows)management (Linux/Windows)– Clients available for snapshots for Clients available for snapshots for

Oracle, Notes/Exchange, SQL Server, Oracle, Notes/Exchange, SQL Server, etcetc

Storage Virtualization – Storage Virtualization – (4)(4)

Tasks for administrators:Tasks for administrators:– Mirror data (Upgrades, backups)Mirror data (Upgrades, backups)– Move dataMove data– Add additional storage from selected Add additional storage from selected

tiertier– Add new servers to storage poolAdd new servers to storage pool

Storage Virtualization – Storage Virtualization – (5)(5)

Mirror CommandMirror Command– Move dataMove data– ““Swap” mirrorsSwap” mirrors– ““Promote” mirror Promote” mirror

to primary storageto primary storage

Moving storage Moving storage from one array to from one array to anotheranother

System PerformanceSystem Performance

Applications currently utilizing storage Applications currently utilizing storage virtualization – 70+ server clientsvirtualization – 70+ server clients

– Lotus DominoLotus Domino (campus wide) (campus wide)– Sungard BannerSungard Banner (Approx 12 instances (Approx 12 instances

with multiple add-ons)with multiple add-ons)– File/Print servicesFile/Print services (campus wide) (campus wide)– Content management systemContent management system– Luminis PortalLuminis Portal– VMWare ESX ServerVMWare ESX Server

Additional FeaturesAdditional Features

ReplicationReplication

““Hot Zone”Hot Zone”

SnapshotsSnapshots

ReportsReports

Storage Virtualization - Storage Virtualization - FutureFuture

Fully integrate Dynapath/MultipathFully integrate Dynapath/Multipath

Full 4Gbps SAN connectionsFull 4Gbps SAN connections– Overcomes 2Gbps queue depth issuesOvercomes 2Gbps queue depth issues

Increase number of targets to hostsIncrease number of targets to hosts

Storage Virtualization - Storage Virtualization - ReviewReview

Single pane of glass for administrationSingle pane of glass for administration

Migration between physical disk arrays Migration between physical disk arrays is a non-issueis a non-issue

Simplification means no full time Simplification means no full time storage administrator necessarystorage administrator necessary

Avoid Single Point of FailureAvoid Single Point of Failure

Server VirtualizationServer Virtualization

Server Virtualization - Server Virtualization - HistoryHistory

Single standalone serversSingle standalone servers

One server per applicationOne server per application

Development environment for Development environment for each production environmenteach production environment

Server Virtualization Server Virtualization (1)(1) VMWare Infrastructure Enterprise v3VMWare Infrastructure Enterprise v3

– Single pane of glass to monitor, configure, and Single pane of glass to monitor, configure, and provision new servers (VirtualCenter)provision new servers (VirtualCenter)

– ““VMotion” technology to move virtual machines VMotion” technology to move virtual machines between VMWare serversbetween VMWare servers

– Virtual machines will be “SMP” capableVirtual machines will be “SMP” capable

– Cluster aware filesystem (VMFS)Cluster aware filesystem (VMFS)

– High Availability (VirtualCenter)High Availability (VirtualCenter)

Server Virtualization Server Virtualization (2)(2)

Seton Hall Seton Hall EnvironmentEnvironment

(4) VMWare ESX (4) VMWare ESX ServersServers– IBM x3850IBM x3850– ““Virtual Infrastructure Virtual Infrastructure

Enterprise 3”Enterprise 3”– 32GB RAM each32GB RAM each

VirtualCenter VirtualCenter Management ServerManagement Server– Win2k3 BladeWin2k3 Blade

Server Virtualization Server Virtualization (3)(3)

VMWare 1

VMWare 3 VMWare 4

VMWare 2

VirtualCenter Mgmt

Server Virtualization – Virtual Server Virtualization – Virtual CenterCenter

Virtual CenterVirtual Center– Single management console to view all VMWare serversSingle management console to view all VMWare servers– Can be single point of failure (won’t bring down VMs)Can be single point of failure (won’t bring down VMs)– Required for Vmotion, HA/DRRequired for Vmotion, HA/DR– Accounts can be from Active DirectoryAccounts can be from Active Directory

Server Virtualization - Server Virtualization - VmotionVmotion

VmotionVmotion– ““Live” migration of virtual machines between Live” migration of virtual machines between

VMWare serversVMWare servers

– Requires dedicated GigE connectionRequires dedicated GigE connection

– Requires shared SAN disks (VMFS)Requires shared SAN disks (VMFS)

– Requires “like” CPUs on VMWare serversRequires “like” CPUs on VMWare servers Review VMWare documentation closelyReview VMWare documentation closely

– VirtualCenter can dynamically move VMs based on VirtualCenter can dynamically move VMs based on system loadsystem load

Seton Hall Server Virtualization Seton Hall Server Virtualization (1)(1)

How Seton Hall is utilizing Server How Seton Hall is utilizing Server VirtualizationVirtualization– 55+ Virtual Machines55+ Virtual Machines

– Production and Development systemsProduction and Development systems

– VMotion implemented to avoid VMotion implemented to avoid VMware system downtimeVMware system downtime

Seton Hall Server Virtualization Seton Hall Server Virtualization (2)(2)

– Remote access to development Remote access to development systemssystems From user’s desktopFrom user’s desktop Remote media mount (CD, Floppy, etc)Remote media mount (CD, Floppy, etc)

– Storage flexibility (adding virtual Storage flexibility (adding virtual disks on the fly)disks on the fly)

– ““Virtual Appliances”Virtual Appliances” http://www.vmware.com/applianceshttp://www.vmware.com/appliances

Seton Hall Server Virtualization Seton Hall Server Virtualization (3)(3)

– Migration of old hardware/serversMigration of old hardware/servers Out of date/out of warrantee physical Out of date/out of warrantee physical

hardwarehardware

– Schedule restarts/power Schedule restarts/power on-off/relocation of VMson-off/relocation of VMs

Server Virtualization - Server Virtualization - PerformancePerformance

Sample Seton Hall ApplicationsSample Seton Hall Applications

– Oracle Identity Manager (Development)Oracle Identity Manager (Development)– Cacti SNMP statistics (Production)Cacti SNMP statistics (Production)– ezProxy reverse proxy server (Production)ezProxy reverse proxy server (Production)– R25 Scheduling (Development)R25 Scheduling (Development)– Active Directory (Development)Active Directory (Development)– Sungard Banner (Development)Sungard Banner (Development)– Lecture123 (Production)Lecture123 (Production)

Server Virtualization - Server Virtualization - PerformancePerformance

VMWare ESX VMWare ESX Server and Server and VirtualCenter VirtualCenter provide provide performance performance graphsgraphs– Exportable to Exportable to

ExcelExcel

Seton Hall Server Virtualization Seton Hall Server Virtualization (4)(4)

Future ItemsFuture Items– Migration to VMWare Infrastructure Migration to VMWare Infrastructure

Enterprise 3.5Enterprise 3.5

– VMware Converter Enterprise EditionVMware Converter Enterprise Edition Live migration of physical server to Live migration of physical server to

virtual machinesvirtual machines Clone of physical machines for DRClone of physical machines for DR

Seton Hall Server Virtualization Seton Hall Server Virtualization (5)(5)

Future Items for Seton HallFuture Items for Seton Hall– Review and implement VMWare Review and implement VMWare

Update ManagerUpdate Manager Automated patching for ESX Server and Automated patching for ESX Server and

VMsVMs

– Lab replacement using VI3/VDILab replacement using VI3/VDI Virtual Desktop Infrastructure for lab Virtual Desktop Infrastructure for lab

machinesmachines

How it all works for How it all works for SHU..SHU.. Storage VirtualizationStorage Virtualization

– Dynamic allocation of virtual disksDynamic allocation of virtual disks– Single pane of glass storage managementSingle pane of glass storage management– Sidestep vendor restrictionsSidestep vendor restrictions

Server VirtualizationServer Virtualization– Relies on Storage Virtualization for all storageRelies on Storage Virtualization for all storage– Physical server consolidationPhysical server consolidation– Single pane of glass server managementSingle pane of glass server management– Live movement of VMs for high availabilityLive movement of VMs for high availability– Remote access built inRemote access built in

Questions?Questions?

Matt StevensonMatt StevensonIT ArchitectIT Architect

Seton Hall UniversitySeton Hall Universitystevenma@shu.edustevenma@shu.edu