24
The New Data Center Consolidated, Converged, Consolidated, Converged, Virtualized & Automated Virtualized & Automated Anil Vasudeva President & Chief Analyst [email protected] 408-268-0800 © 2007-08 IMEX Research All Rights Reserved Copying Prohibited Please write to IMEX for authorization IMEX RESEARCH.COM

The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

  • Upload
    others

  • View
    2

  • Download
    1

Embed Size (px)

Citation preview

Page 1: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

IMEXRESEARCH.COM

The New Data CenterConsolidated, Converged, Consolidated, Converged, Virtualized & AutomatedVirtualized & Automated

Anil VasudevaPresident & Chief [email protected]

© 2007-08 IMEX ResearchAll Rights Reserved

Copying ProhibitedPlease write to IMEX for authorization

IMEXRESEARCH.COM

Page 2: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Agenda

•• State of Existing Data Centers State of Existing Data Centers –– IssuesIssues

•• Cost & Technology Trends for the New Data CenterCost & Technology Trends for the New Data Center

•• Technologies/Metrics to followTechnologies/Metrics to follow

•• Implementing a Dynamic Data CenterImplementing a Dynamic Data Center

•• Consolidate, Converge, Consolidate, Converge, VirtualizeVirtualize & Automate& Automate

•• RecommendationsRecommendations

Page 3: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Chaos in the Enterprise . . .

Server/OS

Network

Application

Storage

Test

Backup

Disaster Recovery

Database

Financials

TM

D/R plan (MF only)

STK Silos Tape

TM

TM

TM

IBM3090-600JMVS/ESAIMS / ADABAS

BU by FDRUpstream

HPUX 10, 11.0, 11.2 MPE Sybase 11.9, 12

Fujitsu DS90UXP/M

8mm BackupLegato to DLT

IBM ADSM3490

HPOmniBack

SunSolaris 3.2, 3.4, 3.5Oracle 7.5, 8.0

IBM RS6000AIX 4.1, 4.2, 4.3DB2/6000

Compaq ProLiant 2500,5500NT 3.5, 4.0 SQL

Cheyenne to 4mm

Batch

IBM AS/400OS/400

InventoryExchange

CAD/CAME-commerce

Lotus NotesOLTP

CICS

File transfers AIX to HP/UX via Platinum 9.9

FTP between Sun -NT

Database extracts MVS to SP2 via MQ Series 4.4

PeopleSoft

(1) Scales poorly (2) Difficult to manage (3) Reliability is questionable (4) Management costs out of control

Page 4: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

CIOs Pressures/Dilemma > Data Center

Data Center IT Operations

Page 5: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

NDC – Aligning IT w Business Goals

From Maintenance FireFighting to Aligning IT with Business Goals

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Today Goal

Bud

get &

Res

ourc

es A

lloca

tion

Apps

Apps

Infrastr

Infrastr

Maintenance

Innovation

Page 6: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

*IOs per sesond for a required response time ( ms)

(RAID - 0, 3)

500100MB/sec101 505

1K

10 K

100

10

1

Application Aware Virtualization

eCommerceeCommerceTransaction Transaction ProcessingProcessing

OLTPOLTPOLTP

Data Warehousing

Visual DB

DSS(RAID - 1, 5, 6)

IOPs

(Lat

ency

)

StreamingStreamingStreamingAudioAudio

VideoVideo

Scientific ComputingScientific Computing

ImagingImaging

NICNICNIC

TP

HPCHPC

Page 7: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

CIO Goals - DC Infrastructure

ServersServers/Admin

StorageTerabytes/DBA

MIS Alerts Urgent Alerts/Day

SystemAvailability

Servers Utilization

Win 5-10%, SMP 20-35%, MF 30-50%80+%

15-30300+

1TB100TB

20-404-5

HAL- 3 (99.9%)

HAL- 5 (99.999%)

Storage Utilization

30-45% Disk, 20-40% Tape75+%

Application Application/Server

130

Power & Cooling

kW/Rack Capability

TodayTargeted

2-5 kW/Rack15-20 kW/Rack

Page 8: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

• WW 5.1 million data centers, Costs $100-175M to build a large DC 2007

– ~$1005/Sqft, $40,000/Rack, $2,500/Server, 2.5U– 82% of installed equipment (Srvr,Stg,Ntwk) has only10% utilization– For every $1 invested in new IT infrastructure, $7 spent to maintain– For every $1 in new Server spending, 42c spent on Power & Cooling /2006– Virtual Servers growth > Physical servers by 50% > Managing VM Sprawl– Blades increasing Power/Rack by 10x Need Power/Cooling,

• Consolidation in Enterprises & Service Providers– IT in Mega Data Centers, Data & Video Info Vaults at SPs

• Remote Offices, Global Reach, Always On– 66% of Enterprise workforce has remote location independent capability– Always On 24/7, Continuous Availability Mandatory

• New Technologies Necessary - a Competitive Weapon– Computing: Hi Density Blades, Multicore CPUs, Linux/Windows, TB Disks,– Networks: 10GbE, MPLS; Global Reach– Convergence (Voice Video, Data): Unified Communications, VoIP, Web 2.0– Mobility & Wireless (Location based Search/eCommerce)

Data Center – Cost & Tech Trends

Page 9: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

E2E IT Infrastructure with HA & Securitywith HA & Security

Enterprise

Tier-3DatabaseServers

Tier-2Apps

Tier-1Edge Apps

ManagementDirectory Security Policy

Software OS Platform

Caching, Proxy, FW, SSL, IDS, DNS, LB, Web

Servers

IntrDet

IntrDet

Layer 3 Switches (Routers)

Layer 4-7 Switches

Layer 2 Switches

Stg Fibre Switches

Application,HA, File/Print, ERP, Security, SCM, CRM Servers

Database, Middleware, Data

Mgmt Servers

InternetISP

CoreOptical

NetworkingEdge

Access

ISPISP

ISP

IntrDet

Supplier/Partner

Remote Office

Home Networks

DSL

Cable Modem

MP3 VOD

WirelessCellular

xSP

App.Server

VPN

IntrDet

WebServices DBServers

ISP

ISP

Page 10: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

IT Infrastructure Consolidation with HA & Securitywith HA & Security

Enterprise

InternetISP

CoreOptical

NetworkingEdge

Access

ISPISP

ISP

IntrDet

Supplier/Partner

Remote Office

Home Networks

DSL

Cable Modem

MP3 VOD

WirelessCellular

xSP

App.Server

VPN

IntrDet

WebServices DBServers

ISP

ISP

Tier-3Data Base

ServersTier-2 Apps

Switches: Layer 4-7,Layer 2, 10GbE, FC Stg

FC/ IPSAN

Caching, Proxy, FW, SSL, IDS, DNS,

LB, Web Servers

Application,HA, File/Print, ERP, SCM, CRM Servers

Database, Middleware, Data Mgmt Servers

Tier-1 EdgeApps

ManagementDirectory Security Policy

Software OS Platform

Page 11: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Blade Infrastructure:Local Area Grid (LAG©)

MidplaneW/Connectors

To Blades & BackModules

Storage: IP NAS or FC SAN Switch

Management Modules Remote Mgmt+KVM over IP

Cooling N+1Fans/Cooling ModulesPower: N+1Power Supplies

Networking: Gbit Ethernet Switches

BladeControlPanel

Processor Blades(6-24 typically)

MemoryDDR wECC

GbitEthernet

I/FSystemsMonitorModule

Micro-Processors

USB Ports, CD/Floppy I/F

© 2003-06 IMEX Research

~ GbE Switch supportsTrunking/Port AggregationFlow ControlQoS Packet PrioritizationSNMP/RMONIGMP/BOOTP/TFTP……

Page 12: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Blades - TCO Savings & ROI

0%

20%

40%

60%

80%

100%

1 2

% C

ontr

ibut

ion

OPEX

CAPEX33%

67%

46%

25%

Blade Servers Rack Servers

3 Year TCO Savings Rack vs. Blade Servers

OPEXStaff/

Support25%Maintenance/

Downtime54%

Facilities/Power21%

CAPEX

Servers46%

SWInfrastructure

22%

Storage Infrastructure

13%

Networking19%

TCO Savings in..

Data: IMEX Research 2004

Page 13: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Data Center Cooling

Computer Simulation using widely available software (e.g. Fluent Airpack Ansys CFD …) to verify Cooling Designed is the most cost effective before committing to final implementation.

Source: APC

IT Equipment50%

Where does the power go in Data Centers ?

Source: Emerson Liebert

Many techniques, methodologies and equipments from air cooling to liquid assisted cooling available form a variety of vendors and Consultants ….(Email [email protected] for more info and Assessment of competitive vendor products, consultants and data center power & cooling integrators) Source: IBM 2005

Page 14: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Implementing a Dynamic Data Center

CConvergenceonvergenceWeb 2.0 – Convergence of Computing with IP Telecom/Unified Networks to support eCommerce, Social Networking

VVirtualizationirtualizationPooled Resources, Optimally Provisioned per Application for Optimal Business Service Delivery, Monitored Usage

AAutomationutomationAutomatically Maintains App Service Level Objectives using Policy Based ILM

CConsolidationonsolidationStandardization - Reduce CAPEX via using Industry Standard Infrastructure, Shrink Wrap Apps. Reduced OPEX w/Automation Integration - Integrated Bladed infrastructure and low latency, high BW interconnect fabric

Page 15: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

New Data Center

Converge

Virtualize

Automate

Consolidate

Web 2.0 ApplicationsConverge Computing/IP Telecom/VoIP…

Unified Networking

Data Centers, Branch Offices, DesktopsVirtual Infrastructure (Create Resources Pools)

Dynamically balance computing resources HA/No Downtime (Live Migration w VMotion/DRS)

Intelligent Resources Allocation w Predefined Rules

Bus Continuity (HA/CDP/VMotion FO)Capacity On Demand

Automating Patching of Hosts & VMsMinimize Power Usage/Consolidate Servers Shut down inactive

Standardize – HW/Blades, OS, Interfaces,SW, Apps Integrate – Servers/Storage/Netwrking Fabric

Energy Efficient DC Facilities

Page 16: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Workloads Consolidation using VZ

• A single server 1.5x larger than standard 2-way server will handle consolidated load of 6 servers.• VZ manages the workloads + important apps get the compute resources they need automatically w/o operator intervention.• Physical consolidation of 15-20:1is easily possible• Reasonable goal for VZ x86 servers – 40-50% utilization on large systems (>4way), rising as dual/quad core processors becomes available• Savings result in Real Estate, Power & Cooling, High Availability, Hardware, Management

Source; Dan Olds

Page 17: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Virtualizing your IT InfrastructureSLA

UsageDept/Owner

AssetsLocation

• Host Name (Mfr/Model/SN,• Platform – OS/Processors/#/Speed/Type

• Pooled Infrastructure Resources by Application Metrics

• Pooled Capacity Provisioning: Processing, Bandwidth, Storage, Repository

• Usage Profiles• Users/Services/Workloads

• Applications (OLTP/BI/HPC/Data Streaming)• Execution: Rules Driven, Adaptive Provisioning

• Services Abstraction, Adaptive Provisioning

VirtualizationUtility - P2V

• Business Priorities• Cost of IT Ops/Charge Back Methods

• Response Time/Availability/Throughput,QoS• Transactions/Sessions/Events/Analysis/Reporting

• Business Services Managed & Charged

For copy of case study on how a major financial institution implemented virtualization email [email protected]

Page 18: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Available Solutions

Major Virtualization Vendors Major Virtualization Vendors -- VMWare / VMWare / MicrosftMicrosft / Xen/ Xen

VMWare Solutions & ProductsVMWare Solutions & Products• Application QoS – DRS, DPM• Resources Deployment to Apps in Realtime – DRS, DPM*• Fast Recovery from HW & SW Failures – HA, VMotion• Proactively Avoid Planned Downtime – VMotion• Failover of entire DC – Site Recovery Mgr• Security - VMSafe

• Automating Application Delivery From Dev/Test through Staging to Production - Lifecycle Mgr/Staging Mgr/Lab Mgr

*DRS – Distributed Resource Scheduler, DPM – Distributed Power Mgmt

Page 19: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Datacenter Automation Source: VMWare

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

Lab Manager Stage Manager (Release Mgmt from Integration, Testing, Staging, Acceptance to Production)

Sire Recovery Mgr Sire Recovery Mgr Site Recovery Manager (automates & ensures DR)

(Failover Site) (Failover Site)

Lifecycle Manager (manages requested/approved VMs across DC over VM lifecycle)

Virtual Infrastructure (DRS, HA, DR…)

Virtual Center (VI APIs)

Dev & QA Staging Production

Hypervisor

AppOS

App

OS

AppOS

App

OS

AppOS

App

OS

AppOS

App

OS

AppOS

App

OS

AppOS

App

OS

AppOS

App

OS

AppOS

App

OS

Physical Resources

Page 20: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

TCO Savings with Virtualization

$-

$4,000

$8,000

$12,000

$16,000

w/o VZ w VZ

Provisioning

HardwareSAN

NetworkPower & Cooling

DC Real EstateDisaster Recovery

Downtime

Cos

t ove

r 3 y

ears

995 Pre-Virtualization (VZ) Servers 78 VZ Servers

VZ SW & Support

For a copy of TCO

Analysis, Email:

imex@ imexresearch.comOr call (408) 268-0800

Page 21: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Summary Implementing New DC

•• Virtualization (VZ) now a mainstream technologyVirtualization (VZ) now a mainstream technology–– VZ turning DC core infrastructure upside down, DC VZ turning DC core infrastructure upside down, DC

Professionals very happy with its future useProfessionals very happy with its future use–– VZ means VZ means ““Doing More for LessDoing More for Less”” (finally making CFOs get off (finally making CFOs get off

your back)your back)

•• Follow SICVA in executing your DC strategyFollow SICVA in executing your DC strategy–– StandardizeStandardize (Windows/Linux, GbE, IP Storage/(Windows/Linux, GbE, IP Storage/iSCSI,SATAiSCSI,SATA..)..)–– IntegrateIntegrate (Blades, Management Tools..)(Blades, Management Tools..)–– ConvergeConverge Computing w Web 2.0/IP Telecom InfrastructureComputing w Web 2.0/IP Telecom Infrastructure–– VirtualizeVirtualize (Infrastructure(Infrastructure--uP,ServersuP,Servers, Storage, , Storage, Networks,ClientsNetworks,Clients

w P2V tools)w P2V tools)–– AutomateAutomate (Provide important Apps required resources (Provide important Apps required resources

automatically w/o intervention to automatically w/o intervention to OOPEX costs)PEX costs)

Page 22: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Summary Implementing New DC

•• Create VZ Justification: TCO Reduction of 60Create VZ Justification: TCO Reduction of 60--70% 70% over 3 years, ROI >58%over 3 years, ROI >58%–– Combined with VZ, Consolidation can reduce cost by 70%Combined with VZ, Consolidation can reduce cost by 70%–– Key advantages: Increased utilization, HA/BC/DRKey advantages: Increased utilization, HA/BC/DR

•• Focus Focus –– Focus on IT Services and not IT Resources or Focus on IT Services and not IT Resources or

InfrastructureInfrastructure

–– Keep an eye on Rise of Cloud Computing / SaaS, SOA Keep an eye on Rise of Cloud Computing / SaaS, SOA

Page 23: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

Summary Implementing New DC

•• Issues to be ResolvedIssues to be Resolved–– VMs exploding VMs exploding –– Managing them a nightmareManaging them a nightmare

–– Database Performance Database Performance

–– SecuritySecurity

•• Follow Virtualization in 3 phasesFollow Virtualization in 3 phases–– Consolidation & Resource Sharing Consolidation & Resource Sharing

HA/BC/DR, Workload Balancing HA/BC/DR, Workload Balancing

Automation. Consolidate through VZ and Workload Management, Automation. Consolidate through VZ and Workload Management,

–– Reduce # systems Footprints & OS instances Reduce # systems Footprints & OS instances

(Reduces OS Licensing Costs, Reduces Mgmt Admin Costs)(Reduces OS Licensing Costs, Reduces Mgmt Admin Costs)

–– Create Workload Mgmt based on Business Policies Create Workload Mgmt based on Business Policies

Mission Critical, & DB WorkloadsMission Critical, & DB Workloads……

Page 24: The New Data Center Consolidated, Converged, Virtualized ... 2008 Keynote (may08).pdf · Data Center Cooling Computer Simulation using widely available software (e.g. Fluent Airpack

© 2008 IMEX Research All Rights Reserved Copying Prohibited

IMEXRESEARCH.COM

The New Data CenterConsolidated, Converged, Consolidated, Converged, Virtualized & AutomatedVirtualized & Automated

Anil VasudevaPresident & Chief [email protected]

© 2007-08 IMEX ResearchAll Rights Reserved

Copying ProhibitedPlease write to IMEX for authorization

IMEXRESEARCH.COM