Service Oriented Data Center (SODC)

1© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public

Service Oriented Data Center(SODC)

Sidney MorganManager, IT


Agenda

IT Goals

Cisco Current Data Center View

Q & A

Technology Areas of Focus

Service Oriented Data Center


Cisco IT Goals

Enable Cisco Business Strategy• Deliver services rapidly using an on-

demand utility computing model

Drive Productivity• Drive automation by removing the

complexity out of the Infrastructure

Showcase Cisco Technology• Share Cisco’s IT experience with

Customers


Cisco Data Center Goals

Optimize TCO• Consolidate Data Centers

• Life Cycle Management

• Data Center Standards

Business Agility• On Demand Utility

• Rapid Delivery of Services

• Enabler of Business Goals

Business Continuance• Security

• Active-Active Architecture

• Virtual OS and Application Layers


Current Data Center Overview


Cisco Production Data Centers

SJ-12SJ-CLinksys

RTP 5

Amsterdam

Sydney

Production Data CenterData Centers Development Data Center


Cisco Data Center Trends

FutureTodayStandards Based EnvironmentHeterogeneous Environment

Rigid User Environment Flexible User Environment

Self-Defending Data CenterApplication Specific Security

Intelligent Network ServicesMulti-Services Network

Network Virtualized StorageSAN and NAS Storage

Dynamic Compute ResourcesDedicated Compute Resources

Policy Based ManagementApplication Specific Management


Cisco Data Center Landscape

• Overall population of 7,000 servers

• Cisco currently has one SA for every 80 servers

• Server environment and ratio will continue to grow

• Heterogeneous environment with multiple hardware vendors

• Multiple OS environments

Solaris 2,52636%

Windows1,756 25%

Linux 2,538 37%

HPUX166 2%

Source: Cisco IT, October 2005


Cisco Data Center Storage Landscape

• Currently, Cisco IT supports nearly 3.9 PB of “raw” storage

• Roughly split between SAN (EMC) and NAS (NetApp)

• Growth Rates: FY’02=69%, FY’03=32%, FY’04=28%, FY’05=86%

• Managed storage per FTE (constant): ~200 TB

0

500

1000

1500

2000

2500

FY'01 FY'02 FY'03 FY'04 FY'05

DAS

NAS

SAN


Service Oriented Data CenterOverview


Service Oriented Data Center (SODC)

ServiceOriented

Data CenterVision

Vision EnablersSoftwareTechnology

BusinessProcessesPeople Hardware

Technology

SODC Target StateA Highly Automated, Services Based, Secure, Virtual Environment Where Resources Are Allocated Through an Intelligent Network Fabric Founded on Structured Policies That Enable Tight Alignment With Cisco’s Business Goals


Service Oriented Data Center Roadmap

20052004 2006 2008

• Infrastructure Consolidation

• SAN Virtualization

• Centralized Resources

• OS• Improve

Utilization• Centralize DC

• Infrastructure aligned to BU

• Storage Silos• Manual Patches• Heterogeneous

OS• Low Utilization• Element

Management• Distributed DC

• Infrastructure aligned to application

• Active SAN/NAS Virtualization

• Virtual• Common OS• Automated

Purposing• Fabric

Management

• Infrastructure aligned to Service

• Automated Application

• Policy Based• Utility model• Policy Based

Management• Self Purposing• Optimized TCO

LegacyData Center

VirtualData Center

Service OrientedData Center

CurrentData Center

Consolidation Phase Virtualization Phase Automation Phase


Service Oriented Data Center Model

SODC Utility Pool

SODC

Demand

Supply

Business Goals

SODC Intelligent

Management Fabric

(IME/VFrame 4.0)

SODC Vision:• Highly Automated Virtual

Environment

Main Objectives:• Drive Productivity• Enable Cisco Business• Optimize TCO• Show case Cisco

Main Requirements:• Availability• Scalability• Flexibility• Business Continuance• Security


Physical SODC Architecture

Site Backbone Router

Data Center Distribution GW

Access Switches

Blade Server with Cisco SFS Module or Ethernet Switch

MDS9509

SANStorage

NASGateways

1RU Servers

A1 2

A1 2

A1 2

FibreChannel

6500 Series

65xx

FibreChannel

MDS9509

iSCSI

iSCSI

Intelligent SAN withVirtualization,Replication,Serverless BackupFCIP SAN Extension

A

12

A1 2

Backup Master Server(s)

Backup Media Server(s)TapeLibrary

NAS Filer(s)

Shared Network Services (CSM, SSL, FWSM, AONS)

6500 Series

6500 Series


Service Oriented Data CenterSystems


SODC Systems Architecture Summary

• Data Center PODs are a way to reduce TCO by reducing cost and complexity in Data Center server environments

• Data Center PODs will improved productivity and agility to respond to the business environment

• Cisco is working to Standardizeon commodity server racks and Blade Technology

• Cisco is committed to maximize ROI on the infrastructure investment in the Data Center


Logical SODC Systems Architecture

Current StateMultiple Managed Environments

Future StateSingle Managed Environment

Inconsistent Processes (Automated And Manual) And Silo’d Physical Infrastructures

Consistent AutomatedProcesses

11i

EIR

CCI/CCX

SODCVirtualization


SODC Systems Purposing

• Specific resources selected from pools• VLANs are configured• Macros are played• SAN is zoned• Servers get booted with assigned image• Application(s) are started• Traffic into logical network turned “on”

Phys

ical

PO

DVi

rtua

l PO

D


Physical SODC Systems ArchitectureData Center Distribution GW

Shared Network Services (CSM, SSL, FWSM, AONS)

SODC Service POD

Data Center Distribution GW

6500Series

10 Gig10 Gig

30 1RU 30 1RU 30 1RU 30 1RUCAT 4948 CAT 4948

CAT 4948 Out of Band

Management

CAT 4948 Out of Band

Management

CAT 4948 CAT 4948

6500Series

6500Series

6500Series


Service Oriented Data CenterVirtualization


SODC Virtualization Architecture Summary

• Virtual Environments provide ServicesClients consume ServicesVirtual Environments consume physical infrastructureService Level Objectives determine Virtual Environments (performance and availability)

• Virtual Environments can consume different numbers of resources

Storage, Processor, Network, Databases, ApplicationsMultiple physical servers (scale-out or high availability) “Transparent Workload Distribution”A fraction of a single server (Software Partitioning, Emulation) “VMware, Xen, and Server Virtual Partitioning”

• Virtual Environments will optimize over timeChanges are transparent to clientsPerformance and availability requirements are achievedThe efficiency of the environment is increased dramatically


Logical SODC Virtual Architecture

SOD

C M

anag

emen

t Fab

ric

SOD

C M

anag

emen

t Fab

ric

Storage Architecture

Intelligent Network Fabric

Physical Data Center

Operating System Architecture

Business Application Services

Infrastructure Services

OS Workflow Management


SODC Virtualization Vision

SODC Management

Fabric

Server Fabric

Network Fabric

Storage Fabric

Applications

Security

Security

Security

Security

Security

SODC FabricResources• Processor

Virtualization

• Storage Virtualization

• Network Virtualization

• Shared Services Virtualization

• File Virtualization


SODC Virtual Environment

Defines:

• Everything required for complete/correct operation

• Everything needed for optimal resource selection

Includes:

• References to the O.S. and application images

• Service Level Objectives including high availability and performance objectives

• Dependencies on other entities; for example:Storage and Network (connectivity and locality)

Processors (utility grid)

Infrastructure Services (Databases)


SODC Infrastructure Virtualization

WANMAN

Silver Servers

Platinum Servers

Bronze Servers

SilverStorage

Platinum Storage

BronzeStorage

SODC NetworkFabric

SODC, SAN, Fabric

SODC Systems FabricVFrame 4.0

IntelligentManagement

Fabric

GoldStorage

Server Virtualization

Low Latency RDMA and DAPL Services

Virtual I/O

Clustering

Grid/Utility Computing

Fabric Routing

Data Replication

Storage Virtualization

Virtual Fabrics (VSANs)

SSL TerminationVPN Termination

Firewall ServicesIntrusion Detection

Server Balancing

GoldServers

Internet


Service Oriented Data CenterNetwork


SODC Network Architecture Summary

• Enhance IP Network Security and its Integration into a Self-Defending Infrastructure

• Maximize Network Effect Multiplier for the Service Oriented Network Architecture

• Simplify, Standardize and Converge Infrastructure, Applications and Services

• Drive Autonomous and Virtual Infrastructure Architecture

• Provide Greater Business Agility for New Technologies and Applications


SODC Network Components

Services Virtualization

Automated Purposing

Routing and Switching

Low Latency Switching

Low Latency Ethernet

Integrated Security

High Availability

Application Aware


SODC n-tier Datacenter Network

Physical Logical

Web Servers

DatabaseServers

Storage

AppServersEdge

Core


SODC Network Physical Layout

• Any subnet/VLAN, any switch

• Enables L4–L7 deployments with full redundancy

• Layer 2 interfaces on gateways result in 30-second spanning-tree outages during gateway upgrade

Hosts Requiring Redundant NIC

Host Not Requiring Redundant NIC

Standby Link for Redundant Interface

SW3SW2SW1

L3 LAN CORE

1/1 1/1 3/13/1

1/2,3/2 1/2,3/2Service

Switch with CSM

Service Switch with

CSM

L3 Distribution

GW1

L3 Distribution

GW1

Access Layer (L2 STP)


SODC SFS Architecture

SODCSAN

Fabric

SODCInn

Fabric

SFS 3012 SFS 3012

10 Gig

SFS 700020 HCAHosts

CAT4948Out of Band Management20 HCA Hosts

SFS 7000

CAT4948Out of Band Management20 HCA Hosts

SFS 7000

CAT4948Out of Band

Management20 HCA Hosts

20 HCAHosts

SFS 700020 HCA

Hosts

SFS 7008 SFS 7008

10 Gig


Service Oriented Data CenterStorage


SODC Storage Architecture Summary

• Disk is relatively cheap, but storage and storage management is expensive

• Growth is still rampant; datacenter space is at a premium

• Poor storage utilization is a serious problem at Cisco, creating an enormous ROI potential

• Cisco IT is focusing on creating a consolidated storage utility using Cisco’s own end-to-end storage networking solutions

• The consolidated storage utility allows a company to significantly lower overall TCO by providing storage when needed, as needed and at appropriate service and cost levels


SODC MDS SAN Switch Benefits

Availability• More ports to support multiple paths between servers

and storage • Non-disruptive upgrades• Advanced troubleshooting and diagnostics• VSANs to segregate traffic and management

Data center crowding• Multi-protocol support allows primary storage to be

located in remote data centers

Cost reduction• SAN consolidation using VSANs to increase storage

utilization by sharing each storage frame among many servers and business units

Intelligent SAN fabric services• Virtualization, Continuous Data Protection, Replication

Improved performance• A fully non-blocking architecture• Intelligent traffic management (QoS, FC congestion

control)


SODC Storage Architecture

IP WAN

Campus/Site (1) Wide Low Latency MDS FC SAN Fabric

Cisco IP LAN

NAS Gateways

DWDM, CWDMOr Dark Fibre

Datacenter 1 Datacenter n

PLATINUM GOLD SILVER BRONZECampus/Site (n) wide low latency

MDS FC SAN Fabric

Cisco FileEngines

FCIP

Cisco FileEngines

Small RemoteSite(s)

CIFSNFS

iSCSIFCWAFS

FCIP

A minimal Number of Large, Automated, Fully Networked, Tiered Storage Pool(s) with no Physical Ties Between Hosts, Applications and Storage(i.e., Virtualized)


Service Oriented Data CenterManagement


SODC ManagementSummary

• Standardized infrastructure components (network, server and storage)

• Utility computing model

• Spare pool resource management

• On-demand service purposing of all infrastructure and application components via an automated workflow

• Automated service assurance configuration

• VFrame and IME instances perDC for localized control


SODC Management Benefits

• Manage the data center from a service-oriented perspective• Reduce the number of layers/devices required to

be purposed• Data Center infrastructure is one manageable entity of

shared virtualized resources• Expose a single orchestration and purposing interface for

all data center infrastructure• Dramatically reduce TCO through Operational Excellence


SODC Provisioning Framework

SJC-KSJC-12

Brussels

Bangalore

Amsterdam Tokyo

Richardson

Boxborough

RTP

London

Singapore

HongKong

EMAN Database

Sydney

• Globally Consistent Infrastructure• Globally Managed Infrastructure State


SODC Management ArchitectureGUI APIs (XML, SOAP, etc.)GUI APIs (XML, SOAP, etc.)Access

Role Based Administrative ControlSecurity

Application Compute Storage SecurityNetworkDomains

VirtualizationProvisioning Performance Accounting SecurityAvailabilityServices

Orchestration

Net

wor

k I/O

Virt

ualiz

atio

n

Perf

orm

ance

M

anag

emen

t

P2V

Map

ping

Rep

ortin

g

Stor

age

Virt

ualiz

atio

n

Mon

itorin

g

Logi

cal

Net

wor

ks

Dis

aste

r R

ecov

ery

Virt

ual

Mac

hine

s

Imag

e M

anag

emen

t

Boo

t Se

rvic

es

Dis

cove

ry

Serv

ices

Serv

erVi

rtua

lizat

ion

Capabilities

SFS

Catalyst 6000MDS

Cisco Platforms Cisco Modules

Rack ServersBlade ServersLinux / Windows

Catalyst (CSM, FWSM, Trinity)

MDS (IPS, SSM)

SAN

Provisioning

Security

Compute TechnologyInfiniBandEthernetFibre Channel Security

Other

LAN/WANResources


SODC ISM Integration

ISM Distributed SODCw/VFrame/IME

New Hosts and Network Device Configuration Discovery

Service Node Failover

Allocation of Spare Pool Servers for New Services

Image and Template Distribution

Service Provisioning

Service Monitoring and Alerting

Service Provisioning Applications

Monitoring, Data Collection, Change

Management

IPAM/DNS

Global Inventory, image and

template masters


Service Oriented Data CenterSecurity


SODC SecuritySummary

• End-to-end services accounting• User behavior understood• Data center modularized• Secure Compartmentalized

Information Center (SCIF)• Asset accounting• Standards and regulations

easier to support• AAA and intellectual property

data not mixed in with potentially unsecure services


Cisco Infrastructure Security Guidelines

• Develop an integrated, active security infrastructure

• Set and manage SODC security standards

• Operate at a known and acceptable level of risk

• Manage your conformance to external regulations

• Implement security governance

• Create a security-aware culture


SODC Security Architecture

Network Storage

Unix Servers w/CSA

Call Managers w/CSA

Decru Datafort

Protego/nFSyslog

Collector

NetSonarNetRanger

VPN Users

Tripwire

IP ACL and NAC

Tripwire

Tripwire

DMZ

LAN

Dial-in Users

Infra Connect

WiFi users

ACS Servers

Win Servers w/CSA


SODC Security Architecture

Wan Connection

Secure Servers

IDS

NetForensics Agent

FSMPix

Syslog Collector

NetSonar

DMZ

LAN

DC

DC

FSM

Security SCIF

Event Server

Security Stds Server

IP Server

Repository

DCSS Security Lab

VulnTest Server

CertTest Server

PolicyTest Server

AuditTest Server

KMITest Server

SecReportTest

Server


Q and A


Further Data Center Resources

http://www.cisco.com/en/US/about/ciscoitatwork/case_studies.htmlCase Studies

Operational Practices and Design Guideshttp://www.cisco.com/en/US/about/ciscoitatwork/data_center_op.htmlhttp://www.cisco.com/en/US/netsol/ns340/ns394/ns165/ns391/networking_solutions_design_guidances_list.html

Call to Get Product, Solution and Financing Information1-800-745-8308 ext 4699

Order Resourceshttp://cisco.com/en/US/ordering/index.shtml

http://www.cisco.com/en/US/about/ciscoitatwork/case_studies.html

http://www.cisco.com/en/US/about/ciscoitatwork/data_center_op.html

http://www.cisco.com/en/US/netsol/ns340/ns394/ns165/ns391/networking_solutions_design_guidances_list.html

http://www.cisco.com/en/US/netsol/ns340/ns394/ns165/ns391/networking_solutions_design_guidances_list.html

http://cisco.com/en/US/ordering/index.shtml

htmlhttp://www.cisco.com/en/US/netsol/ns340/ns394/ns165/ns391/networking_solutions_design_guidances_list.htmlCall


Documents

Service Oriented Data Center (SODC)