Data Center Standards RoundupData Center Standards Roundup—

BICSI TIA CENELEC ISOBICSI, TIA, CENELEC, ISO

Steve Kepekci, RCDD

Introduction

• Regardless of business activity or sizeRegardless of business activity or size,all information technology (IT) groups have similar needssimilar needs– Provide secure, uninterrupted availabilityto local and remote resourcesto local and remote resources

• Computing

• Storageg

• Networking

• Telecommunications circuits

Introduction (cont’d)

• Organizations driven by heavy use of bothOrganizations driven by heavy use of both existing and new IT resources require:– Uninterrupted network availability– Uninterrupted network availability

– Rapid provisioning and reconfiguration capabilities

Strong capital and operational cost management– Strong capital and operational cost management

Introduction (cont’d)

• The impact on data center networkThe impact on data center networkphysical‐layer connectivity?– There has never been a greater need for:– There has never been a greater need for:

• Performance

• DensityDensity

• Flexibility

• Manageability

Typical data center network architecturearchitecture

Servers

Switches Storage directors

Disk arraysDisk arrays

Management consoles

Multiple applications sharing the same data center networksame data center network 

• Traditional dataTraditional data

• Voice• Voice

A di / Vid• Audio / Video

• Security / Life safety

• Building / Facilities management

Simultaneous network traffic flows within each applicationwithin each application

• Application flowsApplication flows

• Storage flows• Storage flows

S i fl• Security flows

• Diagnostics and management flows

Network performanceand connectivityand connectivity

• Data center network infrastructureData center network infrastructure– Gigabit Ethernet (802.3z‐1998, 802.3ab‐1999)

10 Gigabit Ethernet (802 3ae 2002 802 3an 2006)– 10 Gigabit Ethernet (802.3ae‐2002, 802.3an‐2006)

– 40/100 Gigabit Ethernet (802.3ba‐2010)

E Effi i t Eth t (802 3 2010)– Energy Efficient Ethernet (802.3az‐2010)

• Data center connecti it infrastr ct re• Data center connectivity infrastructure– Balanced (copper) cabling channels

– Optical fibre cabling channels

Available topologiesp g• Top‐of‐rack switching

All it h f bi t l d i th bi t– All switches for a server cabinet placed in the server cabinet

• End‐of‐row / In‐row switchingAll switches for a row of server cabinets placed in a cabinet– All switches for a row of server cabinets placed in a cabinetat the end / within the row

• Centralized switchingCentralized switching– All switches for all rows of server cabinets grouped together

• Centralized switching and cross‐connecte a ed s c g a d c oss co ec– All server and switch ports in the computer roomaccessible from one patching field

Top‐of‐rack switchingp g

Fibre patch panelFibre cable to core switch

SwitchFibre patch cord

Copper patch cords

Servers

End‐of‐row switchingg

Fibre cable to

Copper patch panels

Fibre cable to core switch

panels

Fibre patch panel

Servers

Switches

panel

In‐row switchingg

Fibre cable to core switch

Copper patch

Fibre t hpatch 

panelspatch panel

Servers

Switches

Centralized switchingg

CopperCopper patch panels

Copper patch panels

Servers

Switches

Centralized switchingand cross‐connectand cross connect

Copper patch panels

Copper patch panels

Servers

SwitchesSwitches

Copper patch panels for centralized cross‐connect

How cabling installationaffects performanceaffects performance

How cabling administrationaffects performanceaffects performance

What do the standards say?yANSI/TIA‐606‐A‐1 (2008)

Addendum 1 — Administration of d

ANSI/TIA‐942 (2005) ATelecommunications

f d d f

ANSI/TIA 942 Add d 1 (2008)

Equipment Rooms and Data Center Computer Rooms

20 pages

Infrastructure Standard forData Centers135 pages

ASHRAE TC9.9 (2009)ANSI/TIA‐942 Addendum 1 (2008)

Data Center Coaxial Cabling Specifications and Application Distances

ANSI/TIA 942 Addendum 2 (2010) ISO/IEC 24764 (2010)

( )Thermal Guidelines for Data Processing 

Environments, 2nd Edition58 pages

ANSI/TIA‐942 Addendum 2 (2010)Additional Media and Guidelines for

Data Centers

ISO/IEC 24764 (2010)Information Technology – Generic Cabling 

Systems for Data Centres44 pages

ANSI/BICSI‐002 (2011)Data Center Design and Implementation

Best Practices350+ pages

CENELEC EN 50173‐5 (2007)Information Technology – Generic Cabling 

Systems — Part 5: Data Centres32 pages

Comparing the standards —CENELEC vs ISOCENELEC vs. ISO

• Nearly identical in content, same chapter titlesy , p– Structure of the generic cabling system

– Channel performance

– Reference implementations

– Cable requirements

– Connecting hardware requirements

– Requirements for cords and jumpers

A A Li k f li it– Annex A: Link performance limits

• Annex B in CENELEC EN 50173‐5– Channel insertion loss models for high bit rate, multimode, optical fibre applicationsChannel insertion loss models for high bit rate, multimode, optical fibre applications

• Annex B in ISO/IEC 24764– Usage of high density connecting hardware within optical fibre cabling

Comparing the standards —TIA contentTIA content

• TIA‐942 chapter titlesData center design overview– Data center design overview

– Data center cabling system infrastructure

– Data center telecommunications spaces & related topologies

– Data center cabling systemsg y

– Data center cabling pathways

– Data center redundancy

• TIA 942 annex titles• TIA‐942 annex titles– Cabling design considerations

– Telecommunications infrastructure administration

Access provider information– Access provider information

– Coordination of equipment plans with other engineers

– Data center space considerations

– Site selection

– Data center infrastructure tiers

– Data center design examples

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

ENI = external network interfaceMD = main distributorZD di t ib t

LDP = local distribution point (optional)EO = equipment outletEQP i tZD = zone distributor EQP = equipment

Comparing the standards —CENELEC / ISO vs TIA — Terminology

equivalent to ENI

CENELEC / ISO vs. TIA  Terminology

Comparing the standards —CENELEC / ISO vs TIA — Terminology

equivalent to network access cabling subsystem

CENELEC / ISO vs. TIA  Terminologyequivalent to ENIequivalent to network access cabling subsystem

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

equivalent to network access cabling subsystem

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystem

equivalent to main distribution

equivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

cabling subsystem

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystemequivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

equivalent to main distribution

Horizontal Cross-connect, equivalent to ZD

cabling subsystem

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystemequivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

equivalent to main distributioncabling subsystem

Horizontal Cross-connect, equivalent to ZD

equivalent to zone distribution cabling subsystem

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystemequivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

equivalent to main distributioncabling subsystem

Horizontal Cross-connect, equivalent to ZD

Optional zone outletor consolidation point

equivalent to zone distribution cabling subsystem

or consolidation point,equivalent to LDP

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystemequivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

equivalent to main distributioncabling subsystem

Horizontal Cross-connect, equivalent to ZD

equivalent to zone distribution cabling subsystem

Optional zone outletor consolidation point

equivalent to EO

or consolidation point,equivalent to LDP

Comparing the standards —CENELEC / ISO vs TIA — TerminologyCENELEC / ISO vs. TIA  Terminology

equivalent to ENIequivalent to network access cabling subsystemequivalent to network access cabling subsystem

Main Cross-connect, equivalent to MD

equivalent to main distributioncabling subsystem

Horizontal Cross-connect, equivalent to ZD

equivalent to zone distribution cabling subsystem

Optional zone outletor consolidation point

equivalent to EQP

or consolidation point,equivalent to LDP

equivalent to EO

Comparing the standards —BICSI contentBICSI content

• BICSI‐002 chapter titles– Space planningp p g

– Site selection

– Architectural

– Structural

– Electrical systems

– Mechanical

– Fire protection

Security– Security

– Building automation systems

– Telecommunications

– Information technologyf gy

– Commissioning

– Data center maintenance

• BICSI‐002 annex titles– Design process

– Reliability and availability

Comparing the standards —TIA vs BICSI — TerminologyTIA vs. BICSI  Terminology

• TIA‐942 defines data center infrastructure TiersTi 1 B i– Tier 1: Basic

– Tier 2: Redundant Components

– Tier 3: Concurrently MaintainableTier 3: Concurrently Maintainable

– Tier 4: Fault Tolerant

• BICSI‐002 defines data center Availability ClassesBICSI 002 defines data center Availability Classes– Class F0: No supplemental equipment

– Class F1: Some supplemental equipment

– Class F2: Critical component redundancy

– Class F3: Critical and noncritical component redundancy

– Class F4: System redundancy with componentredundancy

Comparing the standards —BICSI‐002 Availability ClassesBICSI 002 Availability Classes

Annual allowable maintenance hours

00 00 00 0 99 0 9 0> 400 100‐400 50‐99 0‐49 0

Enterprise‐wide

Class F1 Class F2 Class F3 Class F4 Class F4

Multi‐regional

Class F1 Class F2 Class F3 Class F3 Class F4

Regional Class F1 Class F2 Class F2 Class F3 Class F3Regional Class F1 Class F2 Class F2 Class F3 Class F3

Local Class F0 Class F1 Class F2 Class F3 Class F3

Sub‐local Class F0 Class F0 Class F1 Class F2 Class F2

Data Center Standards RoundupData Center Standards Roundup—

BICSI TIA CENELEC ISOBICSI, TIA, CENELEC, ISO

Steve Kepekci, RCDD