Confidential – © 2015 Equinix Inc. Equinix.com 1

Intra and Inter DCI Optical Network Infrastructure Challenges:

Requirements, Solutions and Services from a Multi-Tenant DC Provider

Perspective Mohan Rao Lingampalli,

Senior Manager, Optical Network Architecture

29-30th June 2016 Acropolis, Nice

Confidential – © 2015 Equinix Inc. Equinix.com 2

AGENDA

• EQUINIX DATA CENTERS, NETWORKS, AND INTERCONNECTION SERVICES

• INTRA-DATA CENTER OPTICAL INTERCONNECTS • INTER-DATA CENTER OPTICAL INTERCONNECT • ROLE OF OPTICAL LAYER SDN

Confidential – © 2015 Equinix Inc. Equinix.com 3

Equinix Data Centers, Networks, and Interconnection Services

Confidential – © 2015 Equinix Inc. Equinix.com 4

EQUINIX IS THE HOME OF INTERCONNECTED CLOUD  

40 Global Markets

145+ Facilities 1,150+

Networks

500+ Clouds

170,000+ Cross-

Connects

99.999%+ Uptime

Confidential – © 2015 Equinix Inc. Equinix.com 5

EQUINIX INTERCONNECTION SERVICES • THE DEMAND…

–  1150+ Network service providers serving enterprises

• SUPPLY… –  500+ Cloud service providers (Google, AWS,

Azure etc.)

• INTERCONNECTION EXPERIENCE… – Operate the world’s largest Internet exchange

business –  170,000 Fiber cross connects and few

thousand metro connects

• GLOBAL FOOTPRINT… – Cloud Exchange available in 21 Markets –  Internet Exchanges available in 19 Markets

NSP CSP Enterprise

Internet Exchange

Metro Connect Cloud

Exchange

Fiber Cross Connects

6

Intra-Data Center Optical Interconnects

Confidential – © 2015 Equinix Inc. Equinix.com 7

INTRA-DATA CENTER OPTICAL INTERCONNECTS

170,000+ fiber cross-connects globally

Fiber cross-connect services for customers and infrastructure

6” to 24” overhead fiber tray infrastructure

Single-mode and multi-mode fibers

Direct connections and via Equinix infrastructure cages

Optics for interconnects resides on client equipment

Confidential – © 2015 Equinix Inc. Equinix.com 8

INTRA DATA CENTER OPTICAL INTERCONNECTS

• OPEN STANDARDS • COST-EFFECTIVE • THIRD PARTY OPTICS FOR LAYER 2 AND LAYER 3 CLIENT EQUIPMENT

• SMF OPTICS: INTER CAGE • MMF OPTICS: INTRA CAGE (INTER SWITCH TRUNKS) • 10G-BASE-LR, 40G-BASE-LR4, AND 100G-BASE-LR4 • HIGHER DENSE QSFP+ (40G) AND QSFP28 (100G) • 400GE AND 1 TBE INTERCONNECTS IN 2018+

Requirements

9

Inter-Data Center Optical Interconnects

10

EQUINIX INTER DATA CENTER OPTICAL NETWORKS

• METRO CONNECT – Carrier grade metro optical transport

networks interconnecting Data Centers – Metro Connect services (1GE/10GE/

100GE) and transport backhaul for Equinix Interconnect services (CX and IX)

–  Built-in optical switch or electrical switch based automatic protection

• HIGH NETWORK PERFORMANCE –  Low latency –  50 ms Automatic protection for services –  Five nines availability

Metro Connect Network Infrastructure

Content Providers 500+ Providers

Dense Metro Connect Capacity: ~ 10 – 20 Tb/s

Diverse Metro-wide Dark Fiber Ring

Enterprises

Networks 1150+ Networks

100% of Tier 1 Network Routes

DC1

DC2

DC3

DC4

11

INTER DATA CENTER OPTICAL INTERCONNECTS

• INTRA CAMPUS NETWORKS – SMF only – Same optics interfaces as for intra data center

• INTER DATA CENTER METRO NETWORKS – Compact low power Data Center Interconnect (DCI) platforms – 300 Km reach high capacity (10 -20 Tb/s) optical systems – 100G/200G waves going to 400G/500G/1Tb/s Super-Channels – Cost effective, high density platforms – Simple photonics and ease of management – Open APIs for SDN control and integration – Low cost client optics for hand-off from optical platforms – Dark fiber direct connects with 40 Km/80 Km optics

Requirements

12

DATA CENTER INTERCONNECTIONS ON SUBMARINE CABLES

• NEW SUBMARINE CABLE OWNERSHIP –  Content / cloud providers and private ownership of dark

fibers and/or spectrum –  Private network traffic (DC to DC)

•  Content localisation / Edge caching •  Distribution of data centers on different continents

• OPEN SUBMARINE CABLE OWNERSHIP MODEL –  Submarine Line Terminating Equipment (SLTE) and wet

plant vendor separation –  Advances in line termination technologies –  Faster SLTE technology refreshments

• SUBMARINE CABLE TERMINATION AT DATA CENTERS –  Faster deployment –  Open access and net neutrality

Trans-Atlantic Capacity Used by Source 2010 - 2014

13

DATA CENTERS FOR SUBMARINE CABLE TERMINATION •  COLOCATION SPACE AND

POWER –  Colocation for SLTE, Power Feed

Equipment (PFE) (option based on distance to beach) and EMS

–  Purpose built to meet PFE high power circuit requirements

–  Conditioned DC power options for SLTE

•  INTERCONNECTIONS TO CUSTOMERS –  Fiber Cross-connects –  Connections to cloud, content, and

carriers

•  OPERATIONS AND MAINTENANCE SUPPORT –  On-site electrical & mechanical

engineers –  24x7x365 operations support –  Optional services like spares

management –  Shared support overhead

structure between many tenants rather than dedicated O&M staff at traditional CLS

14

TRADITIONAL CABLE LANDING STATION

Wet Plant

City POPs

Networks

SLTE

PFE

Terrestrial Back-haul Fiber

XCs TLTE

TLTE

CLS

•  CHALLENGES –  Provisioning complexity and delays

coordinating with back-haul providers –  Lower resiliency due to less architectural

flexibility and “future proofing” due to back-haul provider dependencies

–  Submarine system vendor lock-in with closed system for wet and dry plant equipment leading to slower technological developments for capacity upgrades

–  Limited back-haul connection providers to Metro POPs with higher backhaul costs and increased latency

–  Cost/complexity of managing cable landing station (CLS) and city POP infrastructure

15

INTEGRATED CLS AND COASTAL DC FOR TRANSOCEANIC DATA CENTER INTERCONNECTION

Networks

SLTE

PFE

Fiber XCs Wet Plant

Clouds

Content

Subsea Fiber Pairs

Power and Ocean Ground Cables

16

Role of Optical Layer SDN

17 17

NIKESH KALRA

MULTI-LAYER SDN FRAMEWORK

SDN Control Layer

NETCONF/YANG

Service APIs

NETCONF | CLI | SNMP

Network Abstraction Layer Controller Mediation

Network Devices Layer

18

OPTICAL LAYER SDN USE CASE 1

• Dynamic Optical Transport –  Enables Distributed Data Center

Fabric in metro area –  Low Latency – High Availability – Ubiquity

• Benefits – Common Service and Network

Infrastructure –  L0 to L7 Services – OSS/BSS – NFV Integration

Distributed Data Centers

Service Platform

10GE/40GE/100GE

DC1

Optical Transport

DC2

Optical Transport

Network Abstraction Layer Controller Mediation

DWDM Service Platform

19

OPTICAL LAYER SDN USE CASE 2

• End to End Service Provisioning –  Provisioned Across Multiple

Vendors At The Same Layer –  End To End Resource Visibility – Route Traffic Based On Capacity

And Topology

• Benefits –  Tighter Integration With Higher

Layer Services – Operational Simplicity For Multi-

layer Networks –  Eliminates Multi-segment Circuit

Provisioning –  Avoid Congested Links

Transport Service Provisioning on Multi-Vendor Networks

Network Abstraction Layer Controller Mediation

DC1

DWDM Vendor 1

DC4

DWDM Vendor 1

10GE Metro Connect Circuit from DC1 to DC4

DC2

DWDM Vendor 2

Working Path

Diverse Protect Path

DC3

DWDM Vendor 2

DWDM Vendor 1

DWDM Vendor 1

10G Waves

100G Waves

DC2 DC3

Confidential – © 2015 Equinix Inc. Equinix.com 20