VMWorld 2014 - Scaling Your SDDC Network

Scaling Your SDDC Network:Building a Highly Scalable SDDC Infrastructure with Advanced Physical Network Architectures &

VMware NSX

Phillip CoatesSystems Engineering Manager ANZBrocade Communications Systems, Inc.

Evolution of datacenter architectures

© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC 2

Phase 1:

3-tier Architectures

Co

reA

gg

Acc

ess

Phase 2:

Scale-out Architectures

Le

af

/ S

pin

eC

ore

Scale Out

Phase 3:

Advanced Scale-out Architectures+

Overlay Networking

10G

DC POD N Edge Services POD

SUPER SPINE

BORDER LEAF

WAN EDGE

INTERNET DC INTERCONNECT

DC POD 1

SPINE

LEAF

• Brocade provides choices for building reliable and scalable underlay networks for the VMware SDDC

• Brocade VDX switches are easy to deploy and manage

• Brocade VDX gateway provides a highly resilient and easy to manage Hardware VTEP gateway for VMware NSX

• Integration with VMware vRealize in Brocade VDX switches provides visibility and monitoring for the network

© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. 3

VMware and Brocade – “Better Together”


Physical network architectures for the

SDDC

Logical networking with VMware NSX

Agenda

Provisioning, automation and

visibility/monitoring

Learning from massive scale deployments


Source: https://code.facebook.com/posts/360346274145943/introducing-data-center-fabric-the-next-generation-facebook-data-center-network/

https://code.facebook.com/posts/360346274145943/introducing-data-center-fabric-the-next-generation-facebook-data-center-network/

Clos Concepts: L2 Clos network with Brocade VDX


L2 Links

SPINE

LEAF

• Manage all fabric switches as a single logical device

• No blocking links and no need for Spanning Tree

• Multipathing at layers 1 to 3

• Zero-touch provisioning & Self-forming trunks

TRILL-based Ethernet fabric

Clos Concepts: L3 Clos network with Brocade VDX


L3 Links

SPINE

LEAF

• Zero-touch provisioning and deployment mechanisms (standards based)

‒ DHCP and TFTP

• Management through Netconf/REST and DevOps integration

• Layer 2 Extension mechanisms through native VXLAN support

IP Routing protocols like BGP and OSPF

Choices for datacenter infrastructure


L3 Clos

• Smaller team to manage the infrastructure

• Embedded automation required for OpExsavings

• Larger team to manage the infrastructure

• Tool chains in place for automation and orchestration

• Network infrastructure scalable to very large deployments

L2 Clos with Brocade VCS L3 Clos with Brocade VDX

Both VCS and L3 Clos deployments use the same VDX hardware and Brocade NOS software!


Building scalable physical networks

L2 Clos based architectures

Building Blocks: Datacenter POD physical architecture (3-Stage folded Clos)


L2 Clos with Single or dual homed servers

L2 Links

VCS

Fabric

SPINE

LEAF

Servers/Blades

10G

Servers/Blades

10G

Servers/Blades

10G

Compute Racks

Controller

Management SW IP Storage

10G

Management/Infrastructure Racks

Building Blocks: Edge services POD physical architecture


VCS

Fabric

BORDER LEAF

Servers/Blades

10G

Edge Racks

Load Balancer

10G

Firewall

SW RouterSW VPN

SW Firewall

Single or dual-homed edge service devices

L2 Links

L2 Clos based Datacenter Site(3-stage folded Clos)


SPINE

LEAF

10G 10G 10G 10G

Compute and Infrastructure/Management Racks Edge Racks

10G 10G

BORDER LEAF


L2 Links

WAN EDGE

DC POD Edge Services POD

VCS

Fabric

VCS

Fabric

Multi-fabric VCS physical architecture for DC Site(5-stage folded Clos)


BORDER LEAFSPINE

LEAF

VCS

Fabric

10G 10G

10G

VCS

Fabric

10G 10G 10G

DC POD N


Edge Services POD

SUPER SPINE

WAN EDGE


L2 Links

L3 Links

10G

VCS

Fabric

10G 10G 10G

DC POD 1

Compute and Infrastructure/Management Racks

SPINE

LEAF

L2 Extension between DC Pods for vMotion, Virtual SAN, Fault Tolerance


BORDER LEAFSPINE

LEAF

10G

VCS

Fabric

10G 10G 10G

DC POD N

SPINE

LEAF

VCS

Fabric

10G 10G

10G

VCS

Fabric

10G 10G 10G

DC POD 1

Compute and Infrastructure/Management Racks Compute and Infrastructure/Management Racks Edge Racks

Edge Services POD

SUPER SPINE

WAN EDGE


40G

L2 Links

L3 Links

VXLAN


Building scalable physical networks

L3 Clos architectures

L3 Clos based Datacenter Site(3-stage folded Clos)


SPINE

LEAF

10G 10G 10G 10G


10G 10G

BORDER LEAF

INTERNET DC INTERCONNECTL2 Links

L3 Links

WAN EDGE

DC POD Edge Services POD

Multi-fabric VCS and L3 Clos hybrid architecture(5-stage folded Clos)


10G 10G

10G 10G 10G 10G

DC POD N

SPINE

LEAF


Edge Services POD

SUPER SPINE

BORDER LEAF

WAN EDGE


L2 Links

L3 Links

10G 10G 10G 10G

DC POD 1

Compute and Infrastructure/Management Racks

L3 Clos



SDDC


Agenda




NSX Components in the physical network

Servers/Blades

10G

SPINE

LEAF

Servers/Blades

10G

IP Storage

10G

Compute RacksManagement Rack Infrastructure Rack

Data Center Pod

NSX vSwitch


NSX Components in the physical networkEdge Services Pod

BORDER LEAF

Servers/Blades

10G

Edge Racks

Load Balancer

10G

Firewall

Routed Traffic flows in the network (Distributed Routing)


SPINE

LEAF

10G 10G

DC POD N

SPINE

LEAF

DC POD 1

Infrastructure Racks Edge Racks

Edge Services POD

SUPER SPINE

BORDER LEAF

WAN EDGE

DC INTERCONNECT

INTRANET

Compute RacksCompute Racks

East West Routed Traffic

North South Traffic

VM1 VM2

Infrastructure RackCompute Rack

Load Balancer

10G

Firewall

Brocade VDX Gateway

VM3


NSX Hardware VTEP integration

Brocade VDX Gateway

• High-performance VXLAN gateway (line-rate bridging)

• Full integration with VMware NSX

• Logical chassis: Single entity of management through NSX

• Resilient logical gateway: VTEP resides on all the switches. Stateful redundant g/w.

VXLAN

Compute Rack

Virtualized Workloads

Brocade VDX Gateway for

VMware NSX

Servers/Blades

10G

Physical Workloads

VCS

Fabric

SPINE

LEAF

VLAN 10G

VTEP = VIRTUAL TUNNEL END POINT



SDDC


Agenda



Auto Provisioning

© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC. INTERNAL USE ONLY 24

L2 Links

VCS

Fabric

SPINE

LEAF

Servers/Blades

10G

Servers/Blades

10G

Servers/Blades

10G

Compute Clusters

Increasing cluster capacity in L2 Clos Topology

Servers/Blades

10G

Cluster A

VM3VM1 VM2 VM4

1. Auto-Fabric Deployment

2. ESXi host auto deployment and configuration*

3. Automatic cluster inclusion and NSX Host Preparation

4. DRS balances the cluster

*LACP Configuration may be pushed after new switches are part of VCS Fabric

Auto Provisioning

25

L3 Links

Servers/Blades

10G

Servers/Blades

10G

Servers/Blades

10G

Compute Clusters

Increasing cluster capacity in L3 Clos Topology

Servers/Blades

10G

Cluster A

VM3VM1 VM2 VM4

1. Auto-Provisioning

2. ESXi host auto deployment and configuration

3. Automatic cluster inclusion and NSX Host Preparation

4. DRS balances the cluster

DRS = Dynamic Resource Scheduling

Auto Provisioning for VDX in L3 Clos


DH

CP

Re

qu

est

DH

CP

Re

spo

nse

w/

Op

tio

ns

Imag

e/C

on

fig

ura

tio

n L

oca

tio

n

SF

TP

/TF

TP

Re

qu

est

Im

ag

e/C

on

fig

ura

tio

n

SW Image

Configuration

1

2

34

5

6

Reloads w/ New

7

8Ready

Imag

e &

Co

nfig

ura

tio

n d

ow

nlo

ad

TFTP Server

DHCP Server

DHCP Mapping

Automation

Engine

BGP

Profile Templates

Datacenter automation tools

Brocade Vyatta Controller (ODL based controller)

REST API/NETCONF/YANG Model

Python Neutron ML2 PlugIn


Puppet integration

Analytics Packs for vRealize OperationsGreater visibility and actionable analytics

© 2015 BROCADE COMMUNICATIONS SYSTEMS, INC.

Intelligent Network Operations

Unified Virtual & Physical Networking

Simplified Policy Automation

Go to Brocade G13 booth to see vRealize Operations and VDX integration

Content Pack for vRealize Log InsightAccelerate troubleshooting with actionable analytics


Powerful Filtering Capabilities

Simplifies Root-Cause Analysis

Unified Management


Summary

• Brocade provides choices for building reliable and scalable underlay networks for the VMware SDDC

• Brocade VDX switches are easy to deploy and manage

• Brocade VDX gateway provides a highly resilient and easy to manage Hardware VTEP gateway for VMware NSX

• Integration with VMware vRealize in Brocade VDX switches provides visibility and monitoring for the network


VMware and Brocade – “Better Together”

Key takeaways

• Reviewed choices provided by Brocade in the underlay architecture

• Reviewed scalable and fault resilient model for VMware NSX

• Reviewed automation and deployment mechanisms

• Brocade and VMware – “BETTER TOGETHER”


33

• Brocade and VMware alliance page:

http://www.brocade.com/en/partners/alliances/vmware.html

• Configuration guide for Brocade Hardware VTEP:

http://www.brocade.com/content/html/en/configuration-guide/nos-601-l2guide/GUID-773FF857-F62D-4A4A-89AA-B2301BF3ED8E.html

• Deployment guide for NSX with Brocade VCS:

http://www.brocade.com/downloads/documents/html_product_manuals/brocade-vcs-gateway-vmware-dp/index.html

• Brocade VCS Gateway and VMware NSX Video on Demand (VoD):

https://www.youtube.com/watch?v=khjBszMoM9s


More information

http://www.brocade.com/en/partners/alliances/vmware.html

http://www.brocade.com/content/html/en/configuration-guide/nos-601-l2guide/GUID-773FF857-F62D-4A4A-89AA-B2301BF3ED8E.html

http://www.brocade.com/downloads/documents/html_product_manuals/brocade-vcs-gateway-vmware-dp/index.html

https://www.youtube.com/watch?v=khjBszMoM9s

Documents

VMWorld 2014 - Scaling Your SDDC Network