The Top 10 Business Reasons for 10GbE iSCSI

1© 2011 Emulex Corporation

Storage

The Top 10 Business Reasonsfor 10GbE iSCSI


Storage

Webcast House Keeping

1. All attendees will be on mute during the presentation

2. Please submit your questions via the text/chat feature

3. The Prize winner will be notified via email after the webcast

4. We will do all Q&A at the end of the presentation


Storage

Agenda

Shaun Walsh – The Top 10 Business Reasons for 10Gb iSCSI

Gary Gumanow – The Technical Benefits of iSCSI over DCB

Sean Murphy – Benefit in Virtualized Environments

Q&A with Presenters


Storage

Shaun Walsh joined Emulex in 2008 and serves as vice president of marketing. Walsh is responsible for the Company's global marketing strategy including outbound product and solution marketing, OEM and channel marketing and marketing communications, as well as corporate branding

Shaun WalshVP Corporate Marketing

Discrete Data Center

10G Ethernet and FCoE are enabling technologies to support the Virtual Data Center and Cloud Computing.

Emulex Connects the Cloud

Virtual Data Center

Cloud Data Center

• Cloud Computing (Private & Public)• Modular Building Blocks “Legos”• Open Cloud Connectivity I/O Engine• Multi-Client Secure Network I/O (Multi-Tenant)• Optimized Low-Latency (RoCEE) Delivery• Avoid CAPEX & OPEX

Private cloud

• 3 Discrete Networks• Equipment Proliferation• Management Complexities• Expanding OPEX & CAPEX

• Converged Networks• Virtualized I/O Networks• Universal Multi-Channel• Multi-Fabric Unified I/O• Simplifies I/O Management• SR-IOV, VXLAN, GRE• Reducing OPEX & CAPEX


Storage

Technology Adoptions are About Confluences…

10GbE Networking

– Cost/Gb is dropping

– DCB (Data Center Bridging) Plugs Holes

– 10GbE is coming to Romley Servers

Storage Universe is Expanding

– 10GbE iSCSI Scales Faster & Cheaper

– Management = FC Tools

– Cost/GB is Lower

Cloud & Server Virtualization

– I/O Aggregations of VM

– Mobility is Key (VXLAN)

– The Cloud is IP based

Right Technology…Right Problems… Right Execution…


Storage

CompetitiveAdvantage

Lower CostGb and IOPS

Virtual MachineDensity

Drivers of 10GbE and Network Convergence

Increased Use of Virtual Resources for Real Work Loads!


Storage

Waves of 10GbE Adoption

10Gb LOM and Adapters for Blade Servers50% of IT Managers Cite Virtualization as the Driver of 10GbE in Blades

10G

bE A

dopt

ion

Wav

es

2010 2011 2013 Beyond2012

1-2 Socket Serverwith NICs and Modular LOMs

Cloud Container Servers for Web Giants and Telcos

FCoE Storage 25% of I/O10GbE LOM Everywhere

Sources:

Crehan Research Server-class Adapter and LOM Report

ESG Deployment Paper 2010

IDC WW External Storage Report 2010

IT Brand Pulse 10GbE Survey April 2010

10Gb NAS and iSCSI Drive IP SAN Storage for Unstructured Data

2-4 Socket X86 and Unix Rack Servers Drive 10Gb with Modular LOMs and UCNAs

Wav

e 1

Wav

e 2

Wav

e 3

9

10GbE Migration on New Servers

CY2010 CY2011 CY2012 CY2013 CY2014 CY2015

Rack Optimized 6% 15% 37% 56% 80% 89%

Blade Servers 0.46 0.670000000000001

0.79 0.890000000000001

0.940000000000001

0.97

5%

15%

25%

35%

45%

55%

65%

75%

85%

95%

37%

56%

80%

89%

Conn

ect R

ate

of 1

0GbE

Romley10GbE Rack Servers Ramp

Nehalem10GbE Blade

Ramp

Source: Crehan Research 2011


Storage

Adoption of 10GbE Across the Hybrid Data Center

1Gb Ethernet 10Gb Ethernet 40Gb EthernetFibre Channel2011

BackEnd

SaaS

PaaS

IaaS

DataCenter

Big Data

Telco

CloudRetail

2012

BackEnd

SaaS

PaaS

IaaS

DataCenter

Big Data

Telco

CloudRetail

2013

BackEnd

SaaS

PaaS

IaaS

DataCenter

Big Data

Telco

CloudRetail

2014

BackEnd

SaaS

PaaS

IaaS

DataCenter

Big Data

Telco

CloudRetail

I/O A

do

pti

on

in t

he

Clo

ud


Storage

Top Storage Trends

Big DataFor the Cloud

Latency Reductionwith SSD Flash

Converging Architecture

End-To-EndManagement

MobileDelivery of Content

12

The Storage Universe

Digital Video and Images are 90% of Growth

1.8 Zettabytes growing to7ZB by 2013

SSD is the drive of Performance

Big Data is Getting Bigger

IPTV & Video Distribution will Lead the Way

1,000,000,000,000,000,000,000 ZB or 1021

13

Accelerated IT Spending in 2011

iSCSI Adoption is Growing in the Enterprise!

Source: 2011 Enterprise Strategy Group

14

VM Density Drives More I/O Throughput

© 2011 Enterprise Strategy Group

0%

5%

10%

15%

20%

25%

30%

35%

40%

26%

36%

23%

12%

3%

8%

24%

30% 31%

7%

What would you estimate is the average number of virtual machines per phys-ical x86 server in your environment today? How do you expect this to change

over the next 24 months? (Percent of respondents, N=463)

Today 24 months from now

<5 5-10 11-25 >25

Server Virtualization Impact on the

Network

It has created more network traffic in the data center

(30%)

10GbE & 16Gb FC

40Gb

Don’t Know

Source: 2011 Enterprise Strategy Group

15

Top 10 Business Reasons for 10GbE iSCSI

1. More Storage, Less CAPEX

2. More Flexibility for Virtualization

3. Storage Consolidation Savings

4. Greener Data Center (P, C & FS)

5. Global Data Protection

6. Less Network Management Costs

7. App. Acceleration w/SSD

8. Open Standards Based

9. Cloud & VDI Access Controls

10. Network Convergence LAN/SAN

Gary GumanowProduct Line Mgr

Gary is responsible for product management of Dell’s EqualLogic storage arrays. Gary holds several patents and has authored many papers on storage, networking and server platform architecture. He is also on the Ethernet Alliance Data Center Bridging sub-committee and on the board of directors for SNIA’s Ethernet Storage Forum


Storage

Dell & Emulex: Better Together

Working together for over 10 years– PowerEdge Server FC HBAs & Mezz cards, Converged

Network Adapters– DCB, SNIA iSCSI SIG, UNH, Interoperability, Ethernet Alliance

Recently introduced new capabilities for Ethernet & iSCSI– Enables convergence– Deterministic performance – Lossless Ethernet – New ease of use & management– Centralized configuration – Easy server integration

17


Storage

The need for 10GbE

18

•VMs requires more network capacity

•80% CPU increases demand on bandwidth

•10GbE & iSCSI offers the bandwidth needed today

•10GbE w/ DCB enables enhanced fabric virtualization by offering enhanced manageability and QoS

Virtualization

•Enabling server virtualization allows for increasing levels of server consolidation

•Unifying LAN & SAN consolidates network fabric

•Enables reductions in HW, power and OpEX

Consolidation

•Instant access to data anytime anywhere

•Larger database, streaming media and other high I/O applications demand data center performance

•Enables thin client and desktop virtualization

Responsiveness


Storage

What is Data Center Bridging?

Enhancements to Ethernet– Provided enhanced QoS support to Ethernet– 10GbE Technology today…

What constitutes DCB Standards?– PFC aka Priority based Flow Control (802.1Qbb)– ETS aka Enhanced Transmission Selection (802.1Qaz)– CN aka Congestion Notification (802.1Qau)– DCBX aka Data Center Bridging capability eXchange

• LLDP vs. DCBX– LLDP: Primarily a link level information exchange protocol– DCBX: Neighbors can configure parameters based on info exchange

and state machine

19


Storage

iSCSI over DCB

iSCSI over Data Center Bridging (DCB)

Data Center Bridging Capabilities eXchange Protocol (DCBX)– Supports centralized configuration of DCB and related protocols– Initiated by endpoints (hosts/storage) announce themselves with iSCSI

Type/Length Value (TLV)

Enhanced Transmission Selection– Provides priority groups with bandwidth controls

Priority Flow Control (PFC)– Enable lossless Ethernet operation to provide deterministic performance

What’s needed– iSCSI HBA supporting iSCSI over DCB

• Could be a NIC – some limitations– 10G Ethernet Switch supporting DCB– 10G Storage Array supporting iSCSI over DCB


Storage

802.1Qbb (Per-Priority Flow Control)

10GELink

IEEEDCB

IEEEDCB

802.1Qau (Congestion Management)

End-to-End Communication between end-points. Tells the end-point to BACK OFF!

HALT an individual stream, but NOT all of them!

802.1Qaz (Enhanced Transmission Selection)

t1

5G

4G

1G

3G

4G

3G

10GELink

t2

IEEEDCB

DCB ComponentsAllocate bandwidth based upon predetermined classes of traffic


Storage

Fabric Roadmaps

Infrastructure migrates to Ethernet irrespective of storage protocols

Convergence and virtualization are driving enhancements to Ethernet

22

100M 1G 10G 40G 100G

1994 1996 1998 2000 20042002 2006 20102008 2012 2014 2016

Ethernet

1G 2G 4G 16GFibre Channel

32G?8G

DCB

iSCSI

FCoE


Storage

What’s the DCB Solution look like?

DCB enabled storage target, 10GbE switch, and DCB network adapter

23

EqualLogicPS6010PS6510

PowerConnect DCB-enabled Switch DCB-enabled

Adapter in Server

All EqualLogic 10GbE arrays support iSCSI over DCB today…


Storage

Dell & Emulex not going DCB alone…

24

• Published list of companies which integrate iSCSI over DCB into their products (initiators, switches, targets). TBA

• Dell & Emulex have been at six DCB plugfests in the last two years

• Most companies who have been with us at the plugfests will be on this list

• http://www.iol.unh.edu/services/testing/dcb/list.php

Dell & Emulex are first to market with iSCSI over DCB

http://www.iol.unh.edu/services/testing/dcb/list.php




Storage

Data Center Bridging Exchange Protocol (DCBX)

Automatic “handshake” to allow device to exchange Enhanced Ethernet capabilities

• Simplifies configuration• Identify

misconfigurations• Allows switch to override

server parameters

Based on Link Layer Discovery Protocol (LLDP)


Storage

EqualLogic Family Position

Capacity

Perfo

rman

ce

PS4100 SeriesROBO - SMB

• Entry Point into PS Series

• Same software features , sized for ROBO, smaller deployments

PS6010/6510SeriesLarge Enterprise – Data Center

• Supporting 10GbE • 10x Bandwidth per port• 2.5x Bandwidth per Array• Up to 50% cable reduction• Up to 2.3PB

PS6100 Series Large - Mid Range Enterprise

• Up to 67% IOPS improvement on typical workloads

• Linear Scalability• Mid Tier Enterprise SAN• Over 1PB total capacity

All EqualLogic 10GbE PS series arrays are DCB-

capable


Storage

27

Seamless storage expansionSingle multi-generational SAN

AD / Dom

Auto-Snapshot Manager/Microsoft® Edition

Thin ProvisioningCore data

protection

VMware® Site Recovery Manager

Auto-Snapshot Manager/ VMware® Edition

ASM/ME for Hyper-V™SAN

Headquarters

VMware® vStorage

Continuous advancements ofinclusive EQL PS firmware & software

2003

2012+

PS3000 Series

PS4000 SeriesPS100

Series

PS5000 Series

PS5500

FS7500

PS6010 Series

PS6510

PS6000 Series

PS6500

PS4100PS6100Series

Data Center Bridging (DCB)

2011Core File Capability


Storage

Emulex OneConnect

10 Gigabit Ethernet products for Dell PowerEdge Servers

– NIC, iSCSI and FCoE models

iSCSI over DCB support with OCe11000 family of products

– Built in support for DCB with Microsoft Windows, VMware vSphere, Red Hat and Novell SUSE Linux operating systems

Multi-Channel Support– Universal Multi-Channel (UMC) presents multiple

(typically 4) PCI functions per port to the OS

SFP+ and 10GBASE-T models


Storage

Multi-Channel

Technology– Universal Multi-Channel (UMC)

presents multiple (typically 4) PCI functions per port to the OS

• Partitions the port into independent channels of user-defined bandwidth

– Switch-agnostic• Multiple channels can be segmented

based on MAC address and/or customer-provided VLAN ID (C-VLAN)

Benefits– Retains networking best practices

in 1G to 10G migration• Physical 1G port becomes logical

10G port

– Transparent to operating systems• OS still sees dedicated NIC

devices

– Complementary to DCB traffic shaping with ETS

• Bandwidth controls at both logical NIC and priority group level

Physical Port Channels

MultifunctionAdapters

Network/IP

Storage/iSCSI

Network/IP

Network/IP

Unique PCI function per logical port


Storage

iSCSI over DCB Solution

Sample Solution Overview

– PowerEdge servers (R710) in VMware cluster

– EqualLogic array (PS6010/6510)

– PowerConnect switch (B-8000e)

– Emulex Enterprise iSCSI HBAs

• vCenter iSCSI IMA Plug-in

IMAPlugin

iSCSI Configuration today


Storage

iSCSI over DCB Dell & Emulex: Better Together

Enables convergence of LAN and SAN traffic– DCB enables mixed traffic– Multichannel enables multiple logical NICs in one 10G link

Deterministic performance in converged, mixed traffic environment

– Lossless Ethernet using Priority Flow Control enables support

Ease of use– Centralized configuration via switch with DCBX support

• Hosts, storage announce capabilities with iSCSI TLV• Switch enables PFC, Jumboframes, other parameters via DCBX

Easy server integration– iSCSI HBAs such as Emulex OneConnect provide transparent support

31

32

iSCSI over DCB – Dell, Emulex and VMware

Sean C. Murphy - SW Product Mgr, Emulex

33

Sean Murphy is responsible for Software Product Management at Emulex. Areas of focus include VMware product integration and overall software planning. Sean joined Emulex in 2006, with an extensive background in storage software and product development.

Sean MurphySoftware Product Management

34

Emulex and VMware

Emulex is a long-standing VMware partner

– Early Community Source Partner

– Pioneer in CIM Providers for ESXi, working collaboratively

– Innovative Fibre Channel technologies such as NPIV

vSphere in-box support and IOVP Certifications across Product Lines

iSCSI 10GbE offload product support starting with ESX4.1

PVSP Listing on vmware.com for Dell Equalogic / Emulex now!

– See vmware.com: kb.vmware.com/kb/2005240

35

Prior Barriers to Convergence

iSCSI on Gigabit Ethernet best practices architected separate Ethernet network for iSCSI traffic

– Servers - iSCSI on separate NICs

– Switches – iSCSI on separate switches

– Storage – iSCSI targets placed on separate network & switches

Rationale

– Congestion causes packet loss, creating non-deterministic performance

– TCP/IP error recovery expensive from a predictable latency perspective

In virtualized environments, best practices employ multiple NICs for traffic isolation (iSCSI, vMotion, production, management, etc.)

– Enables effective bandwidth caps between services, ensures available bandwidth at server

36

Enterprise iSCSI – Emulex, Dell, VMware

Dell EqualLogic storage arrays and Emulex OCe11102 CNAs

– Combined with a DCB enabled switch, provide the basis for the iSCSI over DCB model for ESX

iSCSI supports 10GbE today, & does not require DCB, however…

The same benefits apply to iSCSI as apply to FCoE

– iSCSI over DCB provides a lossless environment

– iSCSI has a built in mechanism to recover from dropped packets with TCP/IP, but eliminating the need for retransmits makes the host, network, and target more efficient and reduce CPU utilization

iSCSI over DCB allows for more deterministic performance in the event of network congestion, and more headroom on the host to run more virtual machines

This solution moves 10GbE iSCSI from a bandwidth bump (from 1GbE) to a truly robust iSCSI solution, ready for Enterprise SAN deployment

37

iSCSI over DCB with VMwareEnterprise iSCSI

Current versions of vSphere don’t directly support DCB protocols

– No APIs for a NIC to support DCBX and PFC

HBAs/CNAs offload iSCSI, DCB transparent to OS

– DCBX and PFC all handled by device

– Host to Device interaction all at SCSI layer

PVSP certified

App

OS

App

OS

App

OS

App

OS…

iSCSI storage

EthernetSwitch

VM1 VM2 VM3 VM26

Hardware iSCSI

38

Management Integration

Emulex OneCommand Manager

– Provides a single, uniform management interface, e.g.,

– Procedures for attaching to iSCSI targets consistent across all OS’s

In-box CIM Providers since ESXi3.x

vSphere iSCSI IMA Plug-in – for vCenter integration

OneCommand Manager, for vCenter – V1.1

– vCenter Plug-in version of Emulex OneCommand Manager

– Hardware iSCSI device viewed in vSphere Client under Storage Adapters in the Configuration tab

– Less complicated than software iSCSI

OneCommand Manager

OCM for VMware

39

Emulex Advantages

Benefit Hardware-offload iSCSI Software iSCSIPerformance iSCSI uses separate I/O stack than NIC

traffic. Maintains consistent storage perf under varying LAN traffic conditions.

LAN congestion leads to PFC pause frames affecting iSCSI traffic.

Scalability Support of more VMs in virtualized environments

Not performance-optimized

Reliability Attachments to iSCSI targets are maintained in hardware

Disruption in the host could lead to the loss of sessions

Manageability Emulex OneCommand™ Manager provides a single, uniform management interface; procedures for attaching to iSCSI targets are the same on all supported host operating systems. Graphical and command-line interfaces are provided.

The software iSCSI initiator runs on top of the TCP/IP stack and is managed differently for every operating system.

OneConnect™ iSCSI adapters can be managed across the enterprise from a single console.

Software iSCSI is managed locally on each host.

Software iSCSI Hardware iSCSI0

5

10

15

20

25

30

VMs

53% more

The Time has come – for Enterprise iSCSI with Emulex & Dell!


Storage

Resources & Call to Action

See http://www.emulex-dell.com/– Register for the Emulex quarterly Dell

newsletter – For information on Emulex OneConnect

products supporting iSCSI over DCB– For information about other Emulex solutions

for Dell– For iSCSI over DCB white paper

LIKE us on facebook

Follow us on Twitter

http://www.emulex-dell.com/

Enabling Converged Networks with iSCSI over DCB

Gary Gumanow, Senior Product Line Manager, Dell Inc.

41


Storage