25
David Dale Ethernet Storage Forum; NetApp Ethernet Storage - Benefits & Futures

Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Embed Size (px)

Citation preview

Page 1: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

David Dale Ethernet Storage Forum; NetApp

Ethernet Storage - Benefits & Futures

Page 2: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

SNIA Legal Notice

  The material contained in this presentation is copyrighted by the SNIA.   Member companies and individuals may use this material in presentations

and literature under the following conditions:   Any slide or slides used must be reproduced without modification   The SNIA must be acknowledged as source of any material used in the body

of any document containing material from these presentations.   Neither the Author nor the Presenter is an attorney and nothing in this

presentation is intended to be nor should be construed as legal advice or opinion. If you need legal advice or legal opinion please contact an attorney.

  The information presented herein represents the Author's personal opinion and current understanding of the issues involved. The Author, the Presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information.

NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK.

Page 3: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Abstract

 This presentation presents an overview of Ethernet-based storage networking technologies and solutions. It examines the relevant storage protocols, features and benefits of storage systems using those protocols, and where they are deployed in a typical IT environment today.

 The presentation goes on to examine the latest developments in Ethernet standards, and storage protocols, including Data Center Bridging, FCoE and pNFS, and how they may change the storage landscape over the next few years.

Page 4: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Contents

  Introduction   Storage Topologies Compared   Benefits of Networked Storage   Ethernet as a Storage Fabric

 Ethernet Storage Today   NAS Features and Benefits   iSCSI SAN Features and Benefits   Typical Ethernet Storage Deployments

 Latest Developments   Ethernet beyond 10 Gigabit   Fibre Channel over Ethernet   NFS and scale-out architectures

  Summary

Page 5: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

5

Storage Technologies

SCSI, FCP

Application Server

File System

FC Switch & Infrastructure

RAID

Application Server

File System

Application Server

File System

Ethernet Switch

File System RAID

Application Server

Application Server

RAID Ethernet Switch & Infrastructure OR

iSCSI FCP NFS. CIFS

  Server-based data management

  No resource sharing   No data sharing   Works with all apps

  Server-based data management

  Resource sharing   Complex data sharing   Works with all apps

  Storage-based data management

  Resource sharing   Automatic data sharing   Works with qualified apps

Direct Attached Storage SAN Storage

NAS Storage

Page 6: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

6

Networked Storage

  Benefits of Storage Networking   Improved reliability and reduced cost of backup   Improved scalability of storage capacity and performance   Simplified storage provisioning   Improved data availability

  Top reasons for deploying networked storage   Back-up   Storage consolidation   Satisfy on-going demands for additional capacity   Performance   Disaster recovery   New project or application deployment

Page 7: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Ethernet as a Storage Fabric

  Ethernet and TCP/IP are widely deployed and dominant   Not just the Fortune 1000   Well understood technology – every company has expertise   Low acquisition cost   Unlimited distance

  Ethernet is scalable, with100/1000/10000 Mbps available today   40/100 Gb Ethernet emerging during 2010

  Allows the creation of a single physical network using familiar standards   Virtualization built in

  End points virtualization   VLAN’s maybe used for separating traffic

  Brings Ethernet interoperability & economics to storage   Enables native remote data replication and disaster recovery

Page 8: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

8

Ethernet Storage Today

Page 9: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Networked Storage

2006 2007 2008 2009

FC SAN 73% 72% 68% 61%

iSCSI SAN 4% 6% 10% 13%

NAS 22% 22% 22% 26%

9

2006 2007 2008 2009

FC SAN 64% 62% 58% 53%

iSCSI SAN 6% 8% 13% 15%

NAS 30-% 29% 29% 32%

Market Share by Revenue

Market Share by Capacity

Source: IDC Worldwide Storage Systems Tracker, 2006, 2007, 2008, 2009

Page 10: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Ethernet Storage Protocols

  iSCSI (IETF)   SCSI commands over TCP/IP   Minor update (STORM) started 2009

 NFSv4 (IETF)   Standard file access over TCP/IP   Supporting UNIX and Windows file semantics

  Lease based state

  Mandates strong authentication

  Universal character set for file names

 CIFS/SMB (Microsoft, et al)   Windows file sharing protocol   SMB 2 released with Vista

Page 11: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

NAS/NFS Benefits

  NAS delivers ease-of-use, reliability, scalability, and built-in data protection

  Very prevalent data center storage solution   Home Directory environments; Storage consolidation;   Unix/Linux build farms; diskless boot   Virtual environments over NFS

  Databases and business apps on NFS   About a 3rd of databases out there are NFS server backed   Direct I/O modifications to NFS clients/servers   posix based Async I/O and Direct NFS (dNFS)

  Grid Computing with NFS   HPC & Technical Computing Applications   Clusters on demand

Page 12: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Servers w/ iSCSI Initiators

iSCSI Storage

Systems

Users

Ethernet Switch

IP SAN

LAN

  Standard SAN storage   Block storage access   Supports all apps   Transparent migration from

direct attached storage   Lower TCO than FC

  Zero host connection cost   Less costly infrastructure   Easier to manage; leverage

existing staff   Security

  Built-in authentication   Optional IPSec; encryption

key management   Performance

  1Gb and 10Gb   Offload technologies

iSCSI SAN Benefits

Page 13: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

iSCSI Deployment

 Mainstream storage consolidation solution for Windows application server environments

 Mainstream deployment in multi-OS host environments   Windows plus Linux and/or Unix)

 Mainstream deployment in virtual server environments   VMWare, Xen, Hyper-V

 Broad deployment in small blade server environments

  Increasing deployment with 10GbE infrastructure

Page 14: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

10 Gigabit Ethernet

  IEEE 802.3ae ratified 2002  Broadly deployed in inter-switch links  Host-side proliferation now happening

  Affordable Price   Server I/O architecture support   Standard component on commodity servers   Offload built into on-board components, supported by

operating systems

 Deployment/applications   Backbone and port aggregation for 1Gb LANs

  File and block storage over 10GbE

Page 15: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Where Ethernet Storage Fits – �Large Enterprise

Infrastructure Ethernet FC Mostly Ethernet Lots of both

LAN WAN

Remote Offices

FC Storage Network

Layered Production Bus. Internal, some Bus.

Operations

Core Production: Bus. Critical, some Bus.

Operations

Test/ Dev

Storage Network

Networked Storage

in remote offices

FC and/or Ethernet Storage Network

NAS iSCSI

iSCSI

iSCSI

NAS

NAS/CIFS

Page 16: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Storage Network

LAN WAN

Remote Offices Production Data Center

Bus. Internal, some Bus. Operations

>40% of storage is direct

Storage Network

Networked Storage

in remote offices

D/D Backup & DR

Primary Storage NAS

iSCSI iSCSI

NAS/CIFS

Where Ethernet Storage Fits – �Medium/Small Enterprise

Page 17: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

17

Latest Developments in Ethernet Storage

Page 18: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Source: John D’Ambrosia, Force 10 Networks; Copyright 2008 Chair, IEEE P802.3ba Task Force; Ethernet Alliance Member

Ethernet Beyond 10 Gigabit

Spec scheduled for completion June 2010

Ethernet Beyond 10 Gb

Ethernet Beyond 10Gb/s

Page 19: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

I/O Consolidation – FCoE

– An Extension of Fibre Channel onto a 10Gb Ethernet network – FCoE is a direct mapping of Fibre Channel over Ethernet – TCP/IP is not required and not present for FCoE – Preserves ops, control and management environments for the FC layer

Page 20: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

FCoE: Smooth Transition to Ethernet �for Fibre Channel SAN Investments

 FCoE enables Fibre Channel to run on a “lossless” Ethernet network

 Benefits   Fewer cables

  Block I/O and Ethernet traffic coexist on same cable

  Fewer adapters   Less power   Interoperates with existing SANs

  Same SAN management

Page 21: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

I/O Consolidation – DCB

  Data Center Bridging   Also known as “Converged Enhanced Ethernet” and “Data Center

Ethernet”

  FCoE requires “lossless” Ethernet   Possible with Ethernet plus some extensions

  The IEEE 802.1 DCB WG has defined these extensions   Priority-based Flow Control (PFC): 802.1Qbb

  Required for FCoE   Enhanced Transmission Selection (ETS): 802.1Qaz

  Highly recommended for FCoE   Including DCBX (DCB eXchange protocol)

  Congestion Notification (CN): 802.1Qau   Optional for FCoE

  Standards completed 2H2009   DCB required for multiprotocol support (FCoE and TCP/IP)

Page 22: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved. 22

10Gb Ethernet / DCB / FCoE

2 DCB Switches 26 CNA Ports

Dual DCB Switches

Traditional Fibre Channel

Dual DCB Switches

22

Consolidation Example

Tape Library

LAN

LAN 1Gb Ethernet

4Gb Fibre Channel

FCoE Target

Rack of Application / Web Servers

Attach to Core Via Top of Rack Switches

Attach Directly to Core

Ethernet Storage at 1Gb

2 Ethernet Switches 2 Fibre Channel Switches 26 Ethernet Ports 26 Fibre Ports

Dual Ethernet Switches

Dual Fibre Channel Switches

LAN

10Gb Ethernet

Ethernet Storage at 10Gb

Page 23: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Latest Developments: NFSv4.1

 A dot release of NFSv4  New features:

  Delegations on directories,   Symbolic links,   Session model   Parallel NFS (pNFS)

  Major advance in enabling standards-based scale-out host environments

  A single client supports block, file and object-based storage access

  Improved performance over NFSv4.0   Spec approved December 2008; RFC number

issued January 2010

Page 24: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Supporting scale-out – pNFS

  pNFS metadata protocol   standardized NFSv4.x

  Storage-access protocol   files, objects, blocks

  Data-management protocol   not standardized

pNFS Layouts + Control

Data management protocol

Storage-access protocol

Metadata Server

Data Servers

pNFS Client

Page 25: Ethernet Storage - Benefits & · PDF fileEthernet Storage - Benefits & Futures. ... –FCoE is a direct mapping of Fibre Channel over Ethernet –TCP/IP is not required and not present

Ethernet Storage: Standards, Deployments & Futures © 2010 Storage Networking Industry Association. All Rights Reserved.

Summary

  40% of networked storage shipped today is Ethernet-connected

  NAS and iSCSI continue to be the fastest growing storage networking technologies

  10Gb Ethernet has now entered the mainstream   Many IT organizations are in an upgrade cycle for their data

centre networking architecture   Cost and complexity reduction   Server and storage consolidation/virtualization

  A range of standards activities are enabling:   Greater functionality of Ethernet storage solutions   An orderly transition to a “unified” data centre network based on

10Gb Ethernet supporting all networked storage protocols