30
Future technologies for storage networks Shravan Pargal Director, Compellent Consulting

Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

Future technologies for storage networks

Shravan PargalDirector, Compellent Consulting

Page 2: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

2

Agenda• Storage applications• Application requirements• Available technology solutions• Who is winning today?• What will determine the winning storage

technology of tomorrow?

And, NO object storage in this talk!

Page 3: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

3

Storage applications• Data base applications

• What are they used for in a business?

• Email• Is it critical to a business?

• File and print sharing• Document archiving• “Backup”

Audience question – what % of storage today is email storage?

Page 4: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

4

Application categories• Business processing:

• Enterprise resource planning (ERP)

• Customer relationship management (CRM)

• Online transaction processing (OLTP)

• Batch • Decision support:

• Data warehousing/data mart

• Data analysis/data mining

• Collaborative: • Email • Workgroup

• Application development • IT infrastructure:

• File and print • Networking • Proxy caching • Security • Systems management

• Web infrastructure: • Web serving • Streaming media

• Technical -Scientific/engineering (compute only)

Source IDC: 2002

Page 5: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

5

Storage market

Source IDC: 2002

Technical3%

Other3%

Business Processing

25%

IT Infrastructure

24%

Decision support

19%

Application development

10%

Collaborative10%

Web Infrastructure

6%

Page 6: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

Application requirements

Page 7: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

7

Application requirements…

• Focus of Databases• What is the end user application?

• Order entry• Data mining• OLTP

• All require efficient block I/O• Benchmarked using transactions per

second

Requirements depend on the type of data in the database and the method of

access.

Page 8: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

8

…More requirements• Latency

• How long are you willing to wait at the ATM machine?

• Availability• What happens if the ATM is unable to connect to

its database?• What happens if a patient’s allergy record is

unavailable during surgery?

• Scalability• How much storage do you have today, and how

much will it be in 3 or 6 months?• Does the existing storage solution scale?

Page 9: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

9

FinallyDoes the user or administrator of the

application know the answer to the following:

• What is the data throughput required? • MB/s

• How important are transactions per second metrics? • Input/Outputs per second

Page 10: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

Storage architectureoptions

Page 11: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

11

Architecture Options• Networked Storage – NAS and SAN

• NAS• Very flexible on front end protocol options (FC, iSCSI, InfiniBand

available today)• Currently only FC on the backend

• SAN• FC• IP

» iSCSI» iFCP» FCIP

• InfiniBand

• Direct attached storage• SCSI• ATA

Page 12: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

12

Technology Options• Storage Virtualization

• In-band• Out-of-band

• Why is this interesting?• Why is it difficult to do?• What are the problems with storage

virtualization?

Page 13: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

13

Network Attached Storage (NAS)

NAS Filer

Application Server

Clients

EthernetLAN

Storage Server

Page 14: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

14

Storage Area Network (SAN)

Servers StorageClients

Fibre ChannelSAN

Win 2K

Unix

Novell

Tape

Disk

Disk

EthernetLAN

Disk

Page 15: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

15

iSCSI, iFCP and FCIP Protocol Stacks

IP IP IP

TCP TCP

New Serial SCSI FCP FC-4

TCP

FC Lower Layers

FCP FC-4

iSCSI iFCP FCIP

Standard SCSI Command Set

Operating System

Applications

Copyright © 2001, Storage Networking Industry Association

Page 16: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

16

Direct attached drives (DAS)

IDE or SCSI

Internal disk drive(s)

Useful link: http://www.pcmech.com/hdindex.htm

Page 17: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

17

Who is winning today• Direct Attached Storage - 66.4 % of all

installed storage in 2001

• Network Attached Storage – 7.4 % of all installed storage in 2001

• Storage Area Networks – 26.1 % of all installed storage in 2001

Source IDC: 2002

Page 18: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

18

Installed Storage Revenue

Page 19: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

19

Installed Storage Data

Page 20: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

20

Storage Consolidation

LAN

NTServers

Tape Drive

RAID

Tape Drive

RAID

Tape Drive

RAID

NTServers

RAID(Email)

TapeLibrary

Mission-Critical RAID(Oracle, ERP DB)

SAN

Switch Switch

SwitchSwitch

Page 21: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

21

Interconnect Technologies

Knowing that the strengths of a technology don’t guarantee its success, here are some nice technologies …

Page 22: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

22

Fibre Channel• Low Latency• Immunity from congestion• In-order delivery• Guaranteed delivery• 2 Gigabit per second pipe• Dominant server to storage connection

What percentage of the 2 Gb/s bandwidth is used?

Page 23: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

23

IP• TCP provides in-order delivery• Most ethernet switches can now provide

some level of immunity from congestion –particularly in a LAN environment

• Higher layer protocols provide delivery guarantees

• 1 Gigabit per second bandwidth• Dominant client to server connection

What percentage of the bandwidth is used?

Page 24: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

24

Reality check for IP Storage• Fibre Channel

• Will not disappear any time soon• Market will continue to grow and expand

• IP will provide a way to connect FC islands• Today with FCIP, iFCP and iSCSI

• iSCSI is slowly maturing• Plug Fests to test standard compliance• Final specification just completed - February 2003

iSCSI provides end-to-end native IP Storage

Page 25: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

25

Future Network

Servers StorageClients

SAN

Win 2K

Unix

Novell

Tape

Disk

Disk

LAN

Disk

Single management domain

There is a convergence of network and data administration functions

Page 26: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

Trumps

Page 27: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

27

Hidden agendas• Who is backing the technology?

• FC – FC switch and adapter incumbents• Brocade, EMC, Emulex, QLogic, HDS, IBM,

Sun, HP• iFCP – Nishan and others• FCIP – Cisco, Brocade and others• iSCSI – Cisco, IBM, EMC and others

Fibre Channel incumbents stand to lose as new IP based technologies gain acceptance

The new players need IP based technologies to enter the storage space

Page 28: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

28

Tomorrow’s winners

• What is going to decide who the winners are?• Open systems compliant• Resilient• Flexible deployment options• Affordable as the solution scales• Enables server consolidation

Page 29: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

29

Conclusions• Better

• More features – what is the baseline feature-set requirement?

• Faster• More IOPs - Not more MB/s

• Cheaper• Commodity pricing – like ethernet

• Easy to use – Simplify!

The best technologies don’t always triumph over other contenders – remember VHS v.s.

Betamax

Page 30: Future technologies for storage networks v0.3 - post · • Networking • Proxy caching • Security • Systems management • Web infrastructure: • Web serving • Streaming

30

Questions?

Shravan Pargal

Director, Compellent ConsultingCompellent Technologies Inc.

[email protected]

www.compellent.com