25
The Role of SSDs in the Data Centre Rob Anderson, Director of Technology & Business Development Isilon Systems EMEA [email protected] 5/28/22

The role of SSD’s in the Data Centre

Embed Size (px)

DESCRIPTION

The quest to improve performance within storage subsystems has many paths. One of the most exciting is Solid State Disks, although the technology is not a magic bullet for every situation. This presentation offers an insight into utilising SSD to improve a range of high intensity storage tasks within the datacenter.

Citation preview

Page 1: The role of SSD’s in the Data Centre

The Role of SSDs in the Data Centre

Rob Anderson, Director of Technology & Business DevelopmentIsilon Systems [email protected]

Wednesday, April 12, 2023

Page 2: The role of SSD’s in the Data Centre

Massive Growth in the Data CentreIsilon customer: EBI/EMBLOver 6 PB for genomics, including 1000 Genomes & Elixir

Isilon customer: AdobeScene7 cloud storage & media publishing platform

Isilon customer: SoftLayerTens of thousands of hosted virtual servers

Isilon customer: NavTeqTraffic, mapping and location data for the globe

Page 3: The role of SSD’s in the Data Centre

How is the industry responding?

3 & 4 TB drives to deal with explosion of dataVolume sizes on traditional storage are not increasing, remain < 10 TBDesire to migrate data to clouds (private or public) where possible, to reduce costsUptake of scale-out storage systems to tackle complexity of ever-growing repositories and to create private clouds

Page 4: The role of SSD’s in the Data Centre

Effect on enterprise storage?

Disks are bigger, but not fasterIndividual controller throughput is also not keeping pace with disk sizeHardware RAID is not keeping up with disk sizes, so repairs are longer and risk higherThe number of things to manage—LUNs, volumes, aggregates, etc is getting ever larger, so things are getting more complex

SSD

Isilon

Page 5: The role of SSD’s in the Data Centre

SSD’s – Hype or Reality

Page 6: The role of SSD’s in the Data Centre

SSD – Disruptive Technology

Industry insiders and vendor executives were asked to rank the most disruptive technology or business model changes to affect the Storage Industry over the next 3-5 years:

1. Flash memory / Solid State Disk2. Private and Public Cloud Computing 3. Storage and Server Virtualization4. Storage Efficiency (thin provisioning, de-duplication,

compression etc)5. Unified Networking

Source: GigaOM Pro, May 2009

Page 7: The role of SSD’s in the Data Centre

SSD Key Findings

SSS memory densities are 64x what they were 3 years ago. $/GB is decreasing rapidly but still nowhere near rotating disk $/GB. SSS has much faster access time.

SSD market is gaining momentum. Drive shipments are low right now as a % of the total, but future is extremely bright.

SSD’s (combined with SATA) are making Enterprise SATA disk drives more viable as primary storage. Customers can use half as many drives and achieve similar level of performance as FC/SAS drives which are currently typical for PS environments.

Correctly configured SSD technology can unleash the full potential of multi-core processors, increasing enterprise data throughput while decreasing power and space requirements.

Page 8: The role of SSD’s in the Data Centre

I/O Intensive WW Storage Systems Forecast

I/O intensive Storage Systems are based on Solid State Drives (Tier 0)

Source: IDC 2009

~37PB of SSD based systems estimated to ship in 2010Systems Revenue increasing 98% CAGR between 2008-2013 Price/GB declining by 48% from ‘08-’13

Page 9: The role of SSD’s in the Data Centre

Current methods of SS Storage Adoption Use of SSD’s as simple disk replacement

Pros – Easy, Few changes required to system Least disruptive method of adding SSD’s to a storage environment

Cons – Performance limitations of storage controllers Tiered migration is poor (wasteful since not all data on SSD volume is hot) Deploying all SSD for a volume is expensive

Use of NAND flash as cache in storage controllers or “front-ending disk drives with NAND flash”Pros –

More adapted approach, more cost effective for amount of acceleration deliveredCons –

Performance bottleneck moved to the storage controller head, which may not scale

Page 10: The role of SSD’s in the Data Centre

Isilon Overview

Proven, global leader in Scale Out Storage solutions

Unrivaled product innovation – 6th Generation

1,400 customers and growing rapidly

World-class products and global services

Strong ecosystem of technology partners

NASDAQ Ticker: ISLN

Page 11: The role of SSD’s in the Data Centre

Isilon in Gartner’s NAS “Leaders” Quadrant• Isilon joins NetApp, EMC and

IBM in the upper right of Gartner’s “Magic Quadrant for NAS, 2010”

• “Leaders” scored the highest in ability to execute and completeness of vision

• The other three vendors in the Leaders Quadrant are multi-billion dollar businesses and Isilon gained ground on each in 2009

• Key strength: “Isilon’s three primary product lines have significantly broadened its appeal in horizontal market.”

• Key strength: “The ease of implementing, managing and growing Isilon scale-out NAS results in high business efficiency.”

Page 13: The role of SSD’s in the Data Centre

13

Isilon’s Scale-out Storage Solution

Nodes of different types

Expandable to 144 nodes

Up to 10 PB in a single file system

Up to 1,152 CPU cores

Up to 2.3 TB memory

Up to 576 GbE ports

Enterprise-class

hardwareComplete

storage system

Isilon IQOneFS™

intelligentsoftware

Page 14: The role of SSD’s in the Data Centre

Scalable, and simple

ONEFS

one namespace, no LUNs/Volumes

FT

P/H

TT

PC

loud AP

I

NO MIGRATIONS, NO RECONFIGURATIONS

CIF

S

iSC

SINFS

Page 15: The role of SSD’s in the Data Centre

Complex: Separate LUNs and volumes make for a complex

solution

Eliminate ComplexityOneFS—virtualise / cluster all nodes

No waste: Space is ‘liquid’ on OneFS, so all space

except parity is available

No LUNs or volumes: All space is virtualised. OneFS keeps track off all blocks, obviating the need for a

volume manager

Inefficient: Space wasted in fixed-size LUNs; disk has to be hard-allocated to LUNs

Page 16: The role of SSD’s in the Data Centre

How clustering improves performanceOneFS—virtualise / cluster all nodes

Bottlenecks: Controller becomes bottleneck to

storage

No bottlenecks: Parallel datapaths eliminate

bottlenecks & hotspots

Page 17: The role of SSD’s in the Data Centre

Isilon’s Approach to SSD Adoption

Place file-system metadata directly on the SSDFaster Namespace operations

Design and Simulation BVT workflowsmakefiles, dependency checking, design synchronization, IP and library access etc.

Speeds up treewalks immenselyHome directories workflows (config files, my_docs)Significantly lower latencySAS level performance for hybrid SATA+SSD hybrid node

Page 18: The role of SSD’s in the Data Centre

What is metadata?

Every file systems stores user data and metadata—the objects used to locate dataExamples

InodesDirectory blocksInode metablocks (extents)

Speeding up metadata speeds up access to files and data within files

Page 19: The role of SSD’s in the Data Centre

3 Products Announced in 2010Product

Options

IQ 10000X-SSD IQ 32000X-SSD IQ 5000S-SSD

SSDYes

STEC SLC (2x 100GB)

Yes STEC SLC (4x100GB)

Yes STEC SLC (1x100GB)

HDD10 x 1TB 7200rpm SATA 32 x 1TB 7200rpm SATA

11 x 450GB 15000rpm SAS

Capacity 10TB 32TB 5TB

Memory/CPUDual Quad-Core CPU

16GB MemoryDual Quad-Core CPU

16GB MemoryDual Quad-Core

CPU 16GB Memory

Minimum Cluster size

3 nodes i.e 30TB Raw 3 nodes i.e 96TB Raw3 nodes i.e 15TB

Raw

Page 20: The role of SSD’s in the Data Centre

CREATE & CAPTURE PROCESS

ARCHIVE ARCHIVE

Isilon IQ SAS(16-518 TB)

S-SeriesTransactional I/O &

Random Access

Isilon IQ 5400S,

IQ 5000S-SSD

Isilon IQ X Series Nodes

6000/12000

X-SeriesHigh Concurrent /

Sequential Throughput

Isilon IQ EX Nodes

6000/12000

Isilon IQ X Series SATA (6TB – 3,456TB)

Isilon IQ 10000X-SSD 36000X, 72000X, IQ

32000X-SSD

NL-SeriesNearline Storage

Isilon IQ Nearline SATA(250TB – 3,456TB)

Isilon IQ 72NL,36NL

Backup Acceleratorto Tape Storage

High PerformanceBackup/Restore

10GE

SSD

SSD10GE

10GE

Page 21: The role of SSD’s in the Data Centre

Performance BenchmarksExample 1: IQ 12000X versus IQ 10000X-SSDConfiguration and Workflow: Home Directory Access Pattern

4% Write, 61% Read, 35% Metadata Small Files, Small Block Reads 5 Node Cluster, 30 Linux Clients

5000 5200 5400 5600 5800 6000 62000.0

5.0

10.0

15.0

20.0

25.0

30.0

35.0

40.0

IQ 12000X

8000 10000 12000 14000 16000 18000 20000 22000 24000 26000 280000.0

1.0

2.0

3.0

4.0

5.0

6.0

7.0

8.0

9.0

IQ 10000X-SSD

Lat

ency

in

Mil

lise

co

nd

s

Lat

ency

in

Mil

lise

co

nd

s

Ops/Sec Ops/Sec

IQ10000X-SSD delivers up to 4x increase in IOPS and ~ 8x improvement in latency

Page 22: The role of SSD’s in the Data Centre

Performance BenchmarksExample 2: IQ 12000X versus IQ 10000X-SSD

Configuration and Workflow: Simulated SpecSFS 2008

5 Node Cluster, 30 Linux Clients

7500 8000 8500 9000 9500 10000 10500 11000 115000.0

5.0

10.0

15.0

20.0

25.0

IQ 12000X

9000 100001100012000130001400015000160001700018000190000.0

1.0

2.0

3.0

4.0

5.0

6.0

7.0

8.0

IQ 10000X-SSD

Lat

ency

in

Mil

lise

co

nd

s

Lat

ency

in

Mil

lise

co

nd

s

Ops/Sec Ops/Sec

IQ 10000X-SSD delivers ~17.5K IOPS under 2ms of latency

Page 23: The role of SSD’s in the Data Centre

Performance Solution for

With SSD, SyncIQ tree-walk performance improved from 45 hours to 6 hours

Company: ARM - Fabless Semiconductor Vertical: Design & Simulation Why Isilon: Deep-submicron design was stretching existing NAS storage beyond its limits. Needed a truly scalable solution like IsilonConfiguration: Storage required for each of 3 locations (UK, USA, India) Requirement: Need faster replication to met their RPO. Billions of tiny files.

Page 24: The role of SSD’s in the Data Centre

Financial Quantitative Analysis

Customer Background: Hedge fund. Develops automated trading algorithms using advanced mathematical and statistical modeling techniques and an extremely high-performance computing environment

Workflow Requirements: ~40% of their total accesses were NFS Namespace Operations (getattrs, access checks, file directory creates etc) Extremely low latency requirements (interactive with user) Lots of files with random access patterns (scripts, test results, logs etc)

Isilon Solution: 49 node IQ10000X-SSD cluster in production now

More RAM, More CPU, Integrated 10GE and SSD for metadata

Page 25: The role of SSD’s in the Data Centre

Thank You

Rob Anderson, Director of Technology & Business DevelopmentIsilon Systems [email protected]