ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

Neue Entwicklungen in Lustre profitieren von aktuellen Netzwerkstandards ZKI –AK Supercomputing 22-23. September Kaiserslautern

2014

Auke Kuiper DDN – ZKI Autumn presentation

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | Agenda

▶  Introduction

▶  Solutions for various vertical markets:

▶  Lustre benefits from new network standards

▶  Summary

▶  Q&A

2

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | Who We Are

▶  Markets: Enterprise Big Data, Cloud, HPC

▶  Solutions: Platforms, File Systems, Object Storage

▶  Customers: 1,000+ in 50 Countries

▶  Go-To-Market: Direct, Partner Assist

▶  Employees: 550 in 20 Countries

▶  Headquarters: Santa Clara, CA

▶  History: Founded in 1998 and Profitable

We Solve Big Data Lifecycle Management Challenges at Large Scale

The World’s Largest Private Storage Company

NDA Confidential 3

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | The Technology Behind The World’s Leading Data-Driven Organizations

HPC & Enterprise Big Data Analytics

Cloud, Web, Telco Infrastructure

Professional Media

Government & Academia

4

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | Storage Appliance Portfolio

SFA12KX Bandwidth: 48GB/s

IOPS: 1.7M Scales to 1680 Drives In-Storage Processing

SFA7700 Bandwidth: 10GB/s

IOPS: 450K Scales to 396* Drives

WOS7000 HD or Archive

4U, 60-Drive System 8 x GbE per Node

2.6PB/Rack, 22B Objects/Rack 30PB/Cluster; 32 Clusters/Namespace

5

Object storage Exa/Grid Scaler or block storage

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

SFA Feature Breakdown

High Density Array Up to 840 HDDs in a single rack. 84 HDDs and SSDs in 4U

Storage Fusion Fabric Highly-Over-Provisioned Backend – Redundant Fabric Withstands Failures of Drives, Enclosures, Cables, etc

DirectProtect™ Real-Time Data Integrity Verification for every I/O Drive Power Cycling to Eliminate False Positives

ReACT Cache Management Real-Time I/O Data-Aware Cache Optimizer, Small IOs Go to Cache; Large & Streaming I/Os Bypass Cache

SFA Embedded (Optional) Low-Latency KVM Environment with Custom DDN DMA Memory Drivers to Host File Servers and Pre/Post Process Analytics

SFX Storage Cache Automated and API-driven caching system to enable hybrid SSD & HDD pools

QoS Engine Real-Time Quality of Service for Read Operations

Real-Time, Multi-CPU RAID Engine Full Implementation of Real-Time Storage OS, Interrupt-Free; Massively Parallel I/O Delivery System

6

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | Technology & Product Portfolio

7

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN End-to-End Big Data Portfolio

8

DDN IME NVM Tier

DDN SFA Persistent File System Storage Tier

DDN WOS Archival Storage Tier

High-Speed File Caching Appliances

High-Speed, High-Capacity Block and File Storage

Power Efficient, High Capacity Object Storage

High Density Compute

DDN WOS Bridge Servers

DDN optimizes your HPC storage appliances into most performing and stable solutions

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | developments

▶  Lustre developments (Bulk RPC 4 MB, 16 MB, DNE)

▶  DNE + SSD’s for internal metadata ▶  Multicore strategy in SFA12K + 84 HDD bay enclosures ▶  FDR for IB

9

DNE = Distributed Name Space to provide better MDS performance and HA

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

Lustre setup with 12KX40 ExaScaler Scalable Storage Unit (SSU)

RP1 RP0 RP1 RP0

OST04 OST24 OST05 OST25

OST18 OST38 OST19 OST39

OST02 OST22 OST03 OST23

OST00 OST20 OST01 OST21

CPU1 CPU0

400 x NL-SAS

2 or 4 MDS Servers

CPU1 CPU0 CPU1 CPU0 CPU1 CPU0 CPU1 CPU0 CPU1 CPU0

MDT02

MDT09

MDT01

MDT00

Up to 20 SSDs

4 OSS Servers

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

ExaScaler 12K40X Single Rack Scalable Storage Unit (SSU)

OST

4 OSSs

MDT

2 or 4 MDSs

▶  ExaScaler/Lustre Configuration •  4 x OSS •  2 or 4 x MDS

▶  Storage Configuration •  12K40X with 5 x SS8460 •  400 x 4 TB NL-SAS, Up to 20 x SSD for Metadata

▶  Software Stack • Server OS: RHEL6.5 or CentOS 6.5 • OFED: Mellanox OFED-2.1-1.0.6 • Server Lustre: Lustre-2.5..x_DDN branch • Client Lustre: Lustre-2.5..x_DDN branch •  Lustre 2.6 available for non production systems

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

12KX40 ExaScaler Scalable Storage Unit (SSU)

IB FDR

▶  1,25 PB usable capacity (1,6 PB raw) (maximum 1,88 PB usable 2,4 PB raw

with 6TB HDD) ▶  30 - 32GB/s bandwidth on Lustre

▶  > 1 Billion files (inodes) ▶  1 Rack 34 U + 1U IB Switch

These specifications do not include the rack and the servers. Power (nominal) Power: 4,7 kW ( 6TB HDD) Power: 5,3 kW ( 4TB HDD) Power servers: 3,2 kW ( 4 OSS + 2 MDS) Cooling (nominal): 29500 BTU/hr Weight: 800 kg

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

Lustre Performance

18,5

26,2

29,4

33,1 31,3

34,3

0

5

10

15

20

25

30

35

40

400 x NLSAS

Thro

ughp

ut (G

B/s

ec)

Write

1MB RPC Write(Buffered)

1MB RPC Write(O_DIRECT)

4MB RPC Write(Buffered)

4MB RPC Write(O_DIRECT)

16MB RPC Write(Buffered)

16MB RPC Write(O_DIRECT)

19,1 20,2

26,6 26,7

37,6

33,3

0

5

10

15

20

25

30

35

40

400 x NLSAS

Thro

ughp

ut (G

B/s

ec)

Read

1MB RPC Read(Buffered)

1MB RPC Read(O_DIRECT)

4MB RPC Read(Buffered)

4MB RPC Read(O_DIRECT)

16MB RPC Read(Buffered)

16MB RPC Read(O_DIRECT)

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

Summary

14

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

DDN | Summary

▶  Network innovation results in smaller footprint with more performance

▶  Smaller persistent FS with burst buffer cache implementation

▶  Smaller FS with near line archive (object store)

▶  TCO optimization and initial investment optimization

15

ddn.com ©2014 DataDirect Networks. All Rights Reserved. Any representations around future events are subject to change. * Other names and brands may be claimed as the property of others.

Thank You

16