13
ddn.com © 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. 1 1 DataDirect Networks (DDN) HPC Leadership and Innovation: Enabling Scientific Discovery & Exascale Initiatives International Supercomputing July 14, 2015 Frankfurt, Germany Alex Bouzari CEO, Chairman & Co-founder, DDN

Enabling Scientific Discoveries and Exascale Initiatives

Embed Size (px)

Citation preview

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

11

DataDirect Networks (DDN)

HPC Leadership and Innovation: Enabling Scientific Discovery & Exascale Initiatives

International Supercomputing

July 14, 2015

Frankfurt, Germany

Alex Bouzari

CEO, Chairman & Co-founder, DDN

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

22DDN | About UsSolving Large HPC, Enterprise and Web Scale Challenges

World-Renowned & Award Winning

Employees:

≈600 in 20 Countries

Go-To-Market:

Direct, Partner Assist, VARs

History

Founded in ‘98, World’s Largest Private Storage Company, Double

Digit Growth, Profitable, Self Funded

Headquarters:

Santa Clara and Chatsworth, CA

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

33 DDN | Global Strength

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

44

4

DDN | Product Portfolio Evolution

Solve Customer End-to-End Big Data Challenges at Large Scale

► PLATFORMS (Processors, Interconnect, Storage + F/S)

• Deliver Best Price/Performance, Price/Capacity, Price/Latency

► SOFTWARE (IME, WOS, F/S)

• Accelerate and Optimally Manage End to End Customer Workflows

► SYSTEMS

• Deployed Centrally, Distributed & Tiering Into the Cloud

HIGHLY CONFIDENTIAL – DDN PROPRIETARY

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

55 DDN | Commitment & Investment in HPC

Innovation & Strategic Long Term HPC Engagement ► DDN partners with HPC sites to develop state of the art technology

► 65% of the Top 100 HPC sites are DDN customers

Enabling Massive Scalability in Web/Cloud► DDN WOS powers some of the largest Web companies in the world

► WOS manages 200+ Billion Objects (2nd largest behind Amazon)

Optimizing Enterprise Big Data and HPC Applications► DDN profiles, analyzes and optimizes Enterprise Big Data workflows► We streamline end-to-end data flow for 100’s of Big Data customers

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

66

Financial ServicesPowering 40% of Leading Global Investment Banks

ManufacturingPowering 30% of the World's

Top Aero & Auto Manufacturers

Web, Cloud & TelcoPowering the Largest Web

Scale Global Service Providers

Oil & GasPowering Over 50% of the

Largest Oil & Gas Sites

Life SciencesPowering Over 1/3 of theTop Sequencing Centers

DDN | Powering Large Scale Data Analytics

SupercomputingPowering Over 2/3 of the

Top100® HPC Sites

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

77

End-to-End Resource Management

DDN | Integrated, End-to-End Data ManagementThe Software Defined Data Center

Compute & Memory

Persistent Data

(Disk)

Fast Data NVM &

SSD

Distributed Data (SSD

& Disk)

Cloud &Archive

HIGHLY CONFIDENTIAL – DDN PROPRIETARY

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

88

Unmatched Content Distribution Performance

DDN | A Comprehensive Product PortfolioFour Strong Pillars

PLATFORMSSFA™

SSD, SAS, SATA

Embedded F/S and Apps

Storage and Processors

FILE SYSTEMSSCALER™ APPLIANCES

Accelerating Time to Insight

Scale in GB/s, IOPS, TB

Mixed Workloads

OBJECT STORAGEWOS®

Collaboration and Global Distribution, Private and

Public Cloud

Massive Scale & Low Latency

APPLICATIONSIME™

1000x IO Acceleration

100x File System

Acceleration

10x Application Acceleration

Best Price / Performance

Best Price / Capacity

Highest ApplicationEfficiency & Performance

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

99DDN | “Wolfcreek” IntroductionWorld’s Most Advance Hyperconverged Platform

World’s Highest Performance

World’s Highest Density

6 M. IOPs

LOWEST LATENCY EMBEDDED FILE SYSTEMS & APPLICATIONS

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

1010DDN | Infinite Memory Engine (IME)Application Aware I/O Accelerator

IME FIXES BAD FILE SYSTEM &

POOR APPLICATION

PERFORMANCE ISSUES

IME PROVIDES MUCH BETTER I/O BANDWIDTH AND LATENCY TO THE

APPLICATION

IME DRIVES MUCH MORE EFFICIENT I/O TO THE FILE

SYSTEM

1000x IO Acceleration

100xFile System Acceleration

4 GB/s

50 GB/s

25 MB/s

FILE SYSTEM

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

1111S3D IO @ TACC StampedeTurbulent Combustion IO Kernel

Lustre PFS

BURST BUFFER

COMPUTE CLUSTER

3.3 GB/s

S3D IO KernelTurbulent

Combustion

60.8 GB/s

Processes X Y Z IME Write (GB/s)

PFS Write (GB/s)

Acceleration

32 1024 2048 128 14.0 1.5 9.3x

64 1024 4096 128 22.3 1.5 14.9x

256 1024 16384 128 44.7 2.6 17.2x

512 1024 32768 128 53.5 2.4 22.3x

Used PnetCDF + IME MPI-IO ROMIO driver, shared-file IO patterns

HIGHLY CONFIDENTIAL – DDN PROPRIETARY

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

1212

• Global Clustered Object Storage Service • Global storage platform spans 2K locations

and 32 Trillions object from a single client• Deployable as SW or Appliance

• Rich Access methods• Public APIs: WOS Core, Native API, REST,

S3/Swift collocated/independent for scaling• Distributed Geo Search of end user defined

• Optimized low latency access

• Guaranteed highest speed single actuator access for Object 1MB or less

• Multi-layer self describing encoding

DDN | Web Object Storage (WOS) Collaboration, Cloud, Distribution, Live Archive

• N way replication/global encoding

• Global collaboration• Access closest data• No risk of data loss

WOS “Buckets”Contain objects of similar size to optimize placement

WOS Object “Slots”Different sized objects are written in slots contiguously

Slots can be as small as 512B to efficiently support the smallest of files.

25 disk drives5 disk drives

Any server with DAS or WOS 7000

Linux Container #1 Linux Container #2

10GBE 10GBE

Internal Network

WOSCORE

Storage Services

• S3/swift• Parallel search • CIFS/NFS• CEPH

ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.

1313 DDN | Insights Into the Long Term

1. DDN is merging processors, fast interconnects, tiers of NVM and spinning disks through a highly innovative distributed software layer

2. High-speed tiering with non-volatile local and distributed memory pools leverages new multi-core processor, interconnect and memory technology

3. DDN’s IME and WOS technologies enable consolidation across protocols with object stores and archives, while allowing GPFS and Lustre support.

4. DDN achieves significantly higher efficiency from applications, workflows, and computing environments with intelligent and predictive software layers