Upload
insidehpc
View
66
Download
2
Tags:
Embed Size (px)
Citation preview
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
11
DataDirect Networks (DDN)
HPC Leadership and Innovation: Enabling Scientific Discovery & Exascale Initiatives
International Supercomputing
July 14, 2015
Frankfurt, Germany
Alex Bouzari
CEO, Chairman & Co-founder, DDN
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
22DDN | About UsSolving Large HPC, Enterprise and Web Scale Challenges
World-Renowned & Award Winning
Employees:
≈600 in 20 Countries
Go-To-Market:
Direct, Partner Assist, VARs
History
Founded in ‘98, World’s Largest Private Storage Company, Double
Digit Growth, Profitable, Self Funded
Headquarters:
Santa Clara and Chatsworth, CA
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
33 DDN | Global Strength
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
44
4
DDN | Product Portfolio Evolution
Solve Customer End-to-End Big Data Challenges at Large Scale
► PLATFORMS (Processors, Interconnect, Storage + F/S)
• Deliver Best Price/Performance, Price/Capacity, Price/Latency
► SOFTWARE (IME, WOS, F/S)
• Accelerate and Optimally Manage End to End Customer Workflows
► SYSTEMS
• Deployed Centrally, Distributed & Tiering Into the Cloud
HIGHLY CONFIDENTIAL – DDN PROPRIETARY
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
55 DDN | Commitment & Investment in HPC
Innovation & Strategic Long Term HPC Engagement ► DDN partners with HPC sites to develop state of the art technology
► 65% of the Top 100 HPC sites are DDN customers
Enabling Massive Scalability in Web/Cloud► DDN WOS powers some of the largest Web companies in the world
► WOS manages 200+ Billion Objects (2nd largest behind Amazon)
Optimizing Enterprise Big Data and HPC Applications► DDN profiles, analyzes and optimizes Enterprise Big Data workflows► We streamline end-to-end data flow for 100’s of Big Data customers
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
66
Financial ServicesPowering 40% of Leading Global Investment Banks
ManufacturingPowering 30% of the World's
Top Aero & Auto Manufacturers
Web, Cloud & TelcoPowering the Largest Web
Scale Global Service Providers
Oil & GasPowering Over 50% of the
Largest Oil & Gas Sites
Life SciencesPowering Over 1/3 of theTop Sequencing Centers
DDN | Powering Large Scale Data Analytics
SupercomputingPowering Over 2/3 of the
Top100® HPC Sites
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
77
End-to-End Resource Management
DDN | Integrated, End-to-End Data ManagementThe Software Defined Data Center
Compute & Memory
Persistent Data
(Disk)
Fast Data NVM &
SSD
Distributed Data (SSD
& Disk)
Cloud &Archive
HIGHLY CONFIDENTIAL – DDN PROPRIETARY
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
88
Unmatched Content Distribution Performance
DDN | A Comprehensive Product PortfolioFour Strong Pillars
PLATFORMSSFA™
SSD, SAS, SATA
Embedded F/S and Apps
Storage and Processors
FILE SYSTEMSSCALER™ APPLIANCES
Accelerating Time to Insight
Scale in GB/s, IOPS, TB
Mixed Workloads
OBJECT STORAGEWOS®
Collaboration and Global Distribution, Private and
Public Cloud
Massive Scale & Low Latency
APPLICATIONSIME™
1000x IO Acceleration
100x File System
Acceleration
10x Application Acceleration
Best Price / Performance
Best Price / Capacity
Highest ApplicationEfficiency & Performance
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
99DDN | “Wolfcreek” IntroductionWorld’s Most Advance Hyperconverged Platform
World’s Highest Performance
World’s Highest Density
6 M. IOPs
LOWEST LATENCY EMBEDDED FILE SYSTEMS & APPLICATIONS
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
1010DDN | Infinite Memory Engine (IME)Application Aware I/O Accelerator
IME FIXES BAD FILE SYSTEM &
POOR APPLICATION
PERFORMANCE ISSUES
IME PROVIDES MUCH BETTER I/O BANDWIDTH AND LATENCY TO THE
APPLICATION
IME DRIVES MUCH MORE EFFICIENT I/O TO THE FILE
SYSTEM
1000x IO Acceleration
100xFile System Acceleration
4 GB/s
50 GB/s
25 MB/s
FILE SYSTEM
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
1111S3D IO @ TACC StampedeTurbulent Combustion IO Kernel
Lustre PFS
BURST BUFFER
COMPUTE CLUSTER
3.3 GB/s
S3D IO KernelTurbulent
Combustion
60.8 GB/s
Processes X Y Z IME Write (GB/s)
PFS Write (GB/s)
Acceleration
32 1024 2048 128 14.0 1.5 9.3x
64 1024 4096 128 22.3 1.5 14.9x
256 1024 16384 128 44.7 2.6 17.2x
512 1024 32768 128 53.5 2.4 22.3x
Used PnetCDF + IME MPI-IO ROMIO driver, shared-file IO patterns
HIGHLY CONFIDENTIAL – DDN PROPRIETARY
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
1212
• Global Clustered Object Storage Service • Global storage platform spans 2K locations
and 32 Trillions object from a single client• Deployable as SW or Appliance
• Rich Access methods• Public APIs: WOS Core, Native API, REST,
S3/Swift collocated/independent for scaling• Distributed Geo Search of end user defined
• Optimized low latency access
• Guaranteed highest speed single actuator access for Object 1MB or less
• Multi-layer self describing encoding
DDN | Web Object Storage (WOS) Collaboration, Cloud, Distribution, Live Archive
• N way replication/global encoding
• Global collaboration• Access closest data• No risk of data loss
WOS “Buckets”Contain objects of similar size to optimize placement
WOS Object “Slots”Different sized objects are written in slots contiguously
Slots can be as small as 512B to efficiently support the smallest of files.
25 disk drives5 disk drives
Any server with DAS or WOS 7000
Linux Container #1 Linux Container #2
10GBE 10GBE
Internal Network
WOSCORE
Storage Services
• S3/swift• Parallel search • CIFS/NFS• CEPH
ddn.com© 2015 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others.Any statements or representations around future events are subject to change.
1313 DDN | Insights Into the Long Term
1. DDN is merging processors, fast interconnects, tiers of NVM and spinning disks through a highly innovative distributed software layer
2. High-speed tiering with non-volatile local and distributed memory pools leverages new multi-core processor, interconnect and memory technology
3. DDN’s IME and WOS technologies enable consolidation across protocols with object stores and archives, while allowing GPFS and Lustre support.
4. DDN achieves significantly higher efficiency from applications, workflows, and computing environments with intelligent and predictive software layers