Embed Size (px)
Citation preview
SGI: HPC Solutions
Andre Gardinalli
Account Manager
Fabio Alves
Systems Engineer
The Digital Universe is Exploding
Source: The IDC’s 6th Annual Study of the Digital Universe
2009
2020
GROWING BY
A FACTOR OF 300
• Stretching IT resources
• Outpacing conventional
IT infrastructure
• Changing traditional
R&D practices
• Straining ability to
derive value
Real Consequences for Today’s
Organizations
©2013 SGI SGI Company Proprietary 3
©2013 SGI
SGI Finding answers to the
world’s biggest challenges 30+ years of innovation from SGI and Silicon Graphics Inc.
600+ patents and patents pending
6,500+ customers
50 countries
1400 employees
High Performance Computing experts
A Rich Heritage Finding Answers
1996 1998 2000 2001 2003 2006 2007 2008 2009 2010 2011 2012 2013
©2013 SGI SGI Company Proprietary
Coin term “Big Data” John R. Mashey
Chief Scientist
Silicon Graphics Inc.
5
Committed to Innovation
©2013 SGI SGI Company Proprietary
Source: Most recent 10Ks on file with the SEC
2%
3%
6%
8%
DELL HP
IBM SGI
Performance
Power & Cooling
High Density
User Experience
R&D as a % of Revenue
6
Solution Foundation
Best-of-Breed | Factory Integrated | Eco-efficient
Compute
Managem
ent
Storage
Networking
Serv
ices
©2013 SGI SGI Company Proprietary
Cluster * Shared Memory * Cloud
SAN/NAS/DAS * XFS®/CXFS™/Lustre * Active Archive
NUMAlink® * Infiniband * Fibre Channel * Ethernet
Desig
n *
Dep
loym
en
t *
Su
pp
ort
Cen
tra
lize
* A
uto
ma
te *
Tu
ne
7
SGI Solution Focus
Technical
Computing
Big Data
Analytics
Petascale
Storage
Gov’t /
Intelligence Gov’t /
Intelligence
Research
Markets
Manufacturing
/ VPD
Telco / Media /
Entertainment
Financial
Services
D O M A I N K N O W L E D G E
Speed - Scale - Efficiency
©2013 SGI SGI Company Proprietary
H
P
C
8
Distributed Memory SGI® ICE™ X
Technical Computing ─ It’s our DNA
©2013 SGI SGI Company Proprietary
Technical
Computing
• World’s Fastest
Commercial
Supercomputer
• #1 Performance per
Watt for x86
• Largest IB-based
system deployment
• Largest cache-
coherent in-memory
system
• Fastest shared
memory benchmark
• Operate like single
workstation
• Value-driven
performance and
capacity
• Simplified cluster
management
• Complete factory-
integration
Shared Memory SGI® UV™
HPC Clusters SGI Rackable®
Scale Out Systems Scale Up Systems
9
Characterization of ANSYS Applications
... ANSYS FLUENT ANSYS CFX
ANSYS LS-DYNA
ANSYS Mechanical
ANSYS HFSS
Data Reuse (Flops / Word)
Sc
ala
bil
ity
Low
High
Memory BW Dependent Clock Frequency Dependent
Low High
Typical HPC Behavior of a Single Job for Various Applications
CFD
(Transient)
CFD
(Steady-state)
Explicit CSM
Implicit CSM
(Statics)
Implicit CSM
(Direct Freq)
CEM
(High Freq)
SGI® Rackable® or ICE™ Clusters
Mem
~128GB
System + OS
Mem
System + OS
Mem
System + OS
Mem
System + OS
InfiniBand or Gigabit Ethernet
CEM
(Low Freq)
Implicit CSM
(Modal Freq) ANSYS Mechanical
ANSYS FLUENT ANSYS CFX
ANSYS Mechanical
Global shared memory to 16TB (per rack)
SGI® NUMAlink® 6 Interconnect
One System + One OS
CFD
(Transient)
CFD
(Steady-state)
Explicit CSM
Implicit CSM
(Statics)
Implicit CSM
(Direct Freq)
CEM
(High Freq)
SGI® UV™ 2000 Platform
CEM
(Low Freq)
Implicit CSM
(Modal Freq)
ANSYS HFSS
Characterization of ANSYS Applications Typical HPC Behavior of a Single Job for Various Applications
Data Reuse (Flops / Word)
Sc
ala
bil
ity
Low
High
Memory BW Dependent Clock Frequency Dependent
Low High
12
In 2010, NASA saved an estimated 2,000,000 hours of user productivity with the “Live Integration” of 512 cores of ICE…
NASA has saved millions and millions of hours since!
“Live Integration” – SGI ICE
SGI Hypercube enables Compute capacity Additions w/o Production Interruption!
Competitor network topologies are incapable or inherently limited in supporting this capability
System Details- - 2.88 PF peak, 166 racks/ 11,136 nodes - 200K+ cores - 417 TB total memory - DDR, QDR & FDR InfiniBand® in one system
- Dual Plane partial 11D SGI Hypercube - Gigabit Ethernet management network
Common InfiniBand Topologies
13
All-to-All
Fat Tree
(CLOS
Networks)
Hypercube Enhanced
Hypercube
All Supported on SGI ICE X
SGI NDA Required:
Do Not Re-Distribute
©2013 SGI
Large Scale HPC:
M-Cell
Traditional Data Center:
D-Rack
Rack Environment al Options:
Container Environments:
Leverage Cell Solutions
SGI NDA Required:
Do Not Re-Distribute
14
©2013 SGI 15
HPC RAID
IS17000, IS5600, IS5100
• Leading IOPS & B/W
performance
• High density and
energy efficiency
• Highly scalable
CXFS and Lustre F/S
• Scale-out storage
without limits
• No RAID rebuilds,
zero data loss
• Integrated, high
performance
• Scans and profiles
storage consumption
• Auto data movement,
seamless user access
• Multi-tier, policy rich,
extreme scale
SGI InfiniteStorage Ecosystem Scale Smart
©2013 SGI SGI Company Proprietary
Petascale
Storage
Object Storage
SGI® OmniStor™
Active Archive SGI® Trusted Edge™, DMF™,
StorHouse™, OmniStor™
16
Analyze Migrate Manage
©2011 SGI
DMF Sample Customers
17
NASA Ames (40 GB/sec) - 60.0 PB GFDL/NOAA (78 TB/day) (Weather) - 36.0 PB CSC Finland - 30.0 PB NASA Goddard - 20.0 PB NBA Digital Media Management (6TB/day) - 15.0 PB Australia National University - 14.0 PB WETA Digital Ltd. (Movie visual effects) - 10.0 PB National Geographic Film Library - 7.0 PB CESNET, Czech Republic - 6.0 PB CEA/CCRT (French Atomic Energy Agency) - 5.0 PB CSIRO Australia (18 yrs in prod.) - 4.8 PB Météo France (13TB/day) – With Lustre - 4.5 PB SARA Computing and Network Services (Netherlands) - 4.0 PB Monash University (Australia) - 4.0 PB INA (French National Institute for Audio & Video) - 3.4 PB Pittsburgh Super Computing - 3.0 PB British Petroleum - 2.7 PB TU Dresden - 2.5 PB CEA (French Atomic Energy Agency) - 5.0 PB Boeing - 2.0 PB IFS, ShockWave Lab, Tohuku U. Japan - 2.0 PB TOTAL - French Oil and Gas - 1.9 PB SARA Computing and Network Services (Netherlands) - 1.5 PB CINES (GENCI) - 1.7 PB
Challenges
• Need massive data management infrastructure
• Manage petabytes of data from 2 ground breaking projects
Solution
• SGI InfiniteStorage
- 100PB of online storage virtualized across multiple
performance tiers by SGI DMF software
- SGI LiveArc™ manages data ingest/workflow
- SGI MAID cache
- 40PB tape capacity and expansion capabilities
• SGI UV 2000
Benefits
• Massive, growing data volume stored and managed cost efficiently
• Powerful data visualization with order of magnitude greater image size
SGI Storage in Action at iVEC HPC, Network & Visualization Capabilities for AU Research Comm.
“SGI's storage and
data analysis
infrastructure is a vital
component of the
Pawsey infrastructure.”
Neil Stringfellow,
Executive Director, iVEC
Petascale
Class
Storage
©2013 SGI SGI Company Proprietary 18
• Customer-focused
design & execution
• Global reach
• Subject matter experts
• Cleared resources
available
SGI Services: Maximizing Your ROI
Professional
Services
Installation &
Operational
Services
Support
Services
Education
Services
©2013 SGI SGI Company Proprietary 19
©2013 SGI
SGI Finding answers to the
world’s biggest challenges
Thank You
©2013 SGI SGI Company Proprietary 21
Appendix – Vertical Workflows
©2013 SGI SGI Company Proprietary 22
Life Science Workflow: NGS Environments
23
Genomic Sequencers
Lab Environment
Workload: Sequential Writes, CIFS
Multiple TB per day
HPC Computational Cluster
Datacenter Environment
Workload: Primarily Scalable Read
Parallel Filesystem, NFS access
Processing Jobs in Parallel
General Purpose Access
Desktop Environment
Workload: Standard NAS
Multiple Researchers,
Collaborative Access
Petascale Global Namespace ●
●
●
Read Write
Shared Storage
Object Store (S3 CDMI OpenStack)
©2013 SGI SGI Company Proprietary
CAE Workflow: Scale-up and Scale-out
Typical CAE Workflow
• CAD model creation
• Mesh-generation
• Model decomposition
• Running solvers
• Viewing results
• Adjust and repeat
Mixed Workflow
SGI® CXFS™, Lustre™,
Gluster and Panasas®
Infiniband or GigE Fabric
SGI® UV™ SGI® Rackable™ SGI® ICE™ X
or
©2013 SGI SGI Company Proprietary 24
Digital Media Workflow: SGI Ecosystem SAN, CXFS, Gateway, MAID, Object Storage, Tape
NAS CXFS
InfiniteStorage RAID
SAN
MAID
FC
S3 /
CD
MI
Op
enSt
ack
Cloud
Object Storage
FC
CIF
S/N
FS
Edit, CGI, Color
Capture & Ingest
FC
Proxy, Log, Browse, MAM, Render
Encode / Transcode
Playout & Distribution
InfiniteStorage Gateway
FTP
Aspera Signiant
FC CIFS/NFS
Preserve / Archive / Protect / Distribute
CIFS / NFS
FC
FC
Preservation/Retention
CIFS/NFS
CIFS/NFS
Zero-Watt Tape
DMF
©2013 SGI SGI Company Proprietary 25
Appendix – Case Studies
©2013 SGI SGI Company Proprietary 26
Customer • CBIS and Mechanobiology Institute at NUS
• Researches biological processes at the molecular, cellular, and tissue levels
• Acquires/analyzes large datasets from in-house optical + electron microscopes
Challenges • Facing exponential real-time data acquisition growth: cameras approaching 10K x
10K resolution, acquisition rates >1GB/s
• Windows servers can’t handle huge datasets – now GB-TB and 200K files each, expecting 10TB and >1M files each
• Need Linux/UNIX-based compute + large shared memory for image-data analysis programs
Solution • SGI UV2000 solution with 80 CPUs, 2 Intel Phi co-processors (CBIS)
• SGI InfiniteStorage 5500 with 150TB raw capacity (MBI)
Benefits • Complete solution for data-intensive research
• Best “performance, feature set, ease of use, manageability, reliability” at affordable $
• 4X performance at lower cost (compared to UV1000)
• Space-saving, high-density rack (IS5500)
• Within-days installation/deployment
“SGI provides the tools that
enable us to answer our
critical biological research
questions in a timely and
efficient manner.”
- Alan Davis, Senior Facility
Manager, IT, CBIS and MBI
SGI in Life Science
SGI® UV™ -- The Big Brain for No-Limit Computing
©2013 SGI SGI Company Proprietary 27
The need to support short term custom
product design work without having to
purchase new custom-configured
hardware for each new project that may
last only six weeks
• SGI® UVTM 100 with Intel® Xeon®
processor X7560
• Rackable C2112-based cluster with Intel®
Xeon® processor X5650
• 624 total cores, 3.136TB of RAM and a
unified 10 Gigabit Ethernet fabric
• Kernel-based Virtual Machine (KVM)
using Intel® Virtualization Technology (Intel
VT) to run virtual machines (VMs) across
shared-memory and cluster resources
• High-performance storage and backup
including ArcFinitiTM file-based archiving
solution with Intel® Xeon® 5600 processor
series to control 150 TB of backup and
archival storage
ANSYS Mechanical and FLUENT, Abaqus,
Accelrys and a variety of in-house applications
in-house
3M Transforms Research and Development
with Hybrid Cluster
Challenge
Applications
Solution
©2013 SGI SGI Company Proprietary 28
• Flexibility: 3M increases business agility by running a broad range of HPC software
without specialized hardware or custom modifications
• Energy-efficient performance: 3M’s applications run an average of 50% faster, helping
users increase design productivity and innovation
• Private cloud foundation: The system’s virtualized performance gives 3M a solid base
for cloud services that will provide additional flexibility; CPU-bound applications show little
virtualization penalty
“ We are a little different in how we support and provide services to our R&D organization. We don’t
just give them off-the-shelf tools and say, ‘Go at it.’ We listen to them and try and come up with
innovative ways to help them do their job better and faster. More often than not, we are able to help
them solve what would have been an intractable problem maybe just a few months ago.”
– Peter Bye, Systems Architect, 3M
Impact
3M Transforms Research and Development
with Hybrid Cluster
29 ©2013 SGI SGI Company Proprietary
• NBA Challenge: • 16 games played simultaneously
• Each game with 9 cameras of HD content
• Over 500 time-stamped logging events for each game
• All content and metadata routed to NBAE Secaucus NJ
• Editors must quickly isolate interesting content, produce customized packages for live broadcast, and clips for rebroadcast by sports outlets
• SGI Solution: • Store 7 PB+ in active archive - using only 200 TB of disk
• Users seamlessly access ~ 2000 files per day
• Ingest up to 38 TB daily
• Manage over 450,000 tapes and 50+ years of digitized footage
• No data has ever been lost
Digital Media Case Study
©2013 SGI SGI Company Proprietary 30
Appendix – Awards
©2013 SGI SGI Company Proprietary 31
HPCwire Recognizes SGI
32 ©2013 SGI SGI Company Proprietary
