My New Year’s Resolution is 3840 x 21601. The x86 Architecture –… since divested MIPS in 1998 –Our x86 roadmaps extend into 2020+ 2. Open Source Software –We support RHEL,

©2016 SGI. All rights reserved. Mark R. Fernandez, Ph.D. v5.2

New Year’s Resolution

1

SGI Confidential

INTERNAL USE ONLY - Do Not Distribute

My New Year’s Resolution is

3840 x 2160

©2016 SGI. All rights reserved. Mark R. Fernandez, Ph.D. v5.2 ©2016 SGI. All rights reserved. Mark R. Fernandez, Ph.D. v5.2

SGI Update:

Zero Copy Architecture (ZCA)

Mark R. Fernandez, Ph.D. Americas Technology Officer, SGI

+1 864.416.1418

[email protected]


Agenda:

3

– SGI’s Business Overview & Presence

– SGI’s Commitments

– Overview of the SGI Family of HPC Solutions • SGI Rackable

• ICE

• UV

• IDC

– UV300 (UV Building Block)

– UV300 and Zero Copy Architecture (ZCA)

– Summary


SGI Business Overview

4


SGI SGI Finding answers to the world’s

biggest challenges 30+ years of innovation

600+ patents

6,500+ customers

50+ countries

1100+ employees

Leader in High Performance Computing (HPC)

Pioneer in High Performance Data Analytics (HPDA)


SGI Current Business Presence

• Clusters: 4 SGI Petascale Systems

• Shared Memory: UV & 1st to ship Phi

• Storage: 600 PB:

• Hadoop: ~10,000 Nodes across 5 solutions

6

13


SGI’s Commitments 1. The x86 Architecture

– … since divested MIPS in 1998

– Our x86 roadmaps extend into 2020+

2. Open Source Software

– We support RHEL, SLES and other Linux O/S’s

– We contribute: e.g., the XFS file system • XFS was created by SGI in 1993

• Open-sourced XFS in 2000

• XFS is now the default file system for RHEL 7 (2014)

3. US-based Corporation

– SGI Federal, a wholly owned SGI subsidiary

7


SGI HPC Solutions

8


SGI HPC & HPDA Platforms: Covering the Extremes and the Middle Ground

SGI Rackable Commodity: • Processors

• Memory

• Interconnect

SGI ICE • Integrated Cluster

Environment:

Commodity Processors, Memory & Interconnect

• Optimized Density, Power, Cooling and Performance

SGI IDC Hadoop Optimized:

• 480 HDD + compute



9

SGI UV • One Node

• Single System Image

Commodity Processors, & Memory

• SGI Interconnect: Cache Coherent, Globally Shared Memory




• Memory

• Interconnect


Environment:







10

SGI UV • One Node




Operating Systems:

SGI Management Suite (SMS) SGI Foundation Software SGI Management Center Open Source integration

System Management

(w/KVM)




• Memory

• Interconnect


Environment:







11

SGI UV • One Node





UV3000 and UV30 (baby brother) • CPU: Intel E5-4600v3

– Haswell-EP4S (HSW-EP4S)

Up to 256 sockets 4,096 cores (using 16-core processors)

8,192 threads

Up to 64TB of memory

Cache coherent

Globally shared & addressable

• NUMAlink-6 (NL6) (12.5 GT/s)

• HyperCube Topology

12


UV300 Chassis • 5U: 4 sockets per chassis

• E7 IvyBridge-EX -> Haswell-EX

• Up to 3 TB (32GB DIMMs) – 96 DIMM slots ; 24 per socket

– ½ TB = 16 * 32GB

– 1 TB = 32 * 32GB

– 2 TB = 64 * 32GB

– 3 TB = 96 * 32GB

• 3 bulkhead options: 1. 8 PCIe with 4 x 2.5” disks

2. 12 PCIe

3. Compute Only – no PCIe

• NUMAlink-7 (NL-7)

13


UV300 Chassis Architecture

Scale up in 5U chassis increments (4-sockets and up to 3TBs) Maximum per rack: 8 chassis, 32 sockets, 24TB w/32GB DIMMs)

4 Socket (1-3TB) 8 Socket (6TB) 16 Socket (12TB) 32 Socket (24TB)

14


UV300 & UV300H – Topology & Latency • NL7 – up to 32 sockets:

– “non-blocking” interconnect

– 1:1 blocking

– Full B/W Fat-Tree

– Max Hop Count = 1

– Up To 24TB (8*3)

– 1 Rack

• Enterprise says:

“All-To-All” • All-to-All up to 32 sockets

• Max hop count = 1

15


• Nvidia Quadro K5200, K6000, K620

• Nvidia Tesla K20X, K40 and K80

• Intel Phi 5110P and 7120P

– 4 double wide GPUs per chassis

– Max 8 Quadro per SSI

– Max 16 Tesla per SSI

– Max 32 Phi per SSI

UV300 and Co-Processors

16


Intel P3700 NVMe Card

• Breakthrough Performance – 400K random IOPS (Intel numbers)

– 2.4GB/s bandwidth (Intel numbers)

• High Capacity – 800GB … 2TB

• Low Power Consumption – 4, 16, 25 watts

• Low Cost

17


8 x Intel P3700 NVMe Card in a UV300

18


UV + VME Performance Data

32

64

0

20

40

60

80

100

120

140

160

180

200

0

5,000,000

10,000,000

15,000,000

20,000,000

25,000,000

30,000,000

35,000,000

0 10 20 30 40 50 60 70 80

P3700 Cards

IOPS

Expected IOPS

GB/s

Linear (IOPS)

Linear (GB/s)

19


30 Million IOPS = 30+ Arrays …

400% more expensive. Also need HBAs, switches, cables, software…

20


Conceptual HPC Workflow

21

• Traditional Today ∶

𝐶𝑜𝑚𝑝𝑢𝑡𝑒 > 𝑆𝑡𝑜𝑟𝑒 > 𝑪𝒐𝒑𝒚 > 𝐴𝑛𝑎𝑙𝑦𝑧𝑒 • UV + SGI’s Zero Copy Architecture (ZCA):

𝐶𝑜𝑚𝑝𝑢𝑡𝑒 > 𝑆𝑡𝑜𝑟𝑒 (𝐿𝑜𝑐𝑎𝑙𝑙𝑦) > 𝐴𝑛𝑎𝑙𝑦𝑧𝑒


UV300 : Workflow Concept

1. Data Acquisition / Ingest (Stock or custom PCI)

2. QA/QC

3. Pre-Processing

4. Processing…

5. DB Searching w/SSDs

6. Post-Processing

7. “Save Your Science”

8. “Show Your Science”: VizServer

• ZCA: Zero Copy Architecture

• All-to-All

22


UV300 : Sequencing Workflow Concept 1. Data Acquisition: e.g., Illumina Sequencer

2. “QC”, e.g., q-score

3. “QA/Trim”

4. Sequence Aligner • Mapping/Indexing fragments

• e.g., bowtie, tophat

5. Sequence Assembler • Aligning/Merging sequences

• e.g., velvet, pipeline by Illumina

6. Sequence Analysis • DB Searching w/SSDs

7. “Save Your Science”

8. VizServer

• All-to-All

23

ZCA: Zero Copy Architecture


UV300: Integrated Compute & Storage • Single Rack UV300 system delivers:

– Compute: • Up to 480 Intel Xeon cores

– Memory: • Up to 24TB DRAM (32GB DIMMs)

– Non-volatile Memory: • Up to 128TB FLASH (8x8x2TB)

• 30 Million IOPs

• 200 GB/s

• All in one rack, air-cooled

• Zero Copy Architecture (ZCA) Phase I

24


Thanks!

Mark R. Fernandez, Ph.D. Americas Technology Officer, SGI

+1 864.416.1418

[email protected]

25


Q&A:

26


27

Documents

My New Year’s Resolution is 3840 x 21601. The x86 Architecture –… since divested MIPS in 1998 –Our x86 roadmaps extend into 2020+ 2. Open Source Software –We support RHEL,