22
0 INTERNAL USE ONLY INTERNAL USE ONLY Copyright 2015 FUJITSU Human Centric Innovation in Action Fujitsu High Performance Computing Ecosystem Dr. Pierre Lagier Chief Technology Officer Fujitsu Systems Europe Innovation Flexibility Simplicity

Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

0 INTERNAL USE ONLYINTERNAL USE ONLY Copyright 2015 FUJITSU

Human Centric Innovation

in Action

Fujitsu High Performance Computing Ecosystem

Dr. Pierre Lagier

Chief Technology Officer

Fujitsu Systems Europe

Innovation

Flexibility

Simplicity

Page 2: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

1 INTERNAL USE ONLYINTERNAL USE ONLY Copyright 2015 FUJITSU

Three challenges for HPC centres

Integration factor

Cooling

Compute Power

Page 3: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

2 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Compute Power: which engine ?

SPARC64 XIfx

• Proprietary implementation of SPARC processor

• 32 cores, 24MB L2 cache

• ~1 TFlops peak performance*

Intel XEON E5 2600

• The most popular processors on earth, largest number of available applications

• Up to 22 cores (EP series), 55MB L3 Cache

• ~0.6TFlops peak performance*

Intel Knights-Landing

• Will it be the new HPC engine ?

• 72 advanced Silvermont cores on one die with 8~16GB on-package multi-purpose memory

• >3TFlops peak performance*

* 64 Bits double precision floating point operations

Page 4: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

3 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Fujitsu HPC Platforms

PRIMEHPC FX100

• focusing on Japanese academic customers and national projects

• Proprietary technologies

PRIMERGY CX-400 (Xeon based)

PRIMERGY CX-xxx (KNL based)

• widely used Intel technology, x86 and KNL, with worldwide support over the 5 continents

• Standards compliant

Page 5: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

4 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

How many compute nodes per rack ?

• General purpose and hybrid parallel applications

• Integrated mid-range to high end

New CX-xxx

• Proprietary platform for hybrid parallel applications

• Integrated high end HPC

FX100 High End HPC

• General purpose and hybrid parallel applications

• Scales in storage memory and number of cores

CX-400 Flexible HPC solution

*assuming 40U rack fully populated

**specific proprietary rack form factor

Peak P

erf

orm

an

ce

C

om

pu

te n

od

es

160* 216** 80*

>500 TFlops

235 TFlops

96 TFlops

40 KW 35

KW 34 KW

Page 6: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

5 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Let’s cool down !

The world’s largest radio telescope, ALMA, located 5,000 meters above sea level in Chile. The ACA Correlator, a ultra-high-speed data processing system Fujitsu deployed solution is based on PRIMERGY servers and FPGA.

The largest university in the kingdom,

using PRIMERGY supercomputer.

Annual mean temperature is 28.4

degrees Celsius (83.2 degrees

Fahrenheit), with an maximum

recorded average of 40° C (104F) in

summer.

The coolest

The warmest

King Abdulaziz University - Jeddah, KSA. ALMA - Atacama desert, Chili

From the

warmest to the

coolest, Fujitsu

has a solution

which fits your

requirements.

Page 7: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

6 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Cool-safe® LCT: How it Works

Heat exchanger

Liquid-to-liquid heat

exchanger between

facilities liquid loop and

server liquid loops.

Facilities and server

liquids are kept separate

and never mix. Pipes move

cooling liquid to

and from

RackCDU to

servers

Pump/cold plate units

atop CPUs, GPUs and

RAM circulate liquid

through server and

RackCDU, collecting heat

and returning to

RackCDU for exchange

with facilities liquid

Leak Detection Panel

(not shown)

Coolant reservoir and control Facility water requirement

Maximum water temperature

Facility supply: 40 °C

Facility Return: 59 °C

Water pressure

Max: 100 PSI

Min: 10 PSI

Page 8: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

7 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

The future of HPC

Page 9: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

8 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Building an Exa-Scale* machine *1,000,000,000,000,000,000 operations/s

Number Cruncher

ARM

AMD / Nvidia

Intel

Memory

Memristor

?RAM??

3D

Interconnect

ARIES

IB TOFU

Power plant

Page 10: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

9 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

ExaScale Workload

Large Hybrid Parallel Applications Hybrid Parallel Applications

Remote

Visualization

Traditional

HPC

workload

Sanbox VM VM

Provisioning VM

Provisioning VM

Provisioning VM

Provisioning VM

Provisioning

Dedicated “On Demand”

Parallel Storage

Private “On Demand”

Parallel Storage

Heterogeneous / Hybrid Parallel

Applications

Virtual

Network

Global Permanent Parallel Storage

Glo

bal In

terc

on

nect

Page 11: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

10 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Traditional HPC Workload

An ExaScale Machine is nothing but a “Super

Massively Parallel System”

TCO and ROI will be critical due the scale of

investments and operations

Reverse trend from Departmental or project

oriented solution to globally centralized IT

Normal end users will not change dramatically because of ExaScale

Any existing application will run on it, even single core ones

Integrated legacy HPC environment will remain almost the same

Remote visualization will play an important role

Remote

Visualization

Traditional

HPC

workload

Page 12: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

11 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Hybrid Parallel Workload

Large Hybrid Parallel Applications

Global Permanent Parallel Storage

Hybrid Parallel Applications

Dedicated “On Demand”

Parallel Storage

Large hybrid parallel applications will

take advantage of ExaScale system

Global permanent parallel storage

will stay as general purpose data

storage ans sharing solution

Specific parallel applications will ensure the

transition to mature new parallel programming

pardigms

Dynamic “on demand” parallel storage will provide

better flexibility as well as higher performance

Page 13: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

12 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Extended usage

Sanbox VM

Private “On Demand”

Parallel Storage

Heterogeneous / Hybrid Parallel

Applications

Virtual

Network

VM

Provisioning VM

Provisioning VM

Provisioning VM

Provisioning VM

Provisioning This will include both classic VM provisioning as well as remote visualization

VM provisioning will introduce more flexibility for end users, extending the capabilities of today Linux clusters

The “sandbox VM” allows end user to

work in highly secured private

environment

Virtual network and interconnect

integration will provide full secured

parallel environment support

Page 14: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

13 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Important facts to take in

account when moving toward

future massively parallel machine.

Page 15: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

14 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Where power consumption really sits ?

Operation (64 bits)

Power Cost (picoJoule)

Multiply & Add 50

On package DRAM read 500

DRAM read 5000

Interconnect send 20000

Network send 40000

Parallel storage write 100000

An Exascale system

will be viable down to

interconnect level with

minimal data

exchange between

the compute nodes

Input/Output will need

to be revisited to

avoid performance

showstopper With current technologies Cloud HPC remains

questionable in front of these numbers

NVRAM ?

Page 16: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

15 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Where data will sit ?

Static legacy parallel data storage

• LUSTRE and similar proven technologies extended with HSM for long time archiving

• Basis for providing applications and data to the compute nodes

Dynamic temporary data storage

• Ultra high speed dedicated parallel storage for single application, created on demand

• Likely NVRAM resident

Private temporary data storage

• Privately owned by a set of VMs

• Accessed through virtual network/interconnect

Page 17: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

16 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

ExaScale will only work if software is ready

Combining vectorization / multi-threading / multi-processing for a single application will increase its

intrinsic complexity

Existing MPI based application might need a rewrite of data distribution for better hybrid parallelism

scientists will need to work with scientific computing experts to exploit the potential of new architectures

0

20

40

60

80

1980's1990's

2000's2010's

2020s

Evolution of HPC applications

Vectorization

Multi-threading

Multi-processing

Page 18: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

17 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

What matters to end users ?

Democratization Team organisation

Application-centric Work management

Coherent interface Expert methods

Page 19: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

18 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Appliances

• Validated architecture

• Preconfigured and tested systems

• “Intel Cluster Ready” compliance

Industry ready solutions

• System oriented appliance unifying HPC and Data Analytic

• Application oriented appliances for solution deployment like Life Science

On going work

Page 20: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

19 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Fujitsu HPC Gateway – Broadening HPC access

Simplify HPC

Build in Expertise

No more scripts – Job preparation in seconds rather than hours

HPC on the Desktop – Intuitive collaborative workplace for newcomers through to practised users

Productive at first login – More users can work with HPC even with little/no IT skill

Page 21: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

20 Copyright 2015 FUJITSU FUJITSU WORLD TOUR 2015

Our Values

© FUJITSU LIMITED 2015

Innovation

Flexibility

Simplicity

We integrates the

best available

technologies to

Fujitsu High

Performance

Computing Solution. Anywhere, anytime,

always available, our

experts have the

answers to your

requirements. We provide you with a

comprehensive set of

tools to make easier

the use of a

supercomputer.

Page 22: Human Centric Innovation Ecosystem in Action · 2019. 4. 13. · Title: Fujitsu High Performance Computing Ecosystem Author: FUJITSUတတတတတတတတ Created Date: 12/8/2015

21 INTERNAL USE ONLYINTERNAL USE ONLY Copyright 2015 FUJITSU