41
The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

The Convergence of AI and HPC: A New Hybrid Architecture for High Performance

Data Analytics

Page 2: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

3. BullSequana XH2000

4. Codex AI Suite:

5. BullExtreme Factory:

Agenda

Page 3: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Convergence of HPC, HPDA and AI architectures

Page 4: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Insatiable need for increasing compute power:

4

Page 5: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Increasing parallelism inevitable

Page 6: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Factors Driving Innovation in HPC and DL

Page 7: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Combining the strengths of HPC and Deep Learning

Page 8: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Incorporating DL as part of the HPC WorkflowHPC Deep Learning

Page 9: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Use of DL for uncertainty modelling

Page 10: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Organising HPC + DL Convergence

Transformation Augmentation Modulation

Potential for Breakthroughs in Scientific Insight

Page 11: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Exascale Deep Learning Enabled Precision Medicine for Cancer

Page 12: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Semi-supervised Deep Learning to detect tissue abnormalities

Page 13: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Gravitational Waves – Next steps

Max Plank Institute

Background

Challenge

Solution

Page 14: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000HPC and DL Hybrid Architecture

Page 15: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000

Enhanced flexibility allows to reduce TCO, from one rack up to Exascale projects

A field proven platform•

BullSequana XH2000 featuring Intel® Xeon® Scalable processors

Page 16: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000

Seamlessly integrated with Codex AI Suite and Google Cloud Platform

Mix & Match Compute and AI workloads on the same platform…

Using best in class CPU/GPU/FPGA & Interconnects

Page 17: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000

Best in class Power Usage Effectiveness (PUE)

Very high density and usage of available resources

Page 18: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000 Blades

Volta P100/V100 NVLink2

Xeon SP Skylake / Cascadelake

ThunderX2ThunderX3 when available

New EPYC Rome

Page 19: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000 Networking

Page 20: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

42U Cabinet Back Front

BullSequana XH2000

42U Cabinet Front View 42U Cabinet Rear View

Page 21: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Entry level simulation system

BullSequana XH2000 Flexibility

Page 22: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Entry level simulation system Deep Learning Training System

BullSequana XH2000 Flexibility

Page 23: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000 Flexibility

Entry level simulation system AI augmented HPC SystemDeep Learning Training System

Page 24: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000 Flexibility

Entry level simulation system AI augmented HPC SystemDeep Learning Training System Memory Bound Apps Sim. System

Page 25: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

BullSequana XH2000 Flexibility

Entry level simulation system AI augmented HPC systemDeep Learning training System Memory bound simulation System

Page 26: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Codex AI Suite:

Page 27: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Phase 2 : Model Prediction/RecallPhase 1 : Model Training

Codex AI Suite tackles the large-scale Deep Learning Problem

Page 28: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Main Requirements for a Deep Learning Self Service model

Page 29: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Codex AI Suite at a glance

STUDIO

FORGE

ComponentsBlueprints

DL frameworks

Data setsTrained models

FastML ENGINE

Application Builder FastML Engine

ORCHESTRATOR

High Level API

Page 30: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

The Codex AI Suite

Codex AI Studio is the common workbench to develop use cases

Orchestrator

Page 31: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

3 key Codex AI Suite benefits

01

02

03

Increases data scientist productivity

Provides a complete cognitive eco-system ready to work

Delivers optimal performance at low cost

Page 32: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Expanding Extreme Factory for Deep Learning

Page 33: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

HPCaaS architecture

Page 34: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

HPCaaS and DLaaS architecture

Page 35: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Deep Learning Self Service (DLSS)C

od

ex A

I Su

ite

Bu

ll Ex

trem

e

Fcat

ory

Page 36: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Summary

Page 37: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Summary

2. The BullSequana XH2000:

3. Codex AI Suite:

4. BullExtreme Factory:

Page 38: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Thanks to our partner Intel

For more information please contact:

+44 7966 [email protected]

Page 39: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

End-to-end, fast development of complex enterprise use cases

Applications are infrastructure-agnostic

HPC business can deliver NG applications

Codex AI Suite differentiators

Page 40: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Key scientific areas include:

Extreme Factory UK – working with STFC Hartree Centre

Atos Solution:

••

Page 41: The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics

Key scientific areas include:

JADE – working with Oxford University and The Hartree Centre

Atos Solution: