14
The Team The Competition Docker Future Cluster Competition Recap ISC18: High Performance Container Workshop Leonhard Reichenbach Universität Hamburg June 28, 2018 Leonhard Reichenbach Cluster Competition Recap 1 / 14

Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Cluster Competition RecapISC18: High Performance Container Workshop

Leonhard Reichenbach

Universität Hamburg

June 28, 2018

Leonhard Reichenbach Cluster Competition Recap 1 / 14

Page 2: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Agenda

1 The Team

2 The Competition

3 Docker

4 Future

Leonhard Reichenbach Cluster Competition Recap 2 / 14

Page 3: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

The Team

Leonhard Reichenbach Cluster Competition Recap 3 / 14

Page 4: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Our Booth

Leonhard Reichenbach Cluster Competition Recap 4 / 14

Page 5: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Our Setup

12 Intel Xeon Phi 7250F1 as a head node with more memoryall the others diskless over PXESpack to manage the applications

Leonhard Reichenbach Cluster Competition Recap 5 / 14

Page 6: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Our Sponsors

Leonhard Reichenbach Cluster Competition Recap 6 / 14

Page 7: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Student Cluster Competition

Held by the HPC-AI Advisory Council12 teams6 students per team3000 watts power limitno reboots!

Leonhard Reichenbach Cluster Competition Recap 7 / 14

Page 8: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Monday: Benchmarks

High Performance Linpack (HPL)HPC Challenge (HPCC)

HPLDGEMMSTREAMPTRANSRandomAccessFFTCommunication bandwidth and latency

High Performance Conjugate Gradient

Leonhard Reichenbach Cluster Competition Recap 8 / 14

Page 9: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Tuesday: HPC Applications

GridLattice QCDSIMD, OpenMP and MPI

Nektar++Spectral/HP Element FrameworkMPI

Surprise Application: Nek5000

Leonhard Reichenbach Cluster Competition Recap 9 / 14

Page 10: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Wednesday: AI Challenge

TensorFlowVGG16 on Imagenet 2012

Leonhard Reichenbach Cluster Competition Recap 10 / 14

Page 11: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

How we used Docker: Visualisation

Grafana & PrometheusEasy deployment

Leonhard Reichenbach Cluster Competition Recap 11 / 14

Page 12: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

The scripts

Leonhard Reichenbach Cluster Competition Recap 12 / 14

Page 13: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

The scripts

Leonhard Reichenbach Cluster Competition Recap 13 / 14

Page 14: Cluster Competition Recapqnib.org/data/isc2018/UniHH_SCC.pdf · Communication bandwidth and latency High Performance Conjugate ... Lattice QCD SIMD, OpenMP and MPI Nektar++ Spectral/HP

The Team The Competition Docker Future

Future

One container for each application

Leonhard Reichenbach Cluster Competition Recap 14 / 14