Convergence between HPC and Big Data: The Day After...

Preview:

Click to see full reader

Citation preview

ConvergencebetweenHPCandBigData:ConvergencebetweenHPCandBigData:

TheDayAfterTomorrow

DanReed

dan.reed@utah.eduwww.hpcdan.org

Thepurposeofcomputingisinsight,notnumbers.

RichardHamming

ReducedModel

ComputationalModel

ReducedModel

Meetings Roadmap

Meetings Questions

Participants• The“usualsuspects”

IoT/Edge,Biginstruments BigdataAI,extremecomputing,clouds

Missingparticipants• Deeplearningcommunity• Newsciencedemands• InfrastructureprovidersShiftinglandscape• Infrastructurecapabilities• Scienceexpectations

ShortenedversionoftheJanuaryreport:https://bit.ly/2qOIOBj

HPC

DeepLearning

Edge&AI

Size Nano Micro Milli Server Fog Campus Facility

Example AdafruitTrinket

Particle.ioBoron

ArrayofThings LinuxBox Co-located

Blades1000-nodecluster

Datacenter&Exascale

Memory 0.5KB 256KB 8GB 32GB 256 GB 32TB 16PB

Network BLE WiFi/LTE WiFi/LTE 1GigE 10GigE 40GigE N*100GigE

Cost $5 $30 $600 $3K $50K $2M $1000M

Edge HPC/Cloud/InstrumentFog

CountxComplexity=~Constant Statefulvs.Stateless

CommonDigitalContinuumPlatformforBigDataandExtremeScaleComputing

Sixinternationalmeetingsspreadovertwoyearshttps://bit.ly/2RVxSgR

Broaddiscussions

1010

This image cannot currently be displayed.

ThankYou

dan.reed@utah.edu

Recommended

Big Data/AI and HPC Convergence Towards Post-K - Post H2020...Big Data/AI and HPC Convergence Towards Post-K Director, Riken Center for Computational Science / Professor, Tokyo Institute
Documents
Research & Innovation funding opportunities for Big Data in … · 2017-11-06 · algorithms for key applications and support to the HPC ecosystem • Convergence of HPC, Big Data
Documents
HPC, Big Data, and Machine Learning Convergencedsc.soic.indiana.edu/presentations/HPC-BigData... · Digital Science Center Convergence of HPC, Systems, ML/AI, Big Data, Clouds, EdgeConvergence
Documents
The INRIA Project LAB HPC-BigData: …...The INRIA Project LAB HPC-BigData: Addressingthe HPC/Big-Data/IA Convergence Bruno Raffin, INRIA Grenoble Rhône-Alpes Lyon, October 2018 The
Documents
The convergence of HPC and BigData...FOSDEM 2019 – Feb 03, 2019 – Brussels | damien.francois@uclouvain.be The convergence of HPC and BigData What does it mean for HPC sysadmins?
Documents
LINQ to HPC: Developing Big Data Applications on Windows HPC Server
Software
HPC & Big Data Convergence - IXPUG...HPC and Big Data • HPC technologies are needed by Big Data to deal with the ever increasing Vs of data in order to forecast and extract insights
Documents
HPC Technologies for Big Data - HPC Advisory Council - A community
Documents
Convergence between HPC and Big Data: The Day After …sc18.supercomputing.org/proceedings/panel/panel...Agenda Panel presentations ( 10 min each) MaximeMartinassoon for the convergence
Documents
STORAGE-BASED CONVERGENCE BETWEEN HPC AND CLOUD …bigstorage-project.eu/images/Deliverables/BigStorage-D3.1.pdf · STORAGE-BASED CONVERGENCE BETWEEN HPC AND CLOUD TO HANDLE BIG DATA
Documents
Pathways to Convergence - European eXtreme Data and ... · BDEC = Big Data & Exascale Computing. European HPC Technology Projects 3 • Successor to the IESP (International Exascale
Documents
Exploring HPC and Big Data Convergence: A Graph Processing ...aua400/pubs/cluster18-hpc-bigdata-convergence.pdf · Exploring HPC and Big Data Convergence: A Graph Processing Study
Documents
HPC and Big data convergence - events.science-japon.orgevents.science-japon.org/hpc17/slides/Serge Petiton... · HPC and Big data convergence Serge G. Petiton, UniversitéLille 1
Documents
AI + HPC Convergence...Motivation for Convergence • HPC owners constrained in growing compute while also dealing with increasing complexity and larger data sets • Call for AI and
Documents
HPC. Big Data. Convergence. Performance-optimized EPYC 7000 Series_201811.pdf · ‧Arti˜cial Intelligence ‧Machine Learning ‧HPC ‧Virtualization Application 7000 EPYC Series
Documents
The Convergence of HPC and Deep Learning
Technology
Big Data, Simulations and HPC Convergence - About DSCdsc.soic.indiana.edu/publications/HPCBigDataConvergence.pdf · Big Data, Simulations and HPC Convergence 5 for streaming data
Documents
Big data, Clouds & HPC
Technology
The Convergence of AI and HPC: A New Hybrid Architecture for … · 2019. 1. 24. · The Convergence of AI and HPC: A New Hybrid Architecture for High Performance Data Analytics
Documents
NVIDIA TO ACCELERATE THE HPC-AI CONVERGENCE · 2020-03-23 · BIG DATA IN SCIENCE Big Science ingests/outputs Big Data Large Hadron Collider Square Kilometer Array Johns ... (FP32/FP16)
Documents