View
0
Download
0
Category
Preview:
Citation preview
© 2016 OpenPOWER Foundation1
Accelerated innovation through collaboration of partners
Amplified capabilities driving industry performance leadership
Vibrant ecosystem through open development
Cloud Computing
Hyperscale & Large scale
Datacenters
High Performance
Computing & AnalyticsDomestic
IT Agendas
Industry adoption, Open choice
OpenPOWER Strategy
Moore’s law no longer satisfies
performance gain
Numerous IT consumption
models
Growing workload
demands
Mature Open software
ecosystem
Market Shifts
OpenPOWER, a catalyst for Open Innovation
OpenPOWER is an open development community,
using the POWER Architecture to serve the evolving needs of customers.
22
IBM’s partnership with the UK's Science and Technology Facilities Council (STFC) will
result in technology transfer of advanced computing and big data analytics in new and
improved products, services and manufacturing processes. Researchers, doctors,
engineers, economists and retailers will be able to use big data to make quicker and
cheaper discoveries, as well as better decisions
STFC will be accessing OpenPOWER high performance, data centric computing
servers, leveraging technologies from OpenPOWER foundation members IBM,
NVIDIA, and Mellanox.
IBM partners with the UK's Science and Technology
Facilities Council (STFC) to advance big data and
cognitive computing research.
“Data intensive techniques are transforming every discipline of science, and connecting these
capabilities to the needs of industry has the potential to revolutionize every business sector, The
government’s five-year investment in the Hartree Centre will deliver a step-change in capability in this
area, and will bring in significant knowledge and expertise from IBM Research that will help ensure our
science and industry remains at the very forefront of research and development”
Professor John Womersley, Chief Executive of STFC
Creating strong UK R&D Centre
– 100+ research staff & scientists
• 35 IBM Research staff in the UK + global reach
• 65 STFC Research staff in the collaboration
– Significant hardware & infrastructure platforms as part of a rolling technology investment programme
• Open POWER Cluster incl ESS, Flash, Nvidia, Mellanox,
• Watson Cognitive cloud capabilities
• Big Data & Analytics with BigInisghts, Streams, SPSS, Cognos
– Access to IBM foreground & background IP
Building on UK Strengths
– Existing SCD and Hartree Centre Capabilities
• Industrial R&D Collaboration for economic impact
• Software development and optimisation
– UK Government Open Data Policy
• E.g. Collaboration with Turing Centre, Open Data Institute
– Strong Science Capability within Academe
Accelerating UK Innovation in key technologies
– Establish UK as leader in Cognitive Computing technologies
– Develop next generation Data Centric Systems to enable Cognitive & Big Data
– Deliver seamlessly through the Cloud
Give UK Industry a significant competitive advantage
– Early access – through the STFC/IBM Innovation Hub
– Direct access - build a portfolio of projects across the breadth of UK industry
– Shape the future - leverage to create new markets from UK Innovation
Embedded
IBM Researchers
Daresbury
Scope & Vision Accelerate UK Competitive Advantage
IBM & Hartree Collaboration
Project Areas
• Initial focus on three domains and enabling
technologies
• Eco-system identification and development:
collaborative partners in industry
• Key measure is the impact on UK based
commercial organizations
• Genomics
• Precision Agriculture
• Food Sustainability and
Security
Life Sciences
• Large Scale Machine Learning
• Algorithms/Implementation to
exploit DCS
• Visualization, Visual Analytics
& Computational Steering
• HPC in the Cloud – tools etc.
• Ease of Access (IPad)
• Uncertainty Quantification
Science, Engineering &
Manufacturing
• Multi-physics component
• Machine Learning component
• Full Jet Engine simulation
under consideration
Enabling Technology
4
• Computer Aided Formulation
• Machine Learning component
• Improvements for Dissipative
Particle Dynamics
• HPC in the Cloud POC –
Motivating Problem for
Enabling Technology
Chemistry
9/21/2016 SMC 2016
Getting HPC to ‘Work Smart Not Hard’
• Typically HPC development is focused on
increased speed.
• The fastest calculation is the one
which you don’t run!
• Can we use machine learning to make
better decisions on which simulations
give the most value?
• Can we use machine learning to improve
resolution of information?
‘Cognitive’ workflow uses 1/3 of the calculations to
achieve 4 orders of magnitude resolution increase
It all starts with the consumer …
Design new experiment
Test efficacy
Criteria matchComputing
analysis
Patentability, cost & availability
From To
Accelerate the transformation to a data and information centric organisation …..skilled to operate and navigate in the new world
Consumable HPC
built a model for liquid
mixtures
coded the interface with
the BlueGene/Q
A powerful supercomputer
on the palm of you hand
10
300 Gflops
(0.3 Tflops)
MareNostrum
1990
IBM Center
for Advanced
Studies
Barcelona
IBM Innovation
Initiative at BSC
2006
MN2
94 Tflops
2004
MN1
42 Tflops
2005
IBM-BSC
Collaboration
Agreement
2007
Collaboration
Agreement
Addendum
1995 2000
2012-13
MN3
1.1 Pflops
(1100 Tflops)
2013
IBM –BSC
Collaboration
Agreement
CEPBA
IBM - BSC a long research collaboration relationship
2005 2010 2015
4 years 3 years6 years
MareIncognito
Research project
Technology Center
for Supercomputing
2013
1121-Sep-16
Collaboration Projects
⦁ Cognitive Computing
⦁ Leveraging Data CentricSystems to develop the
solutions
• Genomic sequencing
Health Simulation
Cognitive development throughalliances with Universities and
institutions
Objectives of Collaboration
Aims to provide support to scientists and engineers to target the grand challenges facing society in the fields of energy and environment, health care and Big Data Processing in High Performance Computing using RISC based Architectures.
• Scale the applications in Science and Engineering towards the peta-flops range,
• Evaluate programming models
• Provide input to the design of future OpenPOWERtechnologies in the range of peta-flop to exa-flop systems and
• Create competence and knowledge for HPC application developers technology developers.
C-DAC’s approach is to explore best possible performance on OpenPOWER Systems and use different performance models to investigate scalability when using many nodes in a cluster mode.
Benchmarking, testing and porting- Stream, LinPack, OpenFoam, MPI Benchmark, GPUBench, SHOC
12
C-DAC’s Collaboration with OpenPOWER Consortium members
•Conclusions
• OpenPOWER eco-system provides new opportunities for co-design and research on HPC architectures and technologies.
• OpenPOWER eco-systems are important to enable heterogeneous architectures required to meet power challenges of applications.
• Results benchmarking and testing the RISC based OpenPOWER Systems with IBM POWER8 System and NVIDIA GPUs (Tesla K40) with CentOS Linux latest release are positive, interesting and insightful. The Benchmarks exercise in the area of High Performance Computing and Big Data Processing framework has been carried out
• OpenPOWER meets a number of challenges of future peta-scale system challenges
Unprecedented performance and application gains with POWER8 NVLink—delivering >2.5X the CPU-GPU bandwidth
compared to x86 based systems
2 POWER8 CPUs and up to 4 Tesla P100 “Pascal” NVLink GPUs in a versatile 2U Linux server
CPU: GPU NVLink: not available on x86
Simpler programming: Access system memory with page migration to GPU control–users can utilize large (even
1TB+!) data sets and do so without manual data management
Water cooled option: improves data center efficiency and enabling CPU (Turbo)/GPU (Boost) performance to be
maintained at high levels for extended periods of time
IBM and Nvidia Collaboration Minsky (S822LC) for High Performance Computing
13
Introducing NVLink for bandwidth differentiation
The NVLink Difference Current CPU to GPU PCIe Attachment
System Bottleneck
Graphics
Memory
CPUDDR4
GPUGPU NVLink
115GB/s
80 GB/s
POWER8 with NVLink Technology
CPUDDR4
GPUP
CIe
x16
3.032
GB
/s
Graphics
Memory
Graphics
Memory
POWER8 with NVLinkdelivers >2.5X the
bandwidthPCIe Data Pipe
POWER8 with NVLink
Data Pipe
THE platform for applications utilizing CPU-GPU
bandwidth!
<77GB/s
Power Acceleration and Design Centre (PADC)- DACH
• Collaboration between
– Research Center Jülich
– NVIDIA Europe
– IBM R&D Labs in Böblingen and Zürich
• Mission Statement
– Support scientists & engineers to target the grand challenges facing society using OpenPOWER technologies
– Grand challenges:
• Energy & Environment, e.g. plasma physics
• Information, e.g. condensed matter physics
• Healthcare, e.g. genomics, brain research
– Create competence and knowledge for Application developers and Technology developers
• Status
– Announced Nov 2014. Technology & application workshop October 2015.
– 4x 824L w/ GPU cluster installed at FZ Juelich, 5x at IBM Boe
• Both systems w/ remote access and used by European application groups
POWER Acceleration & Design Center (PADC) - France• Collaboration among
– IBM Client Center Montpellier and Zürich Research Lab – NVIDIA– Mellanox
• Mission Statement– Expand the software ecosystem around OpenPOWER– Increase computational performance and energy efficiency– Advance the development of data-intensive research, industrial, and commercial
applications– Focus on direct customer porting and tuning
• Status– PADC announced July 2, 2015 in Montpellier– 2x 824L w/ GPU cluster w/ IB installed – 4-node Firestone w/ GPU cluster scheduled for 4Q2015– Remote access to large cluster in Poughkeepsie, IBM WW benchmark center– Contact Pascal Vezolle (VEZOLLE@fr.ibm.com) for more details– Engage with your IBM client rep or business partner to begin
http://www.ibm.com/ibm/clientcenter/montpellier/
STFC POWER Acceleration & Design Center - UK• Collaboration between
– IBM Research
– STFC Hartree Centre at Daresbury Lab
• Mission Statement
– Provide a test environment for enabling industrially relevant applications on OpenPOWER
– Support STFC‘s economic impact in the UK
• Collaborative R&D with academia and industry
• Software and algorithms development
• Training and skills
– Create competence and knowledge for
• Application developers
• Technology developers
• Status
– 2x 824L w/ GPU cluster installed at Hartree Centre
– 16-node Firestone w/ GPU cluster scheduled for 4Q2015
A Research Collaboratory in
association with IBM
BACKUP
IBM is investing and collaborating in customer enablement
• POWER Acceleration and Design centers
– Germany, France, UK, and more to be announced in the future
• Center of Excellence
– With Oak Ridge National Laboratory and Lawrence Livermore National Laboratory
• Systems Technical Computing Client Center
– Consulting, Performance and Benchmarking Services – hosted in Poughkeepsie
• Super Vessel
– OpenPOWER development cloud with accelerated Power8 platforms• https://ptopenlab.com/cloudlabconsole/index.html
• POWER Innovation Cloud
– Hosted in Poughkeepsie
• Academic Initiative
– No-cost remote access to Power systems, discounts on purchases, training
Recommended