19
© 2016 OpenPOWER Foundation 1 Accelerated innovation through collaboration of partners Amplified capabilities driving industry performance leadership Vibrant ecosystem through open development Cloud Computing Hyperscale & Large scale Datacenters High Performance Computing & Analytics Domestic IT Agendas Industry adoption, Open choice OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature Open software ecosystem Market Shifts OpenPOWER, a catalyst for Open Innovation OpenPOWER is an open development community, using the POWER Architecture to serve the evolving needs of customers.

OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

© 2016 OpenPOWER Foundation1

Accelerated innovation through collaboration of partners

Amplified capabilities driving industry performance leadership

Vibrant ecosystem through open development

Cloud Computing

Hyperscale & Large scale

Datacenters

High Performance

Computing & AnalyticsDomestic

IT Agendas

Industry adoption, Open choice

OpenPOWER Strategy

Moore’s law no longer satisfies

performance gain

Numerous IT consumption

models

Growing workload

demands

Mature Open software

ecosystem

Market Shifts

OpenPOWER, a catalyst for Open Innovation

OpenPOWER is an open development community,

using the POWER Architecture to serve the evolving needs of customers.

Page 2: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

22

IBM’s partnership with the UK's Science and Technology Facilities Council (STFC) will

result in technology transfer of advanced computing and big data analytics in new and

improved products, services and manufacturing processes. Researchers, doctors,

engineers, economists and retailers will be able to use big data to make quicker and

cheaper discoveries, as well as better decisions

STFC will be accessing OpenPOWER high performance, data centric computing

servers, leveraging technologies from OpenPOWER foundation members IBM,

NVIDIA, and Mellanox.

IBM partners with the UK's Science and Technology

Facilities Council (STFC) to advance big data and

cognitive computing research.

“Data intensive techniques are transforming every discipline of science, and connecting these

capabilities to the needs of industry has the potential to revolutionize every business sector, The

government’s five-year investment in the Hartree Centre will deliver a step-change in capability in this

area, and will bring in significant knowledge and expertise from IBM Research that will help ensure our

science and industry remains at the very forefront of research and development”

Professor John Womersley, Chief Executive of STFC

Page 3: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

Creating strong UK R&D Centre

– 100+ research staff & scientists

• 35 IBM Research staff in the UK + global reach

• 65 STFC Research staff in the collaboration

– Significant hardware & infrastructure platforms as part of a rolling technology investment programme

• Open POWER Cluster incl ESS, Flash, Nvidia, Mellanox,

• Watson Cognitive cloud capabilities

• Big Data & Analytics with BigInisghts, Streams, SPSS, Cognos

– Access to IBM foreground & background IP

Building on UK Strengths

– Existing SCD and Hartree Centre Capabilities

• Industrial R&D Collaboration for economic impact

• Software development and optimisation

– UK Government Open Data Policy

• E.g. Collaboration with Turing Centre, Open Data Institute

– Strong Science Capability within Academe

Accelerating UK Innovation in key technologies

– Establish UK as leader in Cognitive Computing technologies

– Develop next generation Data Centric Systems to enable Cognitive & Big Data

– Deliver seamlessly through the Cloud

Give UK Industry a significant competitive advantage

– Early access – through the STFC/IBM Innovation Hub

– Direct access - build a portfolio of projects across the breadth of UK industry

– Shape the future - leverage to create new markets from UK Innovation

Embedded

IBM Researchers

Daresbury

Scope & Vision Accelerate UK Competitive Advantage

Page 4: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

IBM & Hartree Collaboration

Project Areas

• Initial focus on three domains and enabling

technologies

• Eco-system identification and development:

collaborative partners in industry

• Key measure is the impact on UK based

commercial organizations

• Genomics

• Precision Agriculture

• Food Sustainability and

Security

Life Sciences

• Large Scale Machine Learning

• Algorithms/Implementation to

exploit DCS

• Visualization, Visual Analytics

& Computational Steering

• HPC in the Cloud – tools etc.

• Ease of Access (IPad)

• Uncertainty Quantification

Science, Engineering &

Manufacturing

• Multi-physics component

• Machine Learning component

• Full Jet Engine simulation

under consideration

Enabling Technology

4

• Computer Aided Formulation

• Machine Learning component

• Improvements for Dissipative

Particle Dynamics

• HPC in the Cloud POC –

Motivating Problem for

Enabling Technology

Chemistry

9/21/2016 SMC 2016

Page 5: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

Getting HPC to ‘Work Smart Not Hard’

• Typically HPC development is focused on

increased speed.

• The fastest calculation is the one

which you don’t run!

• Can we use machine learning to make

better decisions on which simulations

give the most value?

• Can we use machine learning to improve

resolution of information?

‘Cognitive’ workflow uses 1/3 of the calculations to

achieve 4 orders of magnitude resolution increase

Page 6: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

It all starts with the consumer …

Page 8: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

From To

Accelerate the transformation to a data and information centric organisation …..skilled to operate and navigate in the new world

Page 9: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

Consumable HPC

built a model for liquid

mixtures

coded the interface with

the BlueGene/Q

A powerful supercomputer

on the palm of you hand

Page 10: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

10

300 Gflops

(0.3 Tflops)

MareNostrum

1990

IBM Center

for Advanced

Studies

Barcelona

IBM Innovation

Initiative at BSC

2006

MN2

94 Tflops

2004

MN1

42 Tflops

2005

IBM-BSC

Collaboration

Agreement

2007

Collaboration

Agreement

Addendum

1995 2000

2012-13

MN3

1.1 Pflops

(1100 Tflops)

2013

IBM –BSC

Collaboration

Agreement

CEPBA

IBM - BSC a long research collaboration relationship

2005 2010 2015

4 years 3 years6 years

MareIncognito

Research project

Technology Center

for Supercomputing

2013

Page 11: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

1121-Sep-16

Collaboration Projects

⦁ Cognitive Computing

⦁ Leveraging Data CentricSystems to develop the

solutions

• Genomic sequencing

Health Simulation

Cognitive development throughalliances with Universities and

institutions

Page 12: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

Objectives of Collaboration

Aims to provide support to scientists and engineers to target the grand challenges facing society in the fields of energy and environment, health care and Big Data Processing in High Performance Computing using RISC based Architectures.

• Scale the applications in Science and Engineering towards the peta-flops range,

• Evaluate programming models

• Provide input to the design of future OpenPOWERtechnologies in the range of peta-flop to exa-flop systems and

• Create competence and knowledge for HPC application developers technology developers.

C-DAC’s approach is to explore best possible performance on OpenPOWER Systems and use different performance models to investigate scalability when using many nodes in a cluster mode.

Benchmarking, testing and porting- Stream, LinPack, OpenFoam, MPI Benchmark, GPUBench, SHOC

12

C-DAC’s Collaboration with OpenPOWER Consortium members

•Conclusions

• OpenPOWER eco-system provides new opportunities for co-design and research on HPC architectures and technologies.

• OpenPOWER eco-systems are important to enable heterogeneous architectures required to meet power challenges of applications.

• Results benchmarking and testing the RISC based OpenPOWER Systems with IBM POWER8 System and NVIDIA GPUs (Tesla K40) with CentOS Linux latest release are positive, interesting and insightful. The Benchmarks exercise in the area of High Performance Computing and Big Data Processing framework has been carried out

• OpenPOWER meets a number of challenges of future peta-scale system challenges

Page 13: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

Unprecedented performance and application gains with POWER8 NVLink—delivering >2.5X the CPU-GPU bandwidth

compared to x86 based systems

2 POWER8 CPUs and up to 4 Tesla P100 “Pascal” NVLink GPUs in a versatile 2U Linux server

CPU: GPU NVLink: not available on x86

Simpler programming: Access system memory with page migration to GPU control–users can utilize large (even

1TB+!) data sets and do so without manual data management

Water cooled option: improves data center efficiency and enabling CPU (Turbo)/GPU (Boost) performance to be

maintained at high levels for extended periods of time

IBM and Nvidia Collaboration Minsky (S822LC) for High Performance Computing

13

Introducing NVLink for bandwidth differentiation

Page 14: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

The NVLink Difference Current CPU to GPU PCIe Attachment

System Bottleneck

Graphics

Memory

CPUDDR4

GPUGPU NVLink

115GB/s

80 GB/s

POWER8 with NVLink Technology

CPUDDR4

GPUP

CIe

x16

3.032

GB

/s

Graphics

Memory

Graphics

Memory

POWER8 with NVLinkdelivers >2.5X the

bandwidthPCIe Data Pipe

POWER8 with NVLink

Data Pipe

THE platform for applications utilizing CPU-GPU

bandwidth!

<77GB/s

Page 15: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

Power Acceleration and Design Centre (PADC)- DACH

• Collaboration between

– Research Center Jülich

– NVIDIA Europe

– IBM R&D Labs in Böblingen and Zürich

• Mission Statement

– Support scientists & engineers to target the grand challenges facing society using OpenPOWER technologies

– Grand challenges:

• Energy & Environment, e.g. plasma physics

• Information, e.g. condensed matter physics

• Healthcare, e.g. genomics, brain research

– Create competence and knowledge for Application developers and Technology developers

• Status

– Announced Nov 2014. Technology & application workshop October 2015.

– 4x 824L w/ GPU cluster installed at FZ Juelich, 5x at IBM Boe

• Both systems w/ remote access and used by European application groups

Page 16: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

POWER Acceleration & Design Center (PADC) - France• Collaboration among

– IBM Client Center Montpellier and Zürich Research Lab – NVIDIA– Mellanox

• Mission Statement– Expand the software ecosystem around OpenPOWER– Increase computational performance and energy efficiency– Advance the development of data-intensive research, industrial, and commercial

applications– Focus on direct customer porting and tuning

• Status– PADC announced July 2, 2015 in Montpellier– 2x 824L w/ GPU cluster w/ IB installed – 4-node Firestone w/ GPU cluster scheduled for 4Q2015– Remote access to large cluster in Poughkeepsie, IBM WW benchmark center– Contact Pascal Vezolle ([email protected]) for more details– Engage with your IBM client rep or business partner to begin

http://www.ibm.com/ibm/clientcenter/montpellier/

Page 17: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

STFC POWER Acceleration & Design Center - UK• Collaboration between

– IBM Research

– STFC Hartree Centre at Daresbury Lab

• Mission Statement

– Provide a test environment for enabling industrially relevant applications on OpenPOWER

– Support STFC‘s economic impact in the UK

• Collaborative R&D with academia and industry

• Software and algorithms development

• Training and skills

– Create competence and knowledge for

• Application developers

• Technology developers

• Status

– 2x 824L w/ GPU cluster installed at Hartree Centre

– 16-node Firestone w/ GPU cluster scheduled for 4Q2015

A Research Collaboratory in

association with IBM

Page 18: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

BACKUP

Page 19: OpenPOWER, a catalyst for Open Innovation€¦ · OpenPOWER Strategy Moore’s law no longer satisfies performance gain Numerous IT consumption models Growing workload demands Mature

IBM is investing and collaborating in customer enablement

• POWER Acceleration and Design centers

– Germany, France, UK, and more to be announced in the future

• Center of Excellence

– With Oak Ridge National Laboratory and Lawrence Livermore National Laboratory

• Systems Technical Computing Client Center

– Consulting, Performance and Benchmarking Services – hosted in Poughkeepsie

• Super Vessel

– OpenPOWER development cloud with accelerated Power8 platforms• https://ptopenlab.com/cloudlabconsole/index.html

• POWER Innovation Cloud

– Hosted in Poughkeepsie

• Academic Initiative

– No-cost remote access to Power systems, discounts on purchases, training