Dr Mandie Quartly - UCL · •Technical Steering Committee is formed from Work group Leads and Platinum members. Membership options include Platinum, Gold, Silver, and Associate

Dr Mandie QuartlyOpenPOWER Global Alliances, Europe, IBM@mandieq

© 2016 OpenPOWER Foundation

What would you do?

∞ 0Performance Cost


The only constant is change...

Source

http://thehipperelement.com/post/118359687821/evolution


Time

IT E

ffic

ien

cy

Multi-CoreMulti-Thread

Workload Optimised Systems

1970’s ~2004 ~2015 >>2025

Quantum, DNA, Neural or ???

computing

CLOCK ERA CLOUD ERA WOS ERA QUANTUM ERA

ScalingSingle thread


Demands and consumption of technology are changing too..


Introducing the OpenPOWER Foundation…5 Founding members in 2013


Accelerated innovation through collaboration of

partners

Driving industry performance leadership

Vibrant ecosystem through open development

What's OpenPOWER all about?

OpenPOWER is an open development community using the POWER Architecture


This is what a revolution looks like


The power of open…


Speed to innovation | Standards | Choice


Open allows you to create what you need


What's the best tool for the job?


What's so special about POWER anyway?


MemoryBuffer

DRAMChips

POWER8

Up to 12 Cores, up to 96 ThreadsL1, L2, L3 + L4 CachesUp to 1 TB per socket

Up to 230 GB/s sustained memory bandwidth

POWER8 Processor – the low down...


POWER8 Architecture POWER9 Architecture

2014POWER8

12 cores

22nm

New Micro-Architecture

New ProcessTechnology

2016POWER8w/ NVLink

12 cores22nm

EnhancedMicro-

ArchitectureWith NVLink

2017P9 SO24 cores

14nm


Direct attachmemory


TBDP9 SUTBD cores

14nm

EnhancedMicro-

Architecture

BufferedMemory

POWER6 Architecture POWER7 Architecture

2007POWER6

2 cores

65nm



2008POWER6+

2 cores

65nm+

EnhancedMicro-

Architecture

EnhancedProcess

Technology

2010POWER7

8 cores

45nm



2012POWER7+

8 cores

32nm

EnhancedMicro-

Architecture


Focus on EnterpriseTechnology and Performance Driven

Focus on Scale-Out and EnterpriseCost and Acceleration Driven

2018 - 20P9 SO

10nm - 7nm

Existing Micro-

Architecture

FoundryTechnology

Partner ChipPOWER8/9

2020+

New Micro- Architecture

NewTechnology

POWER10

Future

TBD

POWER Processor Roadmap


NVIDIA NVLink Technology

NVIDIA Tesla GPU NVIDIA Tesla GPU with NVLink

POWER8 POWER8with NVLink

80 GB/sPeak*

PCIe x16

Current GPU Attach

Graphics Memory

System Memory

Graphics Memory Graphics Memory

System Memory

40+40 GB/s

40+40 GB/s

16+16 GB/s

Future NVLink GPU Attachment


Typical I/O Model FlowTypical I/O Model Flow

Flow with a Coherent ModelFlow with a Coherent ModelShared Mem.

Notify AcceleratorShared Mem.

Notify Accelerator AccelerationAcceleration Shared MemoryCompletion

Shared MemoryCompletion

CAPP PCIe

POWER8 Processor

DD CallDD Call Copy or PinSource DataCopy or PinSource Data

MMIO NotifyAccelerator

MMIO NotifyAccelerator AccelerationAcceleration Poll / Int

CompletionPoll / Int

CompletionCopy or Unpin

Result DataCopy or Unpin

Result DataRet. From DD

CompletionRet. From DD

Completion

FPGA

Coherent Accelerator Processor Interface (CAPI)


So what's new?


Vision Execution Adoption

Incorporated December 2013

Opening the door, a license to innovate

OpenPOWER Summit March 2015

Game changing solutions

OpenPOWER Summit April 2016

From proof of concept to industry revolution

OpenPOWEROpenPOWEROpen InnovationOpen Innovation


Processors

Building blocks

Servers

“Bringing it all together”


Zaius 1.25 OU• 2 POWER9 CPUS

• 32 DDR4 DIMM SLOTS

• 2X G4 PCIE X16 FHFL

SLOTS

• 1X G4 X16 HHHL SLOT

• 1X G4 X16 OCP MEZ

• 1X M.2 SATA PORT

• 1X SATA PORT

• 15X 2.5” SAS/SATA/NVME

SLOTS

• BMC W/GBE LOM

• “DISKLESS” OPTION


Cross community engagement drives

mutual progress


Load Balancer

500GB Cache Node

10Gb Uplink

POWER8 Server

Flash Array w/ up to 40TB

After: NoSQL POWER8 + CAPI Flash

WWW

10Gb Uplink

WWW

Backup Nodes

500GB Cache Node500GB Cache

Node500GB Cache Node500GB Cache

Node

Before: NoSQL in memory (x86)

24U 4U

Less is More24:1 physical server consolidation =

6x less rack space

24:1 server consolidation

3x lower cost per user

In memory databases using CAPI attached flash


http://developers.openpowerfoundation.org/

http://developers.openpowerfoundation.org/


Two tracks to challenge and win:1. The Open Road Test

– Port and optimize for OpenPOWER– Go faster with accelerators (optional)

2. The Spark Rally– Train an accelerated DNN and recognize

objects with greater accuracy– Show you can scale with Spark

Key Dates

Register todayopenpower.devpost.com

Sun May 1st: Submission periods opens

Tue Aug 2nd: Submission period closes

Grand prizes include a trip to Supercomputing 2016

Other prizes include iPads, Apple Watches

http://openpower.devpost.com/

http://ibm.biz/Summit2016SuperVessel


Back to the original question...

∞ 0Performance Cost


A spectrum of “caring”...

“I couldn't care less about the

platform”

“I want to change the specifics of <stack part>”


continents

60+ technologies revealed

innovations under way 100s

members 200+

24 6 countries

In summary – so much going on...


Join the rebellion!

Main website → openpowerfoundation.orgOverview → ibm.biz/openpower_overview

[email protected]

http://www.openpowerfoundation.org/

http://ibm.biz/openpower_overview

Reference material


AC

TIO

NA

CT

ION

OU

TC

OM

EO

UT

CO

ME

INT

ER

ES

TIN

TE

RE

ST

Technology and Software Innovators

Technology and Software Innovators

Discuss areas of collaboration and synergy in OpenPOWER.

Sign up for membership and join a work group.

Build technical and business relationships.

Discuss areas of collaboration and synergy in OpenPOWER.

Sign up for membership and join a work group.

Build technical and business relationships.

Develop collaborative innovations

with compelling value

Develop collaborative innovations


Innovators, Integrators, and Partners

Innovators, Integrators, and Partners

Deep understanding of workload demands and

consumption preferences of end users.

Team with innovators and end users to drive requirements, engage in specific projects.

Deep understanding of workload demands and

consumption preferences of end users.

Team with innovators and end users to drive requirements, engage in specific projects.

Deliver collaborative innovations


Deliver collaborative innovations


End UsersEnd Users

Strategic imperatives and workload demands for performance and cost

optimization.

Require open software and systems with choice and

flexibility.

Engage directly on system design options.

Strategic imperatives and workload demands for performance and cost

optimization.

Require open software and systems with choice and

flexibility.

Engage directly on system design options.

Deploy collaborative innovations


Deploy collaborative innovations


Engage in the OpenPOWER community


Accelerates Infrastructure Standards

2014 2015 2016

Developer Platform

System SW

HW Architecture

Accelerator

Compliance

SP010 – Tyan OpenPOWER Customer Reference System CAPI – Coherent Accelerator Processor Interface

AFU – Accelerator Function UnitFSI – Field Replaceable Unit (FRU) Service Interface

25g IO Compatibility

Memory

OpenPOWER I/O

11 Work Groups

CharterCompliance SpecificationDraft Review WG Spec

CompSTD

CharterOpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch

OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch

Charter P8 SP010Data

P8 2U2SReference

P8+ 1U1SReference

P8+ 2U2SReference

OPMB Intf. Spec V1Charter

Charter CAPI AFU Intf Spec V1

OpenCL SDK

CAPI AFU Intf Spec V2

Charter

CAPI LinuxSDK 64b ABI

Platform Ref

Sys I/O Enablement GuideCharter

Charter 25g IO Spec

OPMB – OpenPOWER Memory Bus ABI – Application Binary Interface

FSI Specification FSI SpecCharter

SDK – Software Developer Kit

Charter Pers Med

Charter Integrated Solutions Integrated Solutions

Personalised Medicine


Membership Level

Annual Fee$ USD FTEs Technical Steering Committee Board / Voting position

Platinum $100k 10 One seat per member not otherwise represented

Includes board positionIncludes TSC position

Gold $60k 3 May be on TSC if Work group lead

Gold members may elect one board representative per three gold members

Silver $20k $5k if <300 employees 0 May be on TSC if

Work group leadSliver members may elect one board representative for all silver members

Associate & Academic $0 0 May be on TSC if

Work group leadMay be elected to one community observer, non-voting Board seat

The OpenPOWER Foundation is a Not-for-profit entity with a Board of Directors and a Technical Steering Committee.

• Membership levels provide either a default Board of Director position (Platinum) or an opportunity to be elected to the Board (Gold, Silver, and Assoc/Academic members). The Bylaws include additional governance detail.

• Technical Steering Committee is formed from Work group Leads and Platinum members.

Membership options include Platinum, Gold, Silver, and Associate / Academic memberships• Annual fee and dedicated full-time equivalent (FTEs) - verification of FTEs on honor system• Contributors, committers, Work group leads and project leads influence Technical Steering Committee• Associate / Academic level is not available to corporations

Membership agreement, Bylaws, and IP Rights Policy available for reviewwww.openpowerfoundation.org

Anyone may participate in OpenPOWER. Membership levels are designed for those that are investing to grow and enhance the OpenPOWER community and its proliferation within the industry.

Membership Options


Introducing OpenPOWER Ready

● Products / solutions may display badge

● Participants request to use it● Compatibility● Not Certification or

Compliance ● OpenPOWER Ready™ List

http://openpowerfoundation.org/technical/openpower-ready/

http://openpowerfoundation.org/technical/openpower-ready/

© 2016 OpenPOWER Foundation35

2015 2016 2017

POWER8 POWER8 with NVLink POWER9

CAPI Interface Enhanced CAPI & NVLink

Connect-IBFDR Infiniband

PCIe Gen3

ConnectX-4EDR Infiniband

CAPI over PCIe Gen3

ConnectX-5Next-Gen Infiniband

Enhanced CAPI over PCIe Gen4

MellanoxInterconnect

IBM CPUs

NVIDIA GPUs KeplerPCIe Gen3

VoltaEnhanced NVLink

PascalNVLink

Systems

Joint roadmaps looking forward...

You are here

© 2016 IBM Corporation

POWER8 => built for performance

* Intel calls this Hyper-Threading Technology (No HT and with HT) *32KB running in “Non-RAS mode” 16KB results in better RAS **85GB running in “Non-RAS mode” and dual-device error NOT supported

1 = The Micro-architecture features above contributed to premium performance for the POWER8 systems compared to Ivy Bridge systems

Sandy Bridge EP

E5-x6xx

Ivy Bridge EP

E5-26xx v2

Ivy Bridge EX

E7-88xx v2

Haswell EPE5-26xx v3

POWER 7+ Systems POWER8

Clock rates (GHz) 1.8–3.6 1.7-3.7 1.9-3.4 1.6-3.5 3.1–4.4 GHz 3.0-4.1 GHz

SMT options 1,2* 1, 2* 1, 2* 1, 2* 1, 2, 4 1, 2, 4, 8

Max Threads / sock 16 24 30 36 32 96

Max L1 Cache 32KB 32KB* 32KB* 64 KB 32KB 64KB

Max L2 Cache 256 KB 256 KB 256 KB 256KB 256 KB 512 KB

Max L3 Cache 20 MB 30 MB 37.5 MB 45 MB 80 MB 96 MB

Max L4 Cache 0 0 0 0 0 128 MB

Memory Bandwidth 31.4-51.2 GB/s

42.6-59.7 GB/s

68-85** GB/s

51-68 GB/s

100 – 180 GB/sec

115 - 410 GB/sec


Linux support for POWER

Same source and distribution release schedules as x86Simplified x86 application migration with little endian distributions Enterprise support for all three from IBM or distributors


• Over 2,300 Linux ISVs developing on Power• 50 IBM Innovation Centers • Compelling PoCs • Support for little endian applications

Accelerated software innovation

Big Data & Machine Learning

Big Data & Machine LearningCloudCloud Mobile EnterpriseMobile Enterprise

Major Linux Distros

HPCHPC

miniDFTminiDFTCTHCTH

BLASTBLASTBowtieBowtieBWABWA

FASTAFASTAHMMERHMMER

GATKGATKSOAP3SOAP3

STAC-A2STAC-A2SHOCSHOC

Graph500Graph500IlogIlog

CHARMMCHARMMGROMACSGROMACS

NAMDNAMDAMBERAMBER

RTMRTMGAMESSGAMESS

WRFWRFHYCOMHYCOMHOMMEHOMME

LESLESMiniGhostMiniGhostAMG2013AMG2013

OpenFOAMOpenFOAM


Site OxFree On-demand cloud-based development platform using Linux on POWER8 for 2 weekswww.siteox.com

IBM PartnerWorldTechnical Support•IBM Innovation Centers•Free access to Power Hardware•Free porting assistance•Free Eclipse-based development environmentwww.ibm.com/partnerworld/wps/servlet/ContentHandler/pw_com_pwp_partnerworld-program

IBM Innovation CentersAll 50+ centers worldwide now support Linux on PowerOne-stop for ISVs, developersHW access, technical support, demos, toolkits, Hands-on labswww.ibm.com/systems/power/software/linux/centers

IBM Power Development CloudProvide free access to Power hardware to ISVs for Portinghwww.ibm.com/partnerworld/wps/servlet/ContentHandler/stg_com_sys_power-development-platform

Regional Ecosystem Initiative – Recruiting Key SolutionsGreater China, North America, EuropeMiddleware and Industry Solutions

IBM DeveloperWorksTechnical resources, community, blogs, toolkits, How to articles, beta codewww.ibm.com/developerworks/linux/

IBM Watson Developer’s CloudAccess to IBM Watson for developing cognitive computing applicationswww.ibm.com/smarterplanet/us/en/ibmwatson/developers.html

IBM Migration FactoryPremier migration services for large applicationswww.ibm.com/systems/power/migratetoibm/index.html

Lots of resources & support for Linux ISVs and Developers


Coming soon: Barreleye

In partnership with Avago, IBM, Mellanox, PMC & Samsung


Motherboard Chassis Rack

OpenPOWER Open Compute Project systems coming to market


Presentation from recent OpenPOWER Summit

Press release

http://openpowerfoundation.org/wp-content/uploads/2016/04/Edico-Genome-Corp-DRAGEN-2016_04_05.pdf

https://www-03.ibm.com/press/us/en/pressrelease/49479.wss


Cross community collaboration is essential

Documents

Dr Mandie Quartly - UCL · •Technical Steering Committee is formed from Work group Leads and Platinum members. Membership options include Platinum, Gold, Silver, and Associate