9/ IBM POWER @ OPEN'16

Open source on IBM POWER System

Franz BourletPOWER Linux Technical sales

September 29, 2016

Open standards offer choice

Applications

Operating Systems

Hypervisors

HW Architecture

Software Stack ComponentsCommonality

Difference = $$

Visibility

####

###

##

#

Evolution of SW StackPlatform

Platform

Platform

Platform

Open source driving commonality & reducing expense

Example : new platform for EnterpriseDB project

EDB

Linux LE

KVM

Dell, HP, Lenovo,

x86

EDB

Linux BE

PowerVM

IBM

POWER7

EDB

Linux LE

KVM

Dell, HP, Lenovo,

x86


EDB

Linux LE

KVM

IBM, Tyan, Supermicro,

POWER8

EDB

Linux LE

KVM

Lenovo, Dell, HP,

x86

Same application


Same operating systemSame hypervisorManufacturer choice

EDB

Linux LE

KVM


POWER8

EDB

Linux LE

KVM

Lenovo, Dell, HP,

x86 PLUS :Better performance per Fewer SW licenses100% open ecosystemBetter RASUnparalleled acceleration


Same applicationSame operating systemSame hypervisorManufacturer choice

Manufacturer choice

NVIDIA: Tesla P100 GPU with NVLink Interface

Ubuntu : NVLink compatible OS

Wistron: Platform co-design

Mellanox: InfiniBand/Ethernet Connectivity in and out of server

Samsung: 2.5 SSDs

HGST: Optional NVMe Adapters

Hynix, Samsung, Micron: DDR4

IBM: POWER8 CPU

POWER S822LC for high performance computing

8

Open source virtualisation from IBM (PowerKVM) or distributor

Provides simplicity and familiarity for VMware and KVM x86 Linux admins

Integrates with OpenStack environments, including vRealize

GUI console

Exploits KVM live migration, POWER8 SMT and micro-threading functionalities

Same hypervisor

Built from the same source as x86Delivered on the same schedule as x86

Supported at the same time as x86

Same operating system

Estimated >95% x86/Linux applications written in C/C++will require no source code change, only a recompile

Moving Linux apps to Power has never been easier

Well-written Java applications written in scripting or interpretive languages will run as is

>95%Require no source code change

+

Same application

EDB

Linux LE

KVM


POWER8

EDB

Linux LE

KVM

Lenovo, Dell, HP,


First review


Latest Intel (2016) vs latest POWER (2014)

2S=2 Socket, 4S=4 Socket, 8S=8 Socket, DCM=Dual Chip Module, SCM=Single Chip Module, Low Power Models Not Included, Updated 6/1/2015

Chip FamilyCore

Frequency(GHz)

L1 plus L2 Cache per Core (KB)

Approximate Cache per Core

(MB)

Intel 26xx-V4 (2S, 8+ Cores) 1.7 3.6 320 2.81 3.44

Intel 46xx-V4 (4S, 8+ Cores) 1.8 2.6 320 2.81 4.06

Intel 48xx-V4 (4S, 8+ Cores) 2.0 2.1 320 2.81

Intel 88xx-V4 (8S, 8+ Cores) 2.1 2.8 320 2.81 6.31

POWER8 (DCM, 8+ Cores) 3.02 4.15 608 19.27

POWER8 (SCM, 8+ Cores) 4.02 4.35 608 19.27

IBM z13 5.0 4,320 32.22

Note: Only 3 of the 42 Intel chips included on this chart have greater than 2.81 MB of cache per core. Only 3 of the chips included have clock frequencies >= 3 GHz

Cache per core

Superior price / performance : EDB

2016 IBM Corporation

1.72XBetter

Price-performance

IBM Power S822LC(16-core, 128GB)

HP DL380 Gen9(36-core, 128GB)

Server web price*-3-year warranty

$15,105 $29,871

System Cost-Server + RHEL OS + EDB Annual Subscription @ $1,750 per core

$44,404($15,105 + $1,299 + $28,000)

$94,170($29,871 + $1,299 + $63,000)

EDB pgbenchTotal Transactions per Second

406.6k tps 500.2k tps

$ / k TPS 109 $ / k tps 188 $ / k tps1.72X better

Results are based on IBM internal testing of single system and OS image running with pgbench work load at scale factor of 1000 and are current as of March 16, 2016. Individual results will vary depending on individual workloads, configurations and conditions. OS and EDB support price is for 1 year duration and Hardware is 3 yr standard support.IBM Power System S822LC; 16 cores / 64 threads, POWER8; 3.3 GHz, 128 GB memory, EDB 9.4, RHEL 7.1 compared to Competitive stack: HP Proliant DL380 Gen9; 36 cores / 72 threads; Intel E5-2699 v3; 2.3 GHz; 128 GB memory, EDB 9.4, RHEL 7.1 Both tested configurations represent the highest processor frequency for that specific processor and incuded 2 x 1TB SATA 7.2K rpm HDD, 1 Gb 2-port, 2 x 16gbps FCAPricing is based on web pricing for S822LC http://www-03.ibm.com/systems/power/hardware/s822lc-commercial/buy.html EDB 9.4 http://www.enterprisedb.com/products-services-training/subscriptions-power and HP DL380 Gen9 https://h22174.www2.hp.com/SimplifiedConfig/Index

1.8XBetter per

core

http://www-03.ibm.com/systems/power/hardware/s822lc-commercial/buy.htmlhttp://www.enterprisedb.com/products-services-training/subscriptions-powerhttps://h22174.www2.hp.com/SimplifiedConfig/Index

Superior price / performance : Docker

ALL data is PUBLISHED

SAP results are based on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application. Results valid as of September 8, 2014. Source: http://www.sap.com/benchmarkSPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/SPECjbb2013 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/jbb2013/resultsSPECjEnterprise2010 results are valid as of 9/8/2014. For more information go to http://www.specbench.org/jEnterprise2010/results/Oracle eBS 12.1.3 Payroll Batch Extra Large Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/apps-benchmark/results-166922.htmlSiebel 8.1.1.4 PSPP Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/white-papers/siebel-167484.html

Superior price / performance : other workloads

http://www.sap.com/benchmarkhttp://www.specbench.org/cpu2006/results/http://www.specbench.org/jbb2013/resultshttp://www.specbench.org/jEnterprise2010/results/http://www.oracle.com/us/solutions/benchmark/apps-benchmark/results-166922.htmlhttp://www.oracle.com/us/solutions/benchmark/white-papers/siebel-167484.html

Example : mix of IBM SWG workloads requiring 50 cores (20/PVU) on x86 :Fewer software licenses : IBM SW

- Scale out approach (2-socket) :

70 PVU X 50 X 20 = 70K

- Optimized scale out (4-socket) :

100 PVU X 50 X 20 = 100K

- Scale up approach (> 4-socket) :

120 PVU X 50 X 20 = 120K

- Scale out approach (2-socket) :

70 PVU X 25 X 20 = 35K

- Optimized scale out (4-socket) :

70 PVU X 25 = 35K

- Scale up approach (> 4-socket) :

70 PVU X 25 = 35K

100% open ecosystem

OpenPOWER Foundation : from 0 to 200+ members in 20 months

Complete list on http://openpowerfoundation.org/membership/current-members/

Processors

Semiconductor Technology

System stack innovations are required to drive Cost/Performance

Workload AccelerationServices Delivery ModelAdvanced Memory TechNetwork & I/O Accel

Use Cases

Microprocessors alone no longer drive sufficient Cost/Performance improvements

Processors

Semiconductor Technology

POWER8 Linux

OpenPOWERNEW

Unparalleled acceleration

Chart1

2003.7590.086773132003.75

2004.2571.497438992004.25

2004.7556.74399922004.75

2005.2545.034922005.25

2005.7535.7422005.75

28.3666666728.3666666728.36666667

20.9285714322.5132275120.92857143

2007.2517.867640880

15.5975609814.1806673715.59756098

2008.2511.254497910

2008.758.9321411990

9.247.0890009529.24

2009.755.6261912320

8.4416243654.4652311367.0346869708

2010.753.5438342350

7.8075117372.8125668535.5767940979

2011.752.2321959150

5.7943661971.771584063.9961146186

2012.751.4060190950

2013.251.1158881710

5.3786008230.8856255323.585733882

2014.250.7028774072014.25

2014.750.5578392120

4.68750.4427295333.0241935484

2015.752015.752015.75

Intel 2-socket

Moore's Law

Intel w/o price increase

Price/Performance ($/SIR)

Sheet1

PriceSIR-nSIR/$Intel 2-socketIntel w/o price increasePOWERMoore's LawMoores Law

2003.7590.086773130.011100409

2004.2571.497438990.013986515

2004.7556.74399920.017623009

2005.2545.034920.022204991

2005.7535.7420.027978289

2006.25851300.03525264428.3666666728.3666666770.91666667528.366666670.035252644

2006.751172560.0477815720.9285714320.9285714352.32142857522.513227510.044418331

2007.2517.867640880.055967098

2007.751279820.06411258815.5975609815.5975609838.9939024514.180667370.070518543

2008.2511.254497910.088853364

2008.758.9321411990.111955239

2009.2513861500.1082251089.249.2423.17.0890009520.141063601

2009.755.6261912320.177740137

2010.2516631970.1184606138.4416243657.034686970821.10406091254.4652311360.223952573

2010.753.5438342350.282180241

2011.2516632130.128081787.8075117375.576794097919.51877934252.8125668530.355547104

2011.752.2321959150.447989351

2012.252,0573550.1725814295.7943661973.996114618614.48591549251.771584060.564466583

2012.751.4060190950.711227894

2013.251.1158881710.896147147

2013.7526144860.1859219595.3786008233.58573388213.44650205750.8856255321.129145405

2014.250.7028774071.42272321

2014.750.5578392121.792631244

2015.2530006400.2133333334.68753.024193548411.718750.4427295332.258715368

2015.75

Current CPU to GPU PCIe Attachment

System Bottleneck

Graphics Memory

CPUDDR4

GPUGPU NVLink

115GB/s

80 GB/s

POWER8 with NVLink Technology

CPUDDR4

GPU

PCIe

x16

3.0

32 G

B/s

Graphics Memory

Graphics Memory

POWER8 with NVLinkdelivers >2.5X the

bandwidthPCIe Data Pipe

POWER8 with NVLinkData Pipe

THE platform for applications utilizing CPU-GPU bandwidth!

2.1XBetter

Price-performance

Unparalleled Acceleration with NVLink 2.4X Better Performance at 52% Lower Cost per Query/Hour

26

IBM Power S822LC for HPC

(20-core, 256GB, 4xPascal)

Dell C4130

(20-core, 256GB, 4xK80)

Server price*-3-year warranty

$66,612 $57,615

GPUDBTotal Queries per Hour

444 qph 185 qph

$ / k TPS 150 $ / qph 311 $ / qph2.1X better

52%Lower HW costs and maintenance per qph

2.4XMore Performance

per Server

@

All results are based on running GPUDB query (filter by geographic area query) IBM Power System S822LC; 10 cores (2 x 10c chips) / 160 threads, POWER8; 2.9 GHz, 256 GB memory, 4xP100 GPU; RHEL 7.2. Competitive stack: Dell C4130 E5-2640 v4; 20 cores (2 x 10 chips) / 40 threads; Intel E5-2640 v4; 2.4 GHz; 256 GB memory, RHEL 7.2 . Both server priced with 2 x 1TB

SATA 7.2K rpm HDD, 10 Gb 2-port. Pricing is based on list prices expected for S822LC for HPC and Dell prices form Gartner list price

Accelerated application example : Kinetica

2015 ITIC Global Server Reliability Report

Sources: http://www.bitpipe.com/detail/RES/1446127681_768.html

Category Best Non z Systems Result

Best Tier 1 Unplanned Downtime(Under 1 hour) IBM Power

Best Tier 2 Unplanned Downtime (1 to 4 hours) IBM Power

Best Tier 3 Unplanned Downtime(Greater than 4 Hours) IBM Power

(a)

Best Virtualization Reliability IBM PowerVM

(a) Lenovo x86 was the only x86 platform that achieved a tie with IBM Power for unplanned down time > 4 Hours

Superior RAS

EDB

Linux LE

KVM


POWER8

EDB

Linux LE

KVM

Lenovo, Dell, HP,


Final review


First OpenPOWER Summit Europe 26-28 october

TCO calculator : https://extbasicdsgtool.podc.sl.edst.ibm.com/power8tco/power8_tool.html

POWER portal : http://www-03.ibm.com/systems/power/software/linux/index.html

Videos and demos : https://www.youtube.com/results?search_query=power8+linux

POWER Linux Community : https://www.ibm.com/developerworks/community/groups/service/html/communityview?communityUuid=fe313521-2e95-46f2-817d-44a4f27eba32

OpenPOWER Foundation : http://openpowerfoundation.org/

Google / Rackspace Zaius project :http://www.nextplatform.com/2016/04/06/inside-future-google-rackspace-power9-system/

Test zone : POWER in the cloud : http://www.siteox.com/ - http://www.softlayer.com/POWER open lab : http://ptopenlab.com/cloudlabconsole/#/

Great links

https://extbasicdsgtool.podc.sl.edst.ibm.com/power8tco/power8_tool.htmlhttp://www-03.ibm.com/systems/power/software/linux/index.htmlhttps://www.youtube.com/results?search_query=power8+linuxhttps://www.ibm.com/developerworks/community/groups/service/html/communityview?communityUuid=fe313521-2e95-46f2-817d-44a4f27eba32http://www.siteox.com/

Recent Redbooks

Link

Link

Link to search for Linux on the Power Systems Redbooks site

Link

http://www.redbooks.ibm.com/redbooks.nsf/RedbookAbstracts/sg248171.html?Openhttp://www.redbooks.ibm.com/redbooks.nsf/RedbookAbstracts/redp5098.html?Openhttp://publib-b.boulder.ibm.com/redbooks.nsf/searchdomain?SearchView&query=%5Bsubjects%5D=Power+and+linux&SearchOrder=4&category=Powerhttp://www.redbooks.ibm.com/redpieces/abstracts/sg248231.html?Open

Open source on IBM POWER SystemOpen standards offer choiceExample : new platform for EnterpriseDB projectExample : new platform for EnterpriseDB projectExample : new platform for EnterpriseDB projectExample : new platform for EnterpriseDB projectManufacturer choicePOWER S822LC for high performance computingSame hypervisorSlide Number 10Slide Number 12First reviewLatest Intel (2016) vs latest POWER (2014)Slide Number 15Superior price / performance : EDBSuperior price / performance : DockerSuperior price / performance : other workloadsFewer software licenses : IBM SW100% open ecosystemOpenPOWER Foundation : from 0 to 200+ members in 20 monthsSlide Number 24Slide Number 25Unparalleled Acceleration with NVLink 2.4X Better Performance at 52% Lower Cost per Query/Hour2015 ITIC Global Server Reliability ReportFinal reviewSlide Number 31TCO calculator : https://extbasicdsgtool.podc.sl.edst.ibm.com/power8tco/power8_tool.htmlPOWER portal : http://www-03.ibm.com/systems/power/software/linux/index.htmlVideos and demos : https://www.youtube.com/results?search_query=power8+linuxPOWER Linux Community : https://www.ibm.com/developerworks/community/groups/service/html/communityview?communityUuid=fe313521-2e95-46f2-817d-44a4f27eba32OpenPOWER Foundation : http://openpowerfoundation.org/Google / Rackspace Zaius project :http://www.nextplatform.com/2016/04/06/inside-future-google-rackspace-power9-system/Test zone : POWER in the cloud : http://www.siteox.com/ - http://www.softlayer.com/POWER open lab : http://ptopenlab.com/cloudlabconsole/#/Recent RedbooksSlide Number 34