IBM Power8 and the Linux EcosystemLuca CompariniISV & Business Development – IBM Global Business PartnersPower Linux Leader Europe
@lucacomparini
@lucacomparini
Before we start: do you know who is this kid?
© 2014 International Business Machines Corporation 2
@lucacomparini
Before we start: do you know who said that?
© 2014 International Business Machines Corporation 3
“Linux is a cancer that attaches itself in an intellectual property sense to everything it touches (…)”
@lucacomparini
Before we start: have you seen this before?
© 2014 International Business Machines Corporation 4
@lucacomparini
Some history and facts on IBM & Open Source
© 2014 International Business Machines Corporation 5
“is getting smarter every day” (2003)
Credits to Michel Teyssedre (2006) – now CTO IBM France
IBM began participating in the community development of Linux in 1999 and Open Source, resulting in:
§ All the IBM servers support Linux operating system
§ Over 500 IBM software products run on Linux
§ A full line of implementation, support and migration services
Active participation in 150+ projects, including:
§ Eclipse, Apache Foundation, Mozilla Firefox, OpenOffice.org, Samba, PHP…
§ Apache Hadoop, Apache UIMA, KVM, Openstack, Cloudfoundry…
“$1 billion commitment” on Linux and Open Source technologies (2001, 2013)
IBM Linux Technology Centers in Bejing, Austin, New York, Montpellier, Tokyo
@lucacomparini
Open Source Trend
© 2014 International Business Machines Corporation 6
Diffusion and interest
2M projects by 2014;; x2 in last 2y.
140% increase in interest purchasing open source software
57% of companies using open source will collaborate with competitors.
41% of people plan to deploy open source solution in 1-2 years.
* “free is free only if your time has no value”
Business dimension
OpenSource Venture investments:+80% between 2011 and 2012
OpenSource means free*?~2B$ in open source sales in 2013
http://blog.gogrid.com/2014/04/08/2014-year-open-source/
@lucacomparini
Linux trend
© 2014 International Business Machines Corporation 7
476 of the Top 500 supercomputers run Linux (2013)Four of the Top 10 supercomputers run on Power Systems. (2014)
Linux for Mission-Critical Workloads (2013)
http://www.linuxfoundati on.org/infographics/2013-enterprise-end-user-report
@lucacomparini
Power paradigm: same technology excellence for scale-up and scale-out systems
© 2014 International Business Machines Corporation 8
Design point is “purposeful”:Enterprise / Mission-Critical workloads (OLTP, ERP, SAP, Big Data, Analytics…)
Design Goals: “consolidate”Consistency, Availability, Reliability, SecurityExtreme performance (throughput per core)>> Less Operational & Licenses Costs
Design point:General Purpose, Cloud, Computing Grids
Design Goals: “distribute”TCA, Standardization (at cost of under-utilization)Performance (throughput per node)>> Affordable acquisition costs, scale is incremental
Systems of Record Structured data from operational systems 20% of all data generated
Systems of Engagement Data that “connects” companies with their
customers, partners and employees80% of all data generated
Power technology fuels:100% of the top10 Banks & Telcos80% of the top 10 Insurers & Retailers
@lucacomparini
Power8 is designed for data: dynamic SMT
© 2014 International Business Machines Corporation 9
Intel HyperThreading: 2 x Threads per CorePower Simultaneous Multi-Threading: 1 / 2 / 4 / 8 x Threads per Core+ 1.6 times single thread performance of Power7+
@lucacomparini
Power8 is designed for data: memory bandwidth
© 2014 International Business Machines Corporation 10
Power8: 230GB/s sustained memory bandwidth96 MB L3 cache, 128 MB L4 cache
@lucacomparini
Unusual transportunfortunately, moving data is a different story
© 2014 International Business Machines Corporation 11
@lucacomparini
Power8 vs Intel comparison (for geeks)
© 2014 International Business Machines Corporation 12
*Intel calls this Hyper-Threading Technology*32KB running in Non-RAS mode, Only 16KB in RAS mode
Sandy Bridge EP E5-26xx
Ivy Bridge EPE5-26xx v2
Haswell EPE5-26xx v3
Ivy Bridge EXE7-88xx v2 POWER 7+ POWER8
Clock rates 1.8–3.6GHz 1.7-3.7GHz 1.7-3.7GHz 1.9-3.4 GHz 3.1-4.4 GHz 3.0-4.15 GHz
SMT options 1,2* 1, 2* 1, 2* 1, 2* 1, 2, 4 1, 2, 4, 8
Cores per socket 8 12 18 15 8 12
Max Threads / socket 16 24 36 30 32 96
Max L1 Cache 32KB 32KB* 32KB* 32KB* 32KB 64KB
Max L2 Cache 256 KB 256 KB 256 KB 256 KB 256 KB 512 KB
Max L3 Cache 20 MB 30 MB 45 MB 37.5 MB 80 MB 96 MB
Max L4 Cache 0 0 0 0 0 128 MB
Memory Bandwidth 31.4-51.2 GB/s 42.6-59.7 GB/s 51.2-68.3 GB/s 68-85 GB/s 100 – 180 GB/sec 190-230 GB/sec
@lucacomparini
Performance comparisons
© 2014 International Business Machines Corporation 13
Java – SPECjbb2013 (Max-jOPS)4.1x Performance
ERP – SAP 2-Tier (Users) 2.4x Performance
SPECint_rate20062.0x Performance
SPECfp_rate20062.2x Performance
• Results are based on best published per core results on Xeon E7-8890 processor.• SAP results are based on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application. Results valid as of October 3, 2014. IBM Power Enterprise System E870 on
the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 80 cores / 640 threads, POWER8; 4.19GHz, 2048 GB memory, 79,750 SD benchmark users running AIX® 7.1 and DB2® 10.5, Certification #: 2014034 Result valid as of October 3, 2014. Source: http://www.sap.com/benchmark. IBM System x3950 X6 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors/ 120 cores/ 240 threads, Intel Xeon Processor 8890 v2; 2.80 GHz, 1024 GB memory; 49,000 SD benchmark users, running Windows Server 2012 Standard Edition and DB2 10; Certification # 2014024. Source: http://www.sap.com/benchmark .
• SPECjbb2013 results are valid as of 10/2/2014. For more information go to http://www.specbench.org/jbb2013/results/ All IBM benchmark results will be submitted to spec.org on October 15, 2014.• SPECcpu2006 results are submitted as of 10/2/2014. For more information go to http://www.specbench.org/cpu2006/results/ All IBM benchmark results will be submitted to spec.org on October 6, 2014.
Intel Xeon E7-8890 v2IBM x3950 X6Win 2012 / DB28s/120c/240t
POWER8IBM E8708s/80c/640t
Intel Xeon E7-8890 v2HP Converged System
8s/120c/240t
POWER8IBM E870AIX / DB28s/80c/640t
POWER8IBM E8708s/80c/640t
Intel Xeon E7-8890 v2Fujitsu PRIMEQUEST2800E
8s/120c/240t
POWER8IBM E8708s/80c/640t
Intel Xeon E7-8890 v2Huawei RH8100 V38s/120c/240t
0
200
400
600
800
1000
1200
020004000
600080001000012000
140001600018000
01020
30405060
708090
0
10
20
30
40
50
60
70
@lucacomparini
The rise of
© 2014 International Business Machines Corporation 14
Performanceof leading POWER architecture Broadens the capability and performance of POWER
Open DevelopmentOpenPOWER enables greater innovation through open software and open hardware
Collaborationacross multiple thought leadersCollaborative development model drives collective thought leadership, across multiple disciplines
- Members can build custom servers (custom-tuned for specific applications)
- Members can provide feedback to the ecosystem, influencing future developments
Context: Growing trend among datacenter operators who design their own hardware, instead of buying
August 2013 (announced OpenPower)1. Create ecosystem2. Make POWER IP licensable to members3. Open POWER Firmware to members
- Innovation injected into the community- Innovation available for POWER customers
&
@lucacomparini
April 2014: Open Standard introduced on
Native PCI-Express 3.0 Support- replacing proprietary GX/Bridge
Transport Layer for CAPI protocol- Coherently Attach Devices connect to processor via PCIe
- Protocol encapsulated in PCIe
FPGA and GPU accelerators
Bi-Endian platform
Support for PowerKVM Hypervisor
© 2014 International Business Machines Corporation 15
OpenPOWER Foundation Chairman Gordon MacKeandisplayed an early system design architecture that Google,through its leadership in OpenPOWER, is investigating asan alternative for large scale data centers with massive datarequirements
At the same time
@lucacomparini
Coherently Attached Protocol Interface (CAPI)… so what?
© 2014 International Business Machines Corporation 16
For each I/O: 40X Fewer Instructions with CAPI500 vs. 20,000 instructions
With CAPI, an accelerator based on GPUs, DSPs, or FPGAs that resides on a PCI card can link into the Power8 processor and memory complex and look like what is in effect a “hollow core” that has the same access to the memory hierarchy as the actual Power8 cores. What this means is that these accelerators do not have to move data back and forth between the CPU and the accelerator;; both devices address the same memory space.http://www.enterprisetech.com/2014/10/02/ibm-accelerates-power8-clusters-gpus-fpgas-flash/
IBM Confidential
@lucacomparini
Coherently Attached Protocol Interface (CAPI)… so what?
© 2014 International Business Machines Corporation 17IBM Confidential
Identical hardware with 2 different paths to data
http://techstacks.io/tech/redis
24:1 consolidation
12x less energy6x less space
3x lower price
40TB Power vs 24TB Intel
infrastructure consolidation savings vs. Intel Xeon for in-memory data
@lucacomparini
FPGA and GPU… so what?
© 2014 International Business Machines Corporation 18
NVIDIA acceleration built into IBM Power S824L
8x faster than x86 Ivy Bridge on pattern extraction82x faster for Cognos BI and DB2 BLU
Altera FPGA acceleration and IBM CAPI
Monte Carlo 250x faster than POWER8 core alone, reduced C code 40x over non-CAPI FPGA
CAPI dev kit with FPGA card from Nallatech
US Dept of Energy $325M super computing contract awarded to IBM, Mellanox, and NVIDIA
DoE systems for science and stockpile stewardship
Sierra and Summit systems to be >100 PF, 2 GB/core main memory, local NVRAM, and science performance 4x-8x Titan or Sequoia
@lucacomparini
FPGA and GPU… so what?
© 2014 International Business Machines Corporation 19
Performance of java.util.Arrays#sort(int[]) on NVIDIA Tesla K40 GPU (ECC enabled) and IBM Power8 CPU.
Up to 48x performance improvement
@lucacomparini
PowerKVM… so what?
© 2014 International Business Machines Corporation 20
@lucacomparini
PowerKVM… so what?
© 2014 International Business Machines Corporation 21
OVH was founded in 1999#1 Internet Hosting in Europe (#3 WW)17 Data Centers (1st biggestWW)180.000 Physical Servers700.000 CustomersWW
@lucacomparini
© 2014 International Business Machines Corporation 22
Founded in 1998Founder of OpenStack9 datacenters300.000 CustomersWW#1 hosting for Internet Retailers#1 hosting OpenStack private cloud
Aaron Sullivan (Director Infrastructure Strategy) shows off Rackspace POWER8 OpenComputeForm Factor Planar
Cloud Ecosystem
Founded in 1999#1 Internet Hosting in Europe (#3 WW)17 Data Centers (1st biggestWW)180.000 Physical Servers700.000 CustomersWW
https://cloud.runabove.com/signup/?launch=power8
@lucacomparini
Cloud Ecosystem
© 2014 International Business Machines Corporation 23
Coming soon: POWER8 Bare Metal as a Service 3 Fixed Configurations + SDD, deployed < 30 mins
Suitable for:§ Big data & Analytics for optimal cost/performance§ Optimized e-commerce & content management§ Hybrid Cloud & Bluemix integration§ Cloud service provider & database services
TYAN TN71-BP012 Collaborator: Tyan, MellanoxWith planned availability second quarter 2015, the TYAN TN71-BP012 servers are designed for large scale cloud deployments and follow Tyan’s highly successful OpenPOWER customer reference system introduced in October 2014. IBM will be among the first to deploy the new servers as part of its SoftLayer infrastructure, utilizing them for a new bare metal service offering.
@lucacomparini
So what? The Linux on Power8 ecosystem at a glance
© 2014 International Business Machines Corporation 24
New. DB2 with BLU Acceleration
Update: SAP HANA Ramp-Up program
New. SoftLayer – POWER-based Bare Metal offerings
New. Rackspace joins the OpenPOWER Foundation
Superior Cloud Economics
New. Docker for Power Systems
Update: OpenStackHEAT and Chef Server for Power
New. Bluemix with Power for SOE/SOR integration
113 members
New. Red Hat in LE mode, RHEV
New. Veristormopen source Hadoop offering
Cloud Open Innovation Big Data & Analytics
Cognos BI already available (BE);; BI and TM1 coming (LE)
SPSS Modeler and Analytics coming (LE)
BPM Advanced 8.5.5Business Monitor 8.5.5
WebSphere Application Server 8.5.5.3
WebSphere Extreme Scale 8.6.0.6
CachingWebSphere MQ 8.0.0.1WebSphere MQ MFT Ed 7
Reliable Messaging
IBM MobileFirstPlatform Foundation 6.3Middleware
IBM Hadoop solutions: BigInsights and Veristorm
OpenSource focus
@lucacomparini
© 2014 International Business Machines Corporation 25
@lucacomparini
Open Source Ecosystem: Relational Databases
© 2014 International Business Machines Corporation 26
https://www-304.ibm.com/partnerworld/wps/servlet /download/DownloadServlet?id=LQPehnUMv8eiPCA$cnt&attachmentName=ibm_power_systems_solution_for_postgr esql.pdf
https://www.flamingspork.com/blog/2014/06/03/1-million-sql-queries-per-second-mysql-5-7-on-power8/
@lucacomparini
Open Source Ecosystem: Turbo LAMP
© 2014 International Business Machines Corporation 27
@lucacomparini
Magento benchmark on IBM TurboLAMP
© 2014 International Business Machines Corporation 28
Independent testing has shown that Magento Enterprise Edition demonstrates a substantial 2.5-3x performance improvement on the POWER8 architecture with its ability to process up to 8 multiple parallel threads per core versus similar priced Intel architectures on the IBM Turbo LAMP stack. Magento serves more than 240,000 retailers worldwide, and enables retailers and brands to create customized, innovative, commerce experiences to accelerate their growth.
Craig Hayman , President - eBay Enterprise Business
TCA = $19,885$3.98 /user/hour
TCA = $45,100$1.88 /user/hour
4x Dell servers (Sandy Bridge)Open Source LAMP, bare metal PHP Server, MySQL, CentOS
Magento Benchmark Test (JMeter driven)A test is considered “successful” if 90% of the user interactions (page load) complete in less than 2 seconds
For a given Users Per Hour Load, simulated User Roles:- 30% browse the catalog- 62% view products and add them to the shopping cart but abandon it- 4% checkout as guest- 4 % checkout as a named user
@lucacomparini
The IBM Linux Commercial from 2003.https://www.youtube.com/watch?v=x7ozaFbqg00
@lucacomparini