Exploring the Open Source Linux Ecosystem

IBM OS CONIBM IBM OS CON

Case studies

in success:

July 23, 2015IBM

Exploiting the open source Linux ecosystem

to drive rapid innovation and higher value

Troy Peterson

Technical Solutions Architect

IBM Systems Group

[email protected]@troypeteoss

mailto:[email protected]

IBM OS CON

Agenda

27/22/2015

Why Linux on POWER?

Why Little Endian POWER?

Open Source is a Foundation

A quick word on Virtualization on POWER 8

Beyond the Distribution – Open Source Software for POWER 8 LE

Building solutions on POWER 8

Embracing the broader open source communities

How to get started on POWER8

IBM OS CONIBM IBM OS CON 7/22/2015 3

Open and

Collaborative

Ecosystem

An open server ecosystem delivering continuous innovation

Consumable for hyperscaledatacenters

Growing Linux Ecosystem

An open technology

platform Built with Linux portability,

OpenStack and KVM

Designed with Open Source

Technologies

POWER8: An Open Innovation Platform


Processors

flexible, fast execution

of analytics algorithms

Memory

large, fast workspace to

maximize business

insight

Cache

ensure continuous data

load for fast responses

4Xthreads per core vs. x86

(up to 1536 threads per

system)

4Xmemory bandwidth vs. x86

(up to 16TB of memory)

5Xmore cache vs. x86

(up to 224MB cache per

socket)

Power Systems with POWER8, are built with open innovation to

accelerate big data insights and hybrid cloud deployment

Flash for extreme performance

Massive IO bandwidth

Continuous data load

Parallel

processing

Large-scale

memory processing

4


Up to TWICE the performance per core across key workloadscompared to the top 5 Intel vendors

0

100

200

300

400

500

600

700

800

900

1000

ERP – SAP 2-Tier (Users)

1.9x Performance

0

10

20

30

40

50

60

70

80

POWER S824

2s/24c/192t

IBM POWER8

Dell

PowerEdge

T620

2s/36c/72t

Intel Xeon

Haswell

SPECint_rate2006

1.8x Performance

0

10

20

30

40

50

60

SPECfp_rate2006

2.1x Performance

1) Results are based on best published results on Xeon E5-2697 v2 and E5-2699 v3 from the top 5 Intel system vendors (HP, Oracle, IBM, Dell, Fujitsu).

2) Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory;

16,500 SD benchmark users, running RHEL 7 and SAP ASE 16; Certification # 2014033. Source: http://www.sap.com/benchmark.

3) IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD

benchmark users, running AIX® 7.1 and DB2® 10.5, Certification # 2014016. Source: http://www.sap.com/benchmark All results valid as of October 3, 2014

4) SPECjbb2013 results are valid as of 11/19/2014 For more information go to http://www.specbench.org/jEnterprise2010/results/

5) SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/

AIX LoP (RHEL)

POWER S824

2s/24c/192t

IBM POWER8

AIX LoP (RHEL)

Nearly Equal

Performance

with both

AIX and LINUX

on POWER8

Nearly Equal

Performance

with both

AIX and LINUX

on POWER8

Dell

PowerEdge

T620

2s/36c/72t

Intel Xeon

Haswell

IBM S824

POWER8

AIX / DB2

4p/24c/192t

Dell PowerEdge R730

E5-2699 v3

RHEL / SAP ASE

2p/36c/72t

Intel Xeon Haswell

0

50000

100000

150000

200000

250000

300000

350000

400000

POWER S824

2s/24c/192t

IBM POWER8

Lenovo IBM Flex240 M5

2s/36c/72t

Intel Xeon Haswell

Java – SPECjbb2013 (Max-jOPS)

2.2x Performance

5

http://www.specbench.org/jEnterprise2010/results/

http://www.specbench.org/cpu2006/results/


Power S822L

versus

Haswell EP

Linux on Intel

Haswell EP

with VMware

VersusLinux on POWER8

with PowerVM

Dell PowerEdge

R730HP ProLiant

DL380 G9

IBM Power

S822L

97330 SAPS 97330 SAPS 99008 SAPS

Server list price*-3-year 24x7 warranty, on-site

$24,783 $26,606 $25,555 $33,136

Virtualization

- OTC + 3yr. 24x7 sub./supp.

$9,356

VMware vSphere

Enterprise 5.5

$9,356

VMware vSphere

Enterprise 5.5

$9,356

VMware vSphere

Enterprise 5.5

$10,450

PowerVM for IBM

PowerLinux

Linux OS list price

- RHEL, 2 sockets, unlimited guests,

24x7, 3 yr. premium sub./ supp.

$9,259

Red Hat subscription

and Red Hat support

$9,259


and Red Hat support

$9,259


and Red Hat support

$6,895


and IBM support

Total list price/server: $43,398 $45,221 $44,170 $51,109

Quantity 3 3 3 2

Total list price $130,194 $135,663 $132,510 $102,218

* Based on US pricing for Power S822L matching configuration s on following page. Source: lenovo.com , hp.com, dell.com, vmware.com. Configuration details in speaker notes

Lenovo

x3650 M5

97330 SAPS

$130,194 $135,663 $132,510 $102,218

Total Cost of Acquisition Linux on Power ($US) vs. Haswell EP

6

http://www.redhat.com/rhel/









IBM Power has superior Reliability Availability Serviceability

Power delivers higher RAS

• Redundant components

• Autonomic computing

• Advanced Error detection

and fault isolation

Resulting in:

• Fewer failures

• Quicker repairs

• Lower operational costs

7

IBM OS CONIBM IBM OS CON 8

Power 8 Support Little Endian

Same as Intel Byte Order

Makes application ports trivial

PPC64 Little Endian distro from most major providers

•Ubuntu

•RHEL

•SLES

Full support for KVM

PowerKVM guests can be either Big Endian or Little Endian

Data can be easily exchanged with other LE systems


Most x86/Linux applications written in C/C++ will require no source code change, only a recompile2

Moving Linux apps to Power has never been easier

Well-written Java applications

written in scripting or interpretive

languages will run as is1

95%Require no source code change

+

1. Interpretive languages include PHP, Python, Perl, Ruby, Java, etc. Assumes 8 hours of dedicated time and prior experience with the application code and its

dependencies (e.g. language, libraries, web application, database) and that dependencies already ported and installed. Assumes no platform or device specific

dependencies.

2. Includes C/C++ and other compiled languages. Assumes 16 hours of dedicated time and prior experience with the application code and its dependencies (e.g.

language, libraries, web application, database) and that dependencies already ported and installed. Assumes no platform or device specific dependencies.

9

Fostering open innovation with Linux and POWER Systems


Virtualization on Linux on POWER

•Legacy Virtualization ManagerPowerVM

•Linux + KVM, Shipped with POWER8PowerKVM

•Industry standard KVM – same as for any architecture or cihpsetKVM

•Containers

•Docker infrastructureDocker

•Cloud Stack, Virtualization management, Guest VMs and Docker containersOpenStack

•Open Source Platform as a Serivce (PaaS) SolutionCloud Foundry

•IBM Open Cloud Architecture based on Cloud Foundry, including easy access to a broad ecosystem of servicesBluemix

OpenPOWER promotes collaboration at all levels


Robust solutions from IBM, ISVs & the Open Source Community

Software Solutions

POWER ISVs

Linux Open Source

WebSphere Application Server

Powered by

Linux Distributors

We have over 1400

ISVs deployed on

Linux on Power ….

12


Big Data

& Analytics

Cloud

Managemnt

Stack

DatabasesDev. Env

/Tools

Other

HA,

Security

etc.

Technical

Computing

Available:Backbone, Bootstrap, Docker , Eigen libErlang, Ganglia, GCC, GDB, Jenkins, Jruby, keepalived, LLVM, Lucene, Maven, Nagios, NGINX, node.jsOpenJDK, PHP, phpMyAdmin, Perl, Python, Python-Django, Python-Pip ecosystem, R/R, rsyslog, Ruby, Ruby on Rails (rbenv), Ruby Gems, scala, snappy,Socket.io (npmjs)SystemTap, Vagrant, V8, wireshark,

Port In Progress:GoLang, gccgoPubsub.io (3Q)Logstash

Available:Accumulo (column), CassandraCouchDB (document)DerbyMariaDB (v10 optimized)

Memcached (KVS)MongoDB (document)MySQLPostgreSQLRabbitMQRedis (KVS)SQLiteVirtuoso (graph)

Port In Progress:Voldemort (KVS)Neo4J (graph)

Available:

Hadoop Core,

Hive, HBase,

Accumolo,

Ambari, Avro,

Falcon, Flume,

Hue, Knox,

Lucene-Solr,

Mahout, Oozie,

Parquet, Phoenix

Pig, Sqoop, Storm

Tez, Zookeeper

Port In Progress:

Spark

Available:Apache Web ServerApache tomcatCeph, Chef serverJuju & Juju guiLandscape clientMAAS, OpenStackPuppetApache QpidThrift

Port In Progress:Ceilometer client

Available:BTRFSBootstrapChroma-keyCluster GlueDRBDEvolution data svrHAProxyHeartbeatkeepalivedLdirectordOpenSSLPacemakersambaTophatWordPress

Port In Progress:

Available:

ALLPATH-LG, Bedtools,

bfast, BioConductor,

BioConductor-base,

BLAST, BOOST, Bowtie,

Bowtie2, BWA, bzip2,

Cufflinks - 2.2.1, FASTA,

FastQC, HMMER, HTSeq,

LibGD(partial), libpng,

Mothur, nose, NumPy,

OpenSSL, PICARD, PLINK,

Python, SAMTools,

SAMTools 1.0, SeqAn,

setuptools(Python),

SHRiMP,

SOAP3-DP, SOAPDenovo

tabix, TopHat, Trinity,

Velvet/Oases, Zlib

ABySS, Balsa,

Bioconductor, GMP,

GROMACS, NAMD, spice,

Quantum Espresso

Port in Progress:

IGV, iRODS, RNAStar,

ISAAC, SOAPAligner

Available: Open source application is ported and

available on distro (Ubuntu or RHEL or SLES)

(black), in community (purple), Lab7 (green) or

Veristorm (orange). Does not mean it is optimized.

Does not mean that a commercial ISV version is

available.

Evaluating: Needs to be vetted in new business

development prioritization process. Some of these

are available codes that need optimization to be

competitive with x86.

13

Expanding the Open Source Ecosystem (1)


Big Data

& Analytics

Cloud

Managemnt

Stack

DatabasesDev. Env

/Tools

Other

HA,

Security

etc.

Technical

Computing

Optimizing:

Evaluating:OpenJDK - optimizePHP - optimizePython - optimizeRuby - optimize

Optimizing:MongoDB (1Q)PostgresSQL (1.86x)Redis (1Q - Surelock)

Evaluating:Couchbase (noSQL)InfiniSQLMarkLogic(document,

ISV)

Riak (KVS)OrientDB

Optimizing:Hadoop (1Q15)

Evaluating:ClusterpointElasticSearch

Optimizing:

Evaluating:BigFix (ISV)MesosTosca Heat

Optimizing:

Evaluating:CentOS (RHEL depend)Cluster-NetworkCoreOS (distro)MondoRescueOpen Identity Stack (forgerock.com)

Optimizing:

NAMD, GROMACS, ABYSS

Evaluating:

CP2K, HOOMD, Milc,

miRdeep2, Galaxy, GATK,

Terachem (ISV), ucsctools,

ViennaRNA,

AMBER14 (plan 2015)

14

Expanding the Open Source Ecosystem (2)

Available: Open source application is ported and

available on distro (Ubuntu or RHEL or SLES)

(black), in community (purple), Lab7 (green) or

Veristorm (orange). Does not mean it is optimized.

Does not mean that a commercial ISV version is

available.

Evaluating: Needs to be vetted in new business

development prioritization process. Some of these

are available codes that need optimization to be

competitive with x86.


Up to 2.2x better per core performance

Up to 1.9x better per system performance

S822L – 10 core POWER8, 3.42 GHz vs.

x3650 M4 – 12 core Ivy Bridge, 2.7 GHz

* Source: http://blog.jelastic.com/2014/08/28/software-stacks-market-share-july-2014/

MariaDB Business Description• Provider and main contributor for MariaDB RDBMS which

is considered an enhanced, drop-in replacement for MySQL• Founded by the team that created MySQL. MariaDB is the

2nd most popular open source DB after MySQL (13%)*

Final results and more information on solution configuration:IBM Power Systems Solution for MariaDB whitepaper link

IBM Power S822L vs. IBM x3650 M4 – per core(Both running Ubuntu as KVM guest – Sysbench benchmark)

Read-

only

Read-

WriteTra

nsacti

on

/

seco

nd

/ c

ore

Read-

only

Read-

Write

Tra

nsacti

on

/

seco

nd

/ s

yste

m

IBM Power S822L vs. IBM x3650 M4 - per system(Both running Ubuntu as KVM guest – Sysbench benchmark)

2.2x

2.1xCore – Core

1.7x

1.9x System – System

Read-

only

Read-

Write

Read-

only

Read-

Write

IBM worked with MariaDB to optimize on Linux on Power

15

http://blog.jelastic.com/2014/08/28/software-stacks-market-share-july-2014/

http://www.ibm.com/partnerworld/page/stg_ast_sys_wp_ibm-power-systems-solution-for-mariadb


Turbo LAMP: LAMP Stack for today’s demanding workloads

PowerKVM

High Speed Data Transfer (Mellanox)

Linux (RHEL or Ubuntu)

Apache Web Server (Zend) MariaDB

PHP (Zend)

Turb

o L

AM

P

Turbo LAMP White Paper: https://www.ibm.com/developerworks/community/groups/community/turbolamp

Orc

he

str

atio

n -

Ju

ju

(Ub

un

tu)

16

https://www.ibm.com/developerworks/community/groups/community/turbolamp


No-Cost Access to Linux on Power for IBM Partners and

Open Source Developers

• Power Development Cloud

• IBM Innovation Center

• OSU Open Source Lab

Fee Based and Sponsored Access

• Site Ox

• OVH

• IBM Center Express

• IBM Client Centers

• IBM Lease and Discount Program

Accessing Linux on POWER8 Hardware

https://ibm.biz/LoP_Access

https://ibm.biz/LoP_Access


15+ Years of

Collaboration on

Open Source+

20071999 2007 2011 2011 2012 20132001 20132000

400+ software products

500patents donated

600+developers

18

IBM: Industry-leading collaboration on open technology

July 20th 2015

IBM is a founding

member of

Cloud Native

Computing

Foundation

New

Visit IBM at booth #501

to talk to an IBM

Recruiter @ OSCON


Thank You!

Troy Peterson

Technical Solutions Architect

IBM Systems Group

[email protected]

@troypeteoss

IBM OS CON

Backup


Linux support for IBM Power Systems

RHEL 7.1 (BE and LE) POWER8 (native mode)

and POWER 7/7+ LE is 64-bit only – P8 only Available March 2015

RHEL 6 • POWER8 supported with U5

(P7-compatibility mode)• Full support of POWER6

and POWER7 (native mode)

Fedora• Fedora 16 was first release

to re-launch POWER• Fedora 20 has POWER8

support

Supported add-ons• JBoss• High Performance Network

Add-on

SLES 12 (LE) POWER8 (native mode, LE) LE is 64-bit only – P8 only Available October 2014

SLES 11 (BE) Selected POWER8 with SP4 SP3 = P7-compatibility POWER7+ encryption, RNG

accelerators with SP3 Full support of POWER7

(native mode)

openSUSE• openSUSE 12.2 re-

launched for IBM POWER• openSUSE 13.2 includes

POWER8 support

Supported add-ons• SUSE Linux Enterprise High

Availability Extension

Ubuntu 14.04 LTS (LE) POWER8 (native mode, LE) LE is 64-bit only – P8 only Available Apr 2014.

Updated regularly

Ubuntu 14.10 and 15.04 (LE) S824L GPU enablement Rapid introduction of new

technologies Available Oct 2014 / Apr

2015

Supported add-ons• JuJu Charms• MaaS (Metal as a Service)• Landscape

Debian• Debian community now

supports Power

Built from the same source as x86 in mainline communities. Delivered on the same schedule as x86 by the Linux vendors themselves.

Supported at the same time as x86 from the vendors and IBM. Over time, LE distros are expected to be supported PowerVM LPARs, PowerKVM guests, bare-metal

22


Linux on Power Distribution Roadmap Today

20092006 2007 2008 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019

Standard Release Support Extended Release Support Self-support Release/update

See for more details:Red Hat lifecycle information - https://access.redhat.com/support/policy/updates/errata/SUSE lifecycle information – http://support.novell.com/inc/lifecycle/linux.htm/ l Ubuntu lifecycle information - https://wiki.ubuntu.com/Releases

SLES 10 (7/06)

RHEL 5 (3/07)

RHEL 7 (06/14)

SLES 12 LE (10/14)

15.04 LE (04/15)

14.04 LE LTS (04/14)

15.10 LE (10/15)

14.10 LE (10/14)

16.04 LE LTS (04/16)

RHEL 6 (11/10)

SLES 11 (3/09)

Information concerning SUSE Linux Enterprise Server was obtained from SUSE.

Information concerning Red Hat Enterprise Linux was obtained from Red Hat.

https://access.redhat.com/support/policy/updates/errata/

http://support.novell.com/inc/lifecycle/linux.htm/

https://wiki.ubuntu.com/Releases

Technology

Exploring the Open Source Linux Ecosystem