18
Software Development at SAP Labs Korea Oct 2 nd , 2013

Software Development at SAP Labs Korea - SNUmmlab.snu.ac.kr/courses/2014_fall_seminar/SNU CE... · © 2014 SAP SE or an SAP affiliate company. All rights reserved. 2 WHO IS SAP SAP

Embed Size (px)

Citation preview

Software Development at SAP Labs KoreaOct 2nd, 2013

2© 2014 SAP SE or an SAP affiliate company. All rights reserved.

WHO IS SAP

SAP is the first global software companyfounded in 1972

Market leader in enterprise SW (ERP,Planning, in-Memory Computing, …)67,000+ Employees Globally

3© 2014 SAP SE or an SAP affiliate company. All rights reserved.

Who is SAP? Mobile First, Cloud, Open Planform

Live KPIs and Summaries, Connected to PreciseDetails, In a Collaborative User Experience

SAP HANA Platform

Applications Analytics

Simplified User Experience

Suppress the Noise. Focus on the Key Factors.

4© 2014 SAP SE or an SAP affiliate company. All rights reserved.

SAP Business Applications and Analytics

Sales OrderManagement

Production Planning Talent Management

Financial/MgmtAccounting

BusinessIntelligence

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 5Internal

:20 x 36 720 (72 billion)

100B 7.2 TB (= 72 billion x 100B)

?

– (filtering)– (grouping)– (aggregation)7.2TB HDD , 2(7,200GB / 1GB/s = 7,200s)7.2TB DRAM , 4(7,200GB / 15GB/s / 2 channels = 240s)

http://www.scottlogic.com/blog/2014/03/20/app-store-analysis.html

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 6Internal

Hardware Advances: Moore’s Law – Supercomputer

Moore’s Law: HW Power 10 100

(SGI)12TB Memory + 1024 processors 24TB Memory + 960 processing cores

2003 2013

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 7Internal

Hardware Advances: Moore’s Law – DRAM

Year Price/GB2013 $5.502010 $12.372005 $1892000 $1,1071995 $30,8751990 $103,8801985 $859,3751980 $6,328,125

Source: http://www.statisticbrain.com/average-historic-price-of-ram/

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 8Internal

Hardware Advances: Servers for In-Memory Computing

HANA Server Box (2013)Blade Box (2007)

4 x 10-core CPU, 2TB DRAM(32GB DIMM x 8 x 2 channels/cpu x 4 cpu)

2 x 4-core CPU, 32GB DRAM(4GB DIMM x 4 x 2 memory channels/system)

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 9Internal

Software Advances: Build for In-Memory ComputingReduce Memory Access Stalls

In-Memory Computing: It is all data-structures (not just tables)Parallelism: Take advantage of tens, hundreds of coresData Locality: On-chip cache awareness

Using Intel Ivy Bridge for approximate values.Actual numbers depend on specific hardware.

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 10Internal

Order Store … Sales456 France … 1.99457 Italy … 4.99458 Italy … 9.99459 Spain … 0.99

In-Memory Computing – Columnar Data Structures

456 France … 1.99

457 Italy … 4.99

458 Italy … 9.99

459 Spain … 0.99

456457458459

FranceItalyItaly

Spain

...

...……

1.994.999.990.99

Typical Database

SAP HANA: column order

SELECT Country, SUM(sales) FROM SalesOrdersWHERE Product = ‘corn’GROUP BY Country

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 11Internal

SAP HANA: Dictionary Compression

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 12Internal

Col C2500

2178675

3432423

12356743

3425644523523

3665364

134341433129089

89089562356

processed by Core 3

Core 4processed by

Col B4545

766347264

4353434

3424553333333

87894523523

78787

1252

Col A1000032

678678682345

89886757234123

234234378787

999999313427777

454544711

21

Core 1 Core 2

proc

esse

dby

proc

esse

dby

676731223423123123123 789976

12122009

200022346098

SAP HANA: Multi-Core Parallelization

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 13Internal

HANA Development Process

Make & Test Farm

Engine Developer

Central Code

HANA

~2,000 builds a day

~85,000 test suite executions a day (> 350,000regression test cases are grouped into ~900 test suites)

~1,000 servers with 40 cores and 1TB memory

Check out

Merge a change

Submit a change

Workstation

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 14Internal

Development Tools

Git, Gerrit, Jenkins, BugZilla, Jira, …Static Code Analysis: Coverity, ConQAT, …Performance ProfilingCode Coverage

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 15Internal

Performance Profiling

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 16Internal

Code Converage

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 17Internal

One Global HANA Platform Team

© 2014 SAP SE or an SAP affiliate company. All rights reserved. 18Internal

Working Globally

HANA Workshop in Seoul, 2012