17
Cumulonimbo Y3 Review Meeting, Brussels 1 FP7-257993 Platform Benchmark Kathryn Bean, SAP CumuloNimbo Year 3 Review Brussels, November 27, 2013

2nd year Review Meeting Heraklion, 23/03/2010 - LSD

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Cumulonimbo Y3 Review Meeting, Brussels 1

FP7-257993

Platform Benchmark

Kathryn Bean, SAP

CumuloNimbo Year 3 Review Brussels, November 27, 2013

Cumulonimbo Y3 Review Meeting, Brussels 2

FP7-257993

• Introduction

• Y3 Focus

• CumuloNimbo PaaS Evaluation

Outline

Cumulonimbo Y3 Review Meeting, Brussels 3

FP7-257993

• Platform benchmark for evaluation of CumuloNimbo PaaS

– Order Processing Enterprise Application

– Load Generation Driver

• Assess performance and scalability behaviour

• Based on TPC-W benchmark

• Real world diverse load generation capability

– Linearly increasing/decreasing workload

Introduction

Cumulonimbo Y3 Review Meeting, Brussels 4

FP7-257993

Cumulonimbo Stack

Cumulonimbo Y3 Review Meeting, Brussels 5

FP7-257993

Platform Benchmark Architecture

Cumulonimbo Y3 Review Meeting, Brussels 6

FP7-257993

• J2EE Enterprise application - major modifications to adapt to distributed CumuloNimbo PaaS environment and to implement MVC

• Remote Browser Emulator (RBE) - rewritten to perform elastic CumuloNimbo evaluation and improve RBE performance

• Data Population Utility

• Visualisation Application - rewritten to integrate this application with RBE

• Image Generator

Components of Benchmark Platform

Cumulonimbo Y3 Review Meeting, Brussels 7

FP7-257993

Y3 Focus

Cumulonimbo Y3 Review Meeting, Brussels 8

FP7-257993

• Improve message logging capability

– Integration with Log4J

• Improve benchmark configuration capabilities

– Configuration parameters are stored into a single property file

• Integration with CumuloNimbo platform

New Features Related to All Benchmark Components

Cumulonimbo Y3 Review Meeting, Brussels 9

FP7-257993

• J2EE Enterprise Application

– Implement Model (EJB) View (JSP) Controller (servlets)

– Adapt to the distributed CumuloNimbo PaaS environment

• Remote Browser Emulator (RBE)

– Use HTMLUnit API to simulate users’ clicks

– Save evaluation statistics into a single database schema

• In its current implementation, using MySQL RDBMS

– Within one user’s session, Shopping, Browsing, Ordering mixes are selected based on probability vector P = <Pshop, Pbrow, Porder>

– Modify thread scheduling algorithm to perform elastic experiments

• Load variation based on trapezoid shape function

New Features Related to Enterprise Application and RBE

Cumulonimbo Y3 Review Meeting, Brussels 10

FP7-257993

• Query MySQL database to obtain CumuloNimbo evaluation statistics based on benchmark user’s request

• Response time histograms

– Web interactions mixes e.g. shopping, browsing and ordering

– Web Interactions e.g. BuyConfirm, OrderInqury etc

• Throughput saved over the course of the benchmark application run

New Features Related to Visualisation Application

Cumulonimbo Y3 Review Meeting, Brussels 11

FP7-257993

Cumulonimbo Evaluation

Cumulonimbo Y3 Review Meeting, Brussels 12

FP7-257993

• Hardware Configuration

– Node A: Remote Browser Emulator (RBE)

– Node B: Platform Management Framework (PMF)

– Node C: Transaction Manager (TM)

– Node D: Zookeeper, HDFS, Hbase master

– Node Ek : Hbase region servers (k=1,…,4)

– Node F j : Jboss and Derby servers (j=1,…,4)

• RBE Configuration:

– Measurement interval

– Load distribution – trapezoid shaped

• Ramp-up: Linearly increase 1 - 60 Ebs over 45 min, each EB starts 45 sec. after previous one

• Run all 60 Ebs for a further 15 min.

• Rump-down: symmetrical to Ramp-up (approximately)

– Probability vector of web mixes: <pbr, psh, por>=<0,1,0>

• Key Performance Indicator

– Histogram of response time

– Throughput over time and

– CPU utilization on Nodes F j (j=1,…,4), Ek (k=1,…,4)

CumulonNimbo Elasticity Evaluation

Cumulonimbo Y3 Review Meeting, Brussels 13

FP7-257993

Increase in the Number of JBoss/Derby VMs

Cumulonimbo Y3 Review Meeting, Brussels 14

FP7-257993

CPU Utilization of the VMs with the HBase

Region Servers

Cumulonimbo Y3 Review Meeting, Brussels 15

FP7-257993

Throughput: Web Interactions Per Second

Cumulonimbo Y3 Review Meeting, Brussels 16

FP7-257993

Response Times

Cumulonimbo Y3 Review Meeting, Brussels 17

FP7-257993

Questions?

Thank You.