DMM107 Capturing and Replaying Workload in SAP HANA · 2016. 9. 14. · SAP HANA SPS12 Basic functionality Capturing, preprocessing, and replaying of workload Filtering of captured

Public

DMM107 – Capturing and Replaying Workload in

SAP HANA

© 2016 SAP SE or an SAP affiliate company. All rights reserved. 2 Public

Speakers

Bangalore, October 5 - 7

Lucas Kiesow

Las Vegas, Sept 19 - 23

Lucas Kiesow, SAP HANA

Product Management

Barcelona, Nov 8 - 10

Lucas Kiesow


Disclaimer

The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of

SAP. Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or

any other service or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this

presentation or any related document, or to develop or release any functionality mentioned therein.

This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

directions and functionality are all subject to change and may be changed by SAP at any time for any reason without notice.

The information in this presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality.

This presentation is provided without a warranty of any kind, either express or implied, including but not limited to, the implied

warranties of merchantability, fitness for a particular purpose, or non-infringement. This presentation is for informational

purposes and may not be incorporated into a contract. SAP assumes no responsibility for errors or omissions in this

presentation, except if such damages were caused by SAP’s intentional or gross negligence.

All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially

from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only

as of their dates, and they should not be relied upon in making purchasing decisions.


Agenda

What is capture and replay?

General introduction to the functionality

When should capture and replay be used?

Common use cases and sample scenarios

How does capture and replay work?

Process architecture and technical details

What features does capture and replay offer?

Details on current capabilities

What is the current roadmap for capture and replay?

Roadmap for SPS12 and beyond

Public

What is capture and replay?


What is capture and replay? Current features & product benefits

Features

• Capture real system workload in production environments

• Pre-process & replay captured workload on target systems

• Analyze runtimes and compare performance

Benefits

• Provides competitive replay and analysis for SAP HANA database

• Helps ensure that landscape changes do not degrade system

performance

• Enables real simulation of workload without the use of other 3rd

party tools

• Reduces manual effort for testing changes in customer

deployments

2

3

4

1

Public

When should capture and

replay be used?


When should capture and replay be used? Common use cases

Hardware

Changes

Table

Distribution

Changes

.ini File

Changes

Index

Changes

Partitioning

Changes

Performance

Checks

Stability

Checks

Software

Updates

Design Changes Upgrades/Updates Standard Checks


When should capture and replay be used? Common scenarios

Design Changes

• Can be more or less complex

depending on customer

landscape

• Can have side effects in

specific scenarios that might

require further analysis

• Might require longer periods

of time when re-distributing

tables or re-partitioning of

large tables

Upgrades/Updates

• Include downtime of systems

for upgrade, installation or

restart

• Load generated on production

system can be quite large

• Testing of different

configurations might require

high manual effort

Standard Checks

• Mandatory process for many

customers

• Can have substantial effects

on migration/upgrade strategy

• Beneficial for different areas

such as operations,

administration and

development


When should capture and replay be used? End-to-end sample scenario

Upgrade

Hardware Change

Other Changes

Find Regressions

Compare Runtime

Hotspot Analysis

Varying Results

Tuning/Rewriting

Repeat “Replay

Workload”

Analyze SQL Analyze Workload / SQL Analyze Workload

Apply

Changes

Capture &

Analyze

Workload

Compare

Workload

Replay

Workload

Identify

Issues

Resolve

Issues

Source System Target System

Public

How does capture and replay

work?


SAP HANA

Revision XXX

App Servers

Production System

Clients

Initialization

of test system

Connection via

SQLDBC

How does capture and replay work? Process architecture

Test System

Replay Service Replay Files

Replay and analyze

workload in similar

execution order, with

similar concurrency

and load distribution

3 REPLAY

4 ANALYZE

SAP HANA

Revision YYY

2

3

4

1

DB Backup

Capture Files

Capture

incoming

SQL

statements

1 CAPTURE

Capture Files

DB Backup

App Servers

Simulation Tools

Reformat &

reorder SQL

statements

2 PRE-PROCESS

Manual copy

of data

Manual

backup after

starting

capture


SAP HANA

Revision XXX

App Servers

Production System

Clients

Initialization

of test system

Connection via

SQLDBC

How does capture and replay work? Process architecture

Test System

Replay Service Replay Files

Replay and analyze

workload in similar

execution order, with

similar concurrency

and load distribution

3 REPLAY

4 ANALYZE

SAP HANA

Revision YYY

2

3

4

1

DB Backup

Capture Files

Capture

incoming

SQL

statements

1 CAPTURE

Capture Files

DB Backup

Reformat &

reorder SQL

statements

2 PRE-PROCESS

Manual copy

of data

Manual

backup after

starting

capture


How does capture and replay work? Captured APIs

IndexServer

XS Classic (XSEngine)

XS Advanced

JDBC / ODBC / JS DBAPI

Applications … (e.g. HANA Cockpit 2.0)

SAP NetWeaver

DBSL

S/4HANA, ERP, BW, Fiori, …

Lumira

Analysis Office 1.x

Design Studio

JDBC / ODBC

Session Layer

SQL Interface

Fiori (XSC-based)

Analysis Office 2.x

HTTP / InA

XSDBC

SAP HANA Platform


How does capture and replay work? Pre-processing details

• Optimized to reduce

overhead when capturing

• Multi-level compression

added to reduce file size on

disk

• One file collected for each

service process running on

SAP HANA database

• Options to include special

information (plans, etc.)

• Reformats data representation

to optimize for replay by

Replay Service

• Reorders workloads based on

sessions

• Gather information on size,

context and timing for Replay

Service

• Session-based

structure

• Statements ordered by

execution timestamp

• No compression

• Include information on

query runtimes, etc.

Capture Files Replay Files Pre-processing


…

ReplayLoader

Threads

How does capture and replay work? Replayer Service architecture overview

HA

NA

SQ

L In

terfa

ce (S

QLD

BC

)

SAP HANA

(Target System)

Logon Secure

Store

RequestDispatcher

Replay Files

RLWorker

threads

incrementally

load Replay

File

1 LOAD

RequestE

xecuto

rs =

Repla

yerS

essio

ns

replay time (ms)

RLWorker

threads fill

RequestInfo

queue

2 FILL QUEUE

Currently

sleeping

Just woke by

RequestDispatcher

logical time (ms)

Executing

Replayed

Running

Loaded

Empty

RequestDispatcher

controls

execution/wait based

on logical time

3 CONTROL Execution

RequestInfo queue #1 / Session #1




…

ReplayLoader

Threads

How does capture and replay work? Replayer Service architecture overview

HA

NA

SQ

L In

terfa

ce (S

QLD

BC

)

SAP HANA

(Target System)

Logon Secure

Store

RequestDispatcher

Replay Files

RLWorker

threads

incrementally

load Replay

File

1 LOAD

RequestE

xecuto

rs =

Repla

yerS

essio

ns

replay time (ms)

RLWorker

threads fill

RequestInfo

queue

2 FILL QUEUE

Currently

sleeping

Just woke by

RequestDispatcher

logical time (ms)

Executing

Replayed

Running

Loaded

Empty

RequestDispatcher

controls

execution/wait based

on logical time

3 CONTROL Execution




Public

What features does capture

and replay offer?


What features does capture and replay offer? Full integration with HANA Cockpit

• Capture and replay is fully integrated with SAP HANA Cockpit

• The tile set includes one tile for capturing workload and one tile for pre-processing and replaying workload

on a target system

• Tiles provide overall status information


What features does capture and replay offer? Capturing workload

• New captures can be configured via SAP Fiori-based UI

• Filters include Database User, Statement Types,

Application Name, Application User Name or Schema

Name and more

• Detailed information is provided for each capture

• Capturing process can be monitored via UI


What features does capture and replay offer? Pre-processing workload

• Pre-processing can be triggered via the SAP

Fiori-based UI

• All capture files from one system can be

selected for pre-processing

• Detailed information is provided for each

pre-processed capture

• Replay can be triggered from details


What features does capture and replay offer? Replaying workload

• Replay can be triggered from pre-processing

details or replay list

• Replay Service information and target

instance information need to be provided

• Detailed report for runtime analysis is

available after replay

• Replay can be monitored from UI

Public

What is the current roadmap

for capture and replay?


This is the current state of planning and may be changed by SAP at any time.

Today Future Direction Planned Innovations

What is the current roadmap for capture and replay? Current and future innovations

SAP HANA SPS12

Basic functionality

Capturing, preprocessing, and replaying

of workload

Filtering of captured data

Replay rate control

Per-query execution time comparison

HANA Cockpit integration

SAP Fiori-based UI

Separate Delivery Unit deployment

Advanced features

Fully Transaction-consistent replay

Result-based comparison, number of

rows and return code

Rolling window capture capabilities

Flexible comparison of replays

Additional features for exporting reports

Integration with SAP HANA

performance management tools

Integration with Workload Analyzer

Integration with SQL Analyzer

Advanced features

Overhead minimization in capture,

preprocess, and replay

Additional reporting information (i.e.

lock/wait times)

Sophisticated workload manipulation

Improved monitoring capabilities for

capture and replay

Stress testing

Workload generation (i.e. additional users)

3rd party tool integration (i.e. script

language support)

Integration with SAP HANA performance

management tools

• Workload tuning suggestions

• SQL plan tuning suggestions

Public

Introduction to SAP HANA

Hybrid Cloud Service for

capture and replay


SAP HANA

Revision XXX*

App Servers

Production System

SAP HANA Hybrid Cloud Service for capture and replay Process Architecture

DB Backup

Capture Files

Create new

workload

capture

Create

full database

backup

Secure data

shipping to

SAP

datacenter

managed by

SAP

Setup

1 Replay

2 Report

3

SAP HANA Enterprise

Cloud

SAP HANA Cloud Platform

Setup, replay,

reporting,

support

managed by

SAP

Clients

1

2

3

Administration Application

Monitor Report

* minimum release level SAP HANA SPS12 required


SAP HANA Hybrid Cloud Service for capture and replay Benefits

Reduced risk for

customers

Reduced risk when applying system changes

Faster productive system upgrade

Simplified maintenance planning for IT landscape

Reduced effort for

customers

Lower amount of manual testing required

Testing and maintenance managed by SAP IT

Support process handled by SAP

Reduced cost for

customer

No additional hardware required for second system

Reduced costs for maintenance

Reduced costs for testing

Beta Program

SAP HANA Hybrid Cloud

Service

SAP is planning to offer a

closed Beta program for the

SAP HANA Hybrid Cloud

Service, starting in Q4 2016.

Customers who are interested

can reach out to SAP Capture

and Replay Cloud Service to

evaluate potential

participation*.

*participation is not guaranteed

and will be evaluated by SAP on

a per-customer basis

mailto:[email protected]?subject=Beta Participation - SAP HANA Hybrid Cloud Service for capture and replaymailto:[email protected]?subject=Beta Participation - SAP HANA Hybrid Cloud Service for capture and replay


SAP TechEd Online

Continue your SAP TechEd

education after the event!

Access replays of

Keynotes

Demo Jam

SAP TechEd live interviews

Select lecture sessions

Hands-on sessions

…

http://sapteched.com/online


Further information

Related SAP TechEd sessions:

ITM105 – Tools for HANA Operations (Lecture)

ITM160 – SAP HANA Database Operations: Beginner (Hands-on)

ITM361 – SAP HANA Database Operations: Advanced (Hands-on)

SAP Public Web

Introduction to SAP HANA capture and replay @scn.sap.com

SAP HANA Hybrid Cloud Service for capture and replay @hana.sap.com

Capture and replay @hana.sap.com

scn.sap.com

www.sap.com

SAP Education and Certification Opportunities

HA100 – SAP HANA Introduction

HA200 – SAP HANA Operations & Administration

www.sap.com/education

Watch SAP TechEd Online

www.sapteched.com/online

http://scn.sap.com/docs/DOC-73600http://scn.sap.com/docs/DOC-73600http://scn.sap.com/docs/DOC-73600https://blogs.saphana.com/2016/05/25/join-the-hybrid-data-management-services-beta-program/https://hana.sap.com/capabilities/admin-ops.htmlhttp://scn.sap.com/welcomehttp://www.sap.com/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha100-sap-hana-introduction-classroom-011-de-en/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/https://training.sap.com/shop/course/ha200-sap-hana---operations--administration-classroom-011-de-de/http://www.sap.com/educationhttp://www.sapteched.com/online


Please complete your

session evaluation for

DMM107

Contact information:

Lucas Kiesow SAP HANA Product Management [email protected]

Feedback

mailto:[email protected]


© 2016 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.

SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate

company) in Germany and other countries. Please see http://www.sap.com/corporate-en/about/legal/copyright/index.html for additional trademark information and notices.

Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.

National product specifications may vary.

These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its

affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and

services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as

constituting an additional warranty.

In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop

or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future

developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time

for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-

looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place

undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
http://www.sap.com/corporate-en/about/legal/copyright/index.htmlhttp://www.sap.com/corporate-en/about/legal/copyright/index.htmlhttp://www.sap.com/corporate-en/about/legal/copyright/index.html

Documents

DMM107 Capturing and Replaying Workload in SAP HANA · 2016. 9. 14. · SAP HANA SPS12 Basic functionality Capturing, preprocessing, and replaying of workload Filtering of captured