Monitoring and Administration with SAP on DB2 Database

Monitoring and Administration with

SAP on DB2 – Database Performance

Warehouse (DPW)

Steffen Siegmund, SAP AG

October 2009

© SAP AG 2009. All rights reserved. / Page 2

CURRENT ARCHITECTURE

TWO DIFFERENT WORLDS


Architecture Before EHP1 – Database and

Applications Monitored Separately

DBA Cockpit

Flat tables in central DBA Cockpit

instance

Simple reports in SAP GUI

Only some charts for visualization

Not flexible at all

No reuse of collected data for

customerspecific reports

DBA Cockpit – Back-End

Collection of

Performance Data

DBA Cockpit

Simple ABAP Reports

in SAP GUI (ALV)

DB DB DB DB


Architecture Before EHP1 – Database and


Solution Manager Diagnostics

SAP NW BW as consolidated pool for

data for all extracted performance data

E2E Workload Analysis:

BI Web reports in a specialized

analysis application

Special reports for each

application (ABAP, BW, EP, ...)

No monitoring of database

hard to determine if it is a database-

or an application-related issue

SAP NW

BW

SMD Back-End

Extraction of SAP

Performance Data

SMD Navigation

SMD Anaylsis on

SAP NW BW


SAP NW BW

SMD InfoCubes,

DPW InfoCubes

Architecture Before EHP1– Database and


DB DB DBDB DB DBDB DB


Collection of

Performance Data

SMD Back-End

Extraction of SAP

Performance Data

Solu

tion

Landscape

DBA Cockpit

Simple ABAP Reports

in SAP GUI (ALV)

SMD Navigation

SMD Analysis on

SAP NW BW


DATABASE PERFORMANCE

WAREHOUSE

NEW INTEGRATED

ARCHITECTURE


Database Performance Warehouse –

New Integrated Architecture

SAP NW BW

SMD InfoCubes,

DPW InfoCubes

DB DB DBDB DB DBDB DB


Extensive Collection

of Performance Data

SMD Backend

Extraction of SAP

Performance Data

Solu

tion

Landscape

DBA Cockpit

Extensible Analysis-

Application for DBAs

SMD Navigation

SMD Analysis on BW



Supported Database Platforms

DB Platform Reports in

EHP1

Reports in

EHP2

(planned)

Minimum Required

Database Release

IBM DB2 for LUW 39 39DB2 V9.1 FP7 (Linux/UNIX),

DB2 V9.5

IBM DB2 for z/OS 5 14 DB2 V8.1

MS SQL Server 9 11 MS SQL Server 2000

Oracle 0 8Oracle 10.2,

Diagnostic Package License

SAP MaxDB 1 9 Max DB 7.5


Data Warehouse


New Integrated Architecture

SMD and DBA Cockpit

use same consolidated

data warehouse

New reports with

application and database

specific KPIs

Analysis

RCA: E2E Workload

Analysis

DBA Cockpit:

Performance Analysis

Customer-Specific BI

Queries / Web Reports

Setup

SMD setup wizard to add

solution for monitoring

If required, database

connection will be set up

Activate database

monitoring

DB

DPW SMD



New Integrated Setup (SOLMAN_SETUP)

Select System

Solution Manager already

provides the database

name, server name and

database type

User input: Database

schema (optional)

DPW Setup

Backend for DPW is

injected

Extractors are scheduled

in Solution Manager

Extractor Framework

Connection Setup

Only if no connection is

available in DBA Cockpit

Most fields for connection

data are already prefilled

Password has to be

provided


Solution Manager

Database

DB2 LUW: Database Performance Warehouse –

Architecture of Data Collectors

DB

Configuration is stored in monitored

database: SAP NW BW server,

monitoring DBA Cockpit

New tablespace for performance

data: SAPTOOLS

Stored procedures for collection

DB2 scheduler to execute stored

procedures hourly

DBA Cockpit



SMD Back-End

Extraction of SAP

Performance Data

SAP NW BW

DPW InfoCubes

Injection of

data collectors

Extraction of

collected data


Solution Manager

Database



DB


database: SAP NW BW server,



data: SAPTOOLS



procedures hourly

DBA Cockpit



SMD Back-End

Extraction of SAP

Performance Data

SAP NW BW

DPW InfoCubes

BI Web ReportsRead

BI Server


Solution Manager

Database



DB


Database: SAP NW BW server,



data: SAPTOOLS



procedures hourly

DBA Cockpit



SMD Back-End

Extraction of SAP

Performance Data

SAP NW BW

DPW InfoCubes

BI Web Reports

DBA Cockpit



Read

BI ServerBI Web Reports Read

BI Server


DBA COCKPIT –

PERFORMANCE ANALYSIS

FLEXIBILITY AND

EXTENSIBILITY


VISUALIZATION: BI Exceptions for

Highlighting of Performance Issues

Buffer Pool Hit Ratio [%]

Charts for visualization of performance issues / trends

SAP CoE - database performance: Thresholds for highlighting


FLEXIBILITY: BI Drill Down for Detailed

Analysis of Performance Issues

BI Drill Down Feature

Detailed analysis of all performence KPIs at the point in time of the performance issue

Drill-down according to technical hierarchy


EXTENSIBILITY: Report Configuration in DBA

Cockpit

Extensibility / Flexibility

Customer can add their own reports into DBA Cockpit


EXTENSIBILITY: Customer Specifc Reports

Combining OS/DB/AS/APP Metrics

Extensibility

Customer can use the provided information in the SAP NW BW to create reports according to

their own requirements and also combine OS, DB, AS and APP metrics in the same report

E2E Workload

SAP ABAP Basis

Database Performance Warehouse

Bufferpool Quality, I/O, Database Size,

Memory Consumption, Sorts, Locks

Core Dims

System ID,

Day


DEMODATABASE PERFORMANCE WAREHOUSE



INTEGRATION

Database performance data

and workload metrics of

SAP applications in SMD

and same, consolidated

data warehouse

VISUALIZATION

Charts and BI exceptions for

improved discovery of

performance issues and

identification of workload trends

in time

EXTENSIBILITY

Customer specific reports

can be easily added to

DBA Cockpit (SLA reports)

FLEXIBILITY

BI drill-down feature for

detailed analysis of

performance issues

(time, technical)



WAREHOUSE

TECHNICAL DETAILS


Due to the two weeks windows of keeping the data and scanning for it there are no

gaps in reporting when SAP Solution Manager is offline for maintenance.


Sliding Window of Collected Performance Data

01.11.2008 12:0018.10.2008 12:00

Sliding Window of Performance Data

1. New set of data

in staging tables

2. Removal of old

data

Extract Range of Performance Data

Solution Manager



Technical Entities of Data Collectors

Data Collectors (DB2 LUW 9.1)

Tablespaces (hourly)

Database (hourly)

Memory (hourly)

Buffer Pools (hourly)

Tables (weekly, no empty tables)

Additional Data Collectors (DB2 LUW 9.5)

Resources (hourly)

WLM Activity (hourly)

WLM Threshold Violations (hourly)

DB2 Deep Compression

Staging tables are compressed once they get larger than 1 MB and compression

feature is available




Phase 1: Snapshot

Dump of snapshot (join of admin views and syscat data of technical entity into

snapshot table)

Phase 2: Calculation

If two snapshots are in snapshot table: Calculate delta of these two snapshots and

some basic harmonization and precalculation (safe to db restarts)

Store result in staging table

Phase 3: Cleanup

Removal of all old snapshots except the latest one

Removal of all staging data which exceeds the two weeks sliding window

Phase 4: Dump Collector Runtime Statistics

Runtimes and handled records are dumped into separate table


Data Collectors

Virtual entries in DBA Cockpit planning calendar

Detailed log is available in program log for data collector


Troubleshooting


Data Extractors

Extraction executed by SAP Solution Manager Extractor Framework

Extractor FWK admininistration displays logs (SOLMAN_WORKCENTER)


Troubleshooting



Housekeeping

0DB6_C$$H

Performance data based

on hour/minute

0DB6_C$$M


month

0DB6_C$$D


on day

Multiprovider

Calculated key figures are

created at multi provider

level

0DB6_MP$$



WAREHOUSE

FUTURE TRENDS


Database Performance Warehouse –New Features in EHP2

DB2 for LUW: Planned Enhancements

DBA Cockpit back-end based on history new screen for scheduling of data

collectors

Unified snapshot timestamp: flushes of event monitors will be done through

stored procedures which will be aligned with data collectors

E2E Database Analysis

Basic database workload monitoring in SAP Solution Manager 7.0 EHP2


Further Information

SAP Developer Network (SDN) – DB2 for LUW

https://www.sdn.sap.com/irj/sdn/db6


Part 1 – General Overview:

http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/0068ba63-dfcd-

2b10-d0af-ceb185354a34

Part 2 – The Content:

http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/c0ac4e8e-dfcd-

2b10-3faa-e318fa3ce0f9

Part 3 – Customizing Reports:

http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/203775b4-dfcd-

2b10-6cbd-cafd2c33f92e

https://www.sdn.sap.com/irj/sdn/db6

http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/0068ba63-dfcd-2b10-d0af-ceb185354a34









http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/c0ac4e8e-dfcd-2b10-3faa-e318fa3ce0f9









http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/203775b4-dfcd-2b10-6cbd-cafd2c33f92e









Thank You!


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.

IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation.

Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.

Oracle is a registered trademark of Oracle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.

HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Sun Microsystems, Inc.

JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP Business ByDesign, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.

Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects S.A. in the United States and in other countries. Business Objects is an SAP company.

All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.

These materials are subject to change without notice. These materials are provided by SAP AG and its affiliated companies ("SAP Group") for informational purposes only, without representation or warranty of any kind, and SAP Group shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP Group products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warrant.

Copyright 2009 SAP AG

All Rights Reserved

Documents

Monitoring and Administration with SAP on DB2 Database