© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Performance & Availability Lifecycle

© 2008 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice

Performance & Availability Lifecycle

Recorded on July 10, 2008

Sanjay Anne

HP Software, Product Marketing

Agenda• Performance & Availability

Lifecycle• Why is it important?• Why is it hard to achieve?• How does it help QA/Test and Ops

teams?• Customer example

April 11, 2023

Performance & Availability Lifecycle (PAL)

• What?−Managing performance and availability in both

pre-production and production

• How?−By integrating testing and monitoring solutions

to drive efficiency, mitigate risk, and reduce costs

• Deployment−Use best practices created by HP Software

Services to deploy

Why is it important?

Run Load Tests

Record Business Processes

Deploy and Monitor

Record Business Processes

Testing Operations

“86% of IT projects experience performance problems when first put in production” Gartner

PerformanceRequirements?

Why is it hard to achieve?

SOA, Shared Services, Web 2.0, Enterprise 2.0

New and Agile Business CapabilitiesBusiness Services?

CRM Operationse-Commerce

Finance

Increasing complexity

Increasing time and cost pressures

CIO

Failure

Distributed and Offshore teams

Integrated business processes

PAL scenarios – attributes of a real-time enterprise

Monitor and Optimize

Reuse Business ProcessScripts

Test and Optimize

Record Business Process Scripts Bidirectional

Asset Reuse

TESTING OPERATIONS

Leverage Real User Information in Pre-Production

Reuse Business Processes Scripts/SLAs from Testing in Production

Unified Diagnostics

New application deployment

Continuous improvement

(Hot packs, fixes etc)

Major upgrades

Leverage operational information

HP Performance and Availability Lifecycle includes:

• HP Performance Center software• HP LoadRunner software• HP Business Availability Center software

−HP End User Management software• HP Business Process Monitor

• HP Real User Monitor

• HP Diagnostics software• HP Performance Center Implementation Service

software

7 04/11/23

Linking pre-production and production teams

Key differences when going live…

QA EnvironmentObjective is to establish the breaking points of the application

•Confined to the QA environment•No access restrictions•Known data sets•Dummy data•All operations are fair game •Clean environment•Consistent network •Not an audited environment

ProductionObjective is to ensure the service doesn’t break

•Global Scope•Location/Time restrictions•Chaotic user defined data•Information security requirements•Some things cannot be touched•Noisy environment•Network varies by time & user•Auditing is common

04/11/23

Performance and Availability Lifecycle Process

MONITORING AND OPTIMIZATION

Build Test Scripts & Scenarios

Plan Capacity

Gather Performance Requirements

Diagnose Root Cause & Optimize

Run Performance Tests

Detect and Isolate Problems

Develop Monitoring Strategy



Monitor App and Infrastructure

Build Monitoring Scripts

TESTING AND OPTIMIZATION

Validate Results

OPTIMIZE BUSINESS OUTCOMES

DevelopmentPerformance EngineerQuality Assurance

OperationsPerformance Engineer

Application Support

Deploy

BidirectionalScript Reuse

GoNo-Go





Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Store and retrieve Test Scripts & Scenarios

04/11/23


Define SLA’s to a load test

Generate point & click scripts

With powerful scripting capabilities

14 April 11, 2023

Broadest environment support

PR

OTO

CO

LS

ERP/CRM

• SAP• Oracle• Siebel• PeopleSoft

Web

• SOA• HTTP(S)• Web 2.0• Citrix ICA• WAP

Middleware

• EJBs• CORBA• COM• RMI• MQSeries

Databases• Oracle• MS

SQLServer• DB2• ODBC

Legacy

• 3270• 5250• VT100

Load

BalancerWeb

ServerApplication Servers

DatabaseNetworkController Load

Generators

Vusers

US

Europe

• Windows• Unix• Linux

• SNMP• WAN

Emulation

• MS IIS• iPlanet• Apache

• BEA WebLogic• IBM

WebSphere• ATG Dynamo• iPlanet App

Server

• EJB• JDBC• JSP• Sitraka

JMonitor

• Oracle• MSSQL

Server• DB2

Oracle 11i Siebel SAP J2EE J2EE .NET

Diagnostics

Monitors

Operating Systems Network Web Servers App Servers Java Databases




Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Store and retrieve Monitoring Scripts

Save time creating monitors

Reuse Test Scripts for Business Process Monitoring




Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Capture Real User Scripts & Scenarios for reuse


What can be learned in production?

Individual behaviorSlow operations

Odd data

Navigation paths

Error creation

Group behaviorUsage loads

Common paths

Abandonment metrics

Under/Unutilized areas

User set/group idiosyncrasies

Infrastructure behaviorUtilization

Topology

Relations to user loads

Shared services

Application logicTopology flows

Slow methods/functions

Bottlenecks

Utilization norms between test and production

Day one monitoring

Understand user experience to ensure service levels

Create SLA definitions based on production data




Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Capture Real User Scripts & Scenarios for reuse


Closed-loop integration with Operations

Identify critical business processes

Specify data for accuracy

Manage what really matters

Deliver actionable information

Manage by actionable information

Create scenarios from production data

Data used to create scenarios:

What are the most used BPs?

How many users per BP?

Generate test scripts from Real-User Monitoring

Create Scripts from Production data:

•What does a user do during session?




Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Collaboration to decrease Time to Resolution

Unified Diagnostics

Unified Diagnostics in pre-production and production




Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Capture Real User Scripts & Scenarios for reuseStore and retrieve Test Scripts & Scenarios






Plan Capacity











Validate Results




Application Support

Deploy


GoNo-Go

Capture Real User Scripts & Scenarios for reuseStore and retrieve Test Scripts & Scenarios



Value proposition

• For organizations who:−Want to collaborate across IT silos

−Want to optimize IT efficiency through bi-directional use of requirements, assets, people, and information.

−Responsible for overall delivery of the application and infrastructure to support business processes

−Realize Performance is “not” a one time event but a cyclical process that is held captive by the dynamic nature of applications.

Increase IT efficiency with requirements and script reuse

2Mitigate risk with testing and monitoring

1Increase collaboration to accelerate time to resolution

3Optimize Service Performance

4

Customer example: SAP BW Rollout

• Customer Goals: 300 concurrent users, <20 second reports• Baseline Situation: Scalability to only 90 users

Date Action Result

2/14 Engagement start

2/22-3/3 Set-up Install monitors, script, set-up test accounts

3/3 Calibration run 90 concurrent user baseline

60 second report retrieval

3/4- 4/29 10 iterative tuning cycles Presentation, application and db layers are isolated and tested

Scalability improves to 264 users

Customer trained on best practices

5/31-6/30 Project extended Scalability hits 300 users

Response times for critical reports drop to 15-30 seconds

7/1-10/1 Ongoing monitoring 11 business processes re-used for end-user monitoring and health checks

SAP project: issues identified

1. Presentation Layer: − Spawning would improve performance

(CPU/Memory/Capacity OK)

2. BW Layer: − Change Load Balancing schema

− Update service packs

− Optimize batch scheduling

− Reconfigure memory settings (after upgrade)

3. Oracle DB Layer: − Update for Oracle 9i configurations

− Remove STAR_TRANSFORMATION hint from the BW queries

− Increase Redo Log file

SAP project: response time improvement

Support pack implementation

City of Boston

Bridging the application life-cycle

David Nero, Director of Enterprise Applications

“If we have a performance or availability issue, even if it’s only once a quarter, the perception of the end user is ‘the system doesn’t work.’ We need to be proactive and prevent issues from becoming visible to users.”

Challenge Solution Results

•Need to improve customers perception of application availability

•Lack visibility into IT infrastructure and end users experience

• Improve customer experience

•Need to scale and ensure IT is not the bottleneck

HP Business Availability Center• Business Process Monitor• Service Level Management• Service Availability Management•HP Loadrunner

• Improved end user perceptions of system availability

• Improved business process availability and performance to 10x faster than expected

•Leverage assets between pre and post production

•Foundation in place for driving improved performance and accountability 24x7

April 11, 202337

Why HP?• Complete lifecycle solution

−Bi-directional script reuse

−Unified Diagnostics support for both pre-production and production

• Market leader in key aspects of lifecycle−Pre-deployment testing, monitoring and diagnostics

• Comprehensive and flexible service offerings−Consulting, Education, Support and Managed Services

Mitigate risk

Optimize application performance

1. Lifecycle must start with clear business requirements

2. Testing must be done based on actual production measures

3. An accurate view of service level must be measured and monitored

“If you can’t measure it, you can’t manage it” - Dave Packard

Summary

Without it IT cannot set, test, measure, or deliver on expectations

Without it Quality will suffer

Without it Service degradation is inevitable

More information

• HP Performance and Availability Lifecycle Webinar (recorded 9/19/07) www.hp.com/go/hpswpalwebinar − Learn how you can integrate HP LoadRunner, HP End User

Management and HP diagnostics software to:• Reduce risk to new application rollouts and upgrades

• Streamline the testing cycle so you can run more tests and resolve problems prior to production

• Automate test script and scenario creation

• HP Software-as-a-Service: www.hp.com/go/saas • Register for live or on-demand HP Software Web Events -

www.hp.com/go/HPSoftwarewebevents • Get white papers and more at the HP Software Download

Center - www.hp.com/go/dlc • Get more on HP Software - www.hp.com/software

© 2008 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice

Documents

© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Performance & Availability Lifecycle