Web Performance Inc - Web Performance Trainer TM - Edition : March 2003 1 Web Performance Trainer TM

Web Performance Inc - Web Performance TrainerWeb Performance Inc - Web Performance TrainerTMTM - Edition : March 2003 - Edition : March 2003 11

Web Performance Web Performance TrainerTrainerTMTM

22Web Performance TrainerWeb Performance TrainerTMTM Presentation 3/11/2002 Presentation 3/11/2002

Load Testing ObjectivesLoad Testing Objectives

Quality Control● Measure and improve the quality and performance of web sites

Lower operating costs● Reduce hardware requirements● Reduce support costs

Increase Revenue● Increase customer retention rates● Increase employee productivity


Answers Your QuestionsAnswers Your Questions

Does my site crash under load? How much load does it take to crash my site? Am I losing customers because of poor performance? How many users can my site handle? What part of my web site has bad performance? What software and hardware configurations give the

best performance?


Web Performance TrainerWeb Performance TrainerTMTM

Competitive AdvantageCompetitive Advantage

Technology• Ease of use

• Automatically verifies that the web site meets performance goals

• Automatically locates slow web pages• Reliable and accurate results

• Broad support of platforms and network configurations

Cost Savings • Industry leading price/performance

• Cost effective for even small or medium sized projects• Upgrade the number of virtual users at any time with no cost

penalties


How It WorksHow It Works

WebWebServerServer

HTTPHTTPS

Web Web Performance Performance

TrainerTrainerTMTM

SimulatedSimulatedBrowserBrowser




Simulated Simulated UsersUsers

To Web ServerTo Web Server

From Web Server


Proxy Server SupportProxy Server Support

WebWebServerServer

HTTPHTTPS

LANLANInternetInternet

HTTP RequestHTTP Request

HTTP Response

ProxyProxyServerServer

Web Web Performance Performance

TrainerTrainerTMTM





SimulateSimulated Usersd Users


Feature OverviewFeature Overview

Realistic User Simulation• Includes simulation of connection speed at varying bandwidths• Accurate browser simulator

Sends HTTP Requests• Reads entire HTTP response• Parses HTTP response headers (Cookies, etc.)

Dynamic Load Modeling • The number of simulated users changes over time

Parameter Replacement• Each virtual user submits unique data to the web site

Complex test set • Simulate multiple user scenarios simultaneously


Feature Overview Cont.Feature Overview Cont.

Record Test Cases• As easy as browsing a web site• Supports any browser

4 levels of statistics: • Overall• Transaction• Web page • URL

Performance of each HTTP request is measured• Others use sampling-- doesn't report accurate max/min/average

Session Tracking• The web server sees each virtual user as a real, unique user


Feature Overview Cont.Feature Overview Cont.

Username/Password Support• Each virtual user has a unique username and password

Instant performance feedback Dynamic Load Balancing

• Test generating machines are never overloaded • Task of simulating browser distributed to network of computers

according to capabilities Secure Sockets Layer (SSL) and HTTPS Results can be viewed in both tables and graphs Export of the data

• Microsoft Excel • Sun StarOffice

Supports Windows NT, 2000, Linux, and Solaris


Supported Products Supported Products

EJBEJBJSPJSPASPASPPHPPHP

ServletsServletsAppletsAppletsActiveXActiveX

WebSphereWebSphereiPlanetiPlanet

ColdFusionColdFusionWebLogicWebLogicEnhydraEnhydraTomcatTomcat

and most others...and most others...

IISIISApacheApacheiPlanetiPlanet

TuxTuxWebSphereWebSphere

and most others...and most others...

TechnologiesTechnologiesApplicationApplication

ServersServersWeb ServersWeb Servers


Computer Computer Operating SystemsOperating Systems

2.6, 2.7 and 2.82.6, 2.7 and 2.8SolarisSolaris

Redhat 6.x, 7.xRedhat 6.x, 7.xMandrake 7.2, 8.XMandrake 7.2, 8.X

and may moreand may moreLinuxLinux

SP2SP2Windows 2000Windows 2000

4.0 (SP6)4.0 (SP6)Windows NTWindows NT

OS VersionsOS VersionsOperating Systems*Operating Systems*

*Applies only to computers running Web Performance Trainer*Applies only to computers running Web Performance TrainerTMTM


Minimum Hardware Minimum Hardware RequirementsRequirements

Virtual UsersVirtual Users

* Additional memory allows for larger test cases.

500500

200200

100100

CPU MhzCPU Mhz

500500

200200

100100

MemoryMemory

256256

180180

128128


Basic Basic Network ConfigurationNetwork Configuration

LANWEB SERVERWEB SERVERAPPLICATIONAPPLICATION

Web Server ComputerWeb Server Computer

WEB WEB PERFORMANCEPERFORMANCE

TRAINERTRAINERTMTM

BROWSER APPLICATIONBROWSER APPLICATION

Test ComputerTest Computer


Remote Remote Network ConfigurationNetwork Configuration

LANLANWEB WEB PERFORMANCEPERFORMANCE

TRAINERTRAINERTMTM


Test ComputerTest Computer

ROUTERROUTER

WEB SERVERWEB SERVERAPPLICATIONAPPLICATION


ROUTERROUTER

LAN

LAN

WANWAN


Generate Unlimited Numbers of Generate Unlimited Numbers of Virtual UsersVirtual Users

WEB WEB PERFORMANCEPERFORMANCE

TRAINERTRAINERTMTM


Test Computer 1Test Computer 1



WEB PERFORMANCEWEB PERFORMANCETRAINER ENGINETRAINER ENGINE



Test Computer NTest Computer N




A Typical SessionA Typical SessionStage 1: RECORDINGStage 1: RECORDING

Click on the Record ButtonThe browser comes up automaticallyBrowse the site

● Perform a typical operation for your users● Each web page and contents are recorded

Click on the Stop ButtonA Business Case is now recorded


Browser Interaction is Browser Interaction is Recorded AutomaticallyRecorded Automatically


Browser Interaction is Browser Interaction is Recorded AutomaticallyRecorded Automatically






A Typical SessionA Typical SessionStage 2: START LOAD TESTStage 2: START LOAD TEST

Decide on playback parameters• Duration• Starting number of virtual users• How many users to add each minute• A maximum number of virtual users


A Typical SessionA Typical SessionStage 3: MONITOR LOAD TESTStage 3: MONITOR LOAD TEST

Click on the Playback Button Watch Runtime Statistics

• Check for Errors• Monitor hits/sec, I/O, number of simulated

users, etc• Monitor Status of Playback Engines

Virtual users stop when the time is up




HTTP Transaction SequenceHTTP Transaction Sequence


WEB PERFORMANCEWEB PERFORMANCEVIRTUAL USERVIRTUAL USER

Time LineTime Line

REQUESTREQUEST

TTFBTTFB

RESPONSERESPONSEHEADERHEADER

CONTENTCONTENT

DurationDuration


A Typical SessionA Typical SessionStage 4: EXAMINE STATISTICSStage 4: EXAMINE STATISTICS

● Automatically measures the number of simultaneous users the web site handled while meeting the performance criteria

● The performance criteria are configurable

● Reports on the slowest web pages


How many users can my web site How many users can my web site handle?handle?

Estimated User Capacity

● Red Indicates User Levels that don't meet specifications

Performance Requirements


Peak Page Duration AnalysisPeak Page Duration Analysis

Web Page Statistics

Web Page Statistics

Sorted List of Slow Web Pages


Web Statistics TreeWeb Statistics Tree

Examine statistics at four levels• Overall• Business Case (Made up of web pages)• Web Page (Made up of URLs)• URL

OverallTest Results

Web PageTest Results

Business CaseTest Results

Web PageTest Results

URL #1 Results

URL #2 Results

URL #3 Results

URL #4 Results

URL #5 Results


URL/Web Page/Business Case Statistics• Min/Max/Avg Time to First Byte

• How long it took for the virtual user to see the first byte of the reply

• Min/Max/Avg Duration• How long it took for the browser to receive the full URL, web

page, or business case• Bytes/Sec• Errors• Repeats

Overall Statistics• Hits/Sec• Bytes/Sec• Errors

Statistics CollectedStatistics Collected


Statistics BrowserStatistics Browser


A Typical SessionA Typical SessionStage 5: View GraphsStage 5: View Graphs

Graph any number of parameters

Create an unlimited number of graphs

Compare the results of multiple tests• Performance tuning

Export data in graph to Excel Save graphs to images



Does my site fail under load?

Users start toexperience errors


How many userscan this sitehandle?

Front page load time goes over 8seconds at 650virtual users



2,0002,000

Price ListPrice List

$1,995US$1,995US$7,995US$7,995US1,0001,000

$2,495US$2,495US$9,995US$9,995US

$2,995US$2,995US$11,995US$11,995US5,0005,000

$1,245US$1,245US$4,995US$4,995US500500

$3,745US$3,745US$14,995US$14,995USUnlimitedUnlimited

$620US$620US$2,495US$2,495US200200

$370US$370US$1,495US$1,495US100100

Premium SupportPremium SupportRetail PriceRetail PriceVirtual UsersVirtual Users


BasicBasicMaintenance/SupportMaintenance/Support

Basic Support• Included in the price of the license

Upgrades• Entitled to any major release for 3 months after purchase• Download any bug fixes for the version purchased• If a bug fix is not available, a free upgrade may be provided


Premium Premium Maintenance/Support Maintenance/Support

All of the features in Basic Maintenance/Support

Plus...

Upgrades• Extended from 3 months to 1 year

Support• Email support receives priority attention• Phone support during normal business hours

Time Period• One Year


Partial Client ListPartial Client List

AIRBUS Atlas Van Lines Blue Cross/Blue Shield of

California Barclays Bank CROSSAIR (Suisse) Deutsche Bank France Telecom General Dynamics Government of Canada Government of France

Government of Quebec Lufthansa Motorola Polaroid Raytheon Toyota of Canada US Navy Wells Fargo Ziff Davis


ContactsContacts

United States • Web Performance Inc.• http://www.webperformanceinc.com

International Resellers• Australia, Austria, Belgium, Brazil• France, Germany, India, Japan • Ireland, Korea, Switzerland• United Kingdom

Documents

Web Performance Inc - Web Performance Trainer TM - Edition : March 2003 1 Web Performance Trainer TM