View
230
Download
0
Category
Preview:
Citation preview
8/3/2019 2006 Oct Web Seminar Power Point
1/12
Performance Testing
Tips and Techniques
Understanding Operational Profiles
Dale L PerrySoftware Quality Engineering
8/3/2019 2006 Oct Web Seminar Power Point
2/12
22005-2006 Collard & Company/SQE V2.2
Performance Profiles
One of the key activities in performance
testing is to decide what type of load orloads to place on the system/application
There are many variations of performancetesting that we can select from so we firsthave to determine what is needed
8/3/2019 2006 Oct Web Seminar Power Point
3/12
32005-2006 Collard & Company/SQE V2.2
Types Of Performance Testing
The three most common types of software
performance testing include: Testing which is driven by what we want to
measure Testing which is based on the source or type
of the load Testing to stress the system or find its limits
8/3/2019 2006 Oct Web Seminar Power Point
4/12
82005-2006 Collard & Company/SQE V2.2
Understanding Load
Once we have an idea of what we want to
accomplish The general type of testing we want What tests we want to run
Now we have to decide on the volume ofactivity and the composition of that volume,load (i.e. workload)
8/3/2019 2006 Oct Web Seminar Power Point
5/12
92005-2006 Collard & Company/SQE V2.2
Load (Operational) Profile
To better simulate the real world, not only
should the load size be estimated, but alsoa profile of the users/activities that make upthe load needs to be created
8/3/2019 2006 Oct Web Seminar Power Point
6/12
102005-2006 Collard & Company/SQE V2.2
Test Sample Sizes
Most factors which we want to measure, such as
response time, vary based on many factors; bothknown and unknown This means we cannot measure something once but
must sample it several times in order to compute ameaningful average
How big does the sample need to be? This is a roughrule of thumb for the relationship between sample sizeand accuracy
Sample AccuracySize (roughly)
30 50%100 25%200 10%
1,000 3%
8/3/2019 2006 Oct Web Seminar Power Point
7/12112005-2006 Collard & Company/SQE V2.2
When To Sample Sampling Errors7 9
Eastern
Central
Mountain
Pacific
8/3/2019 2006 Oct Web Seminar Power Point
8/12132005-2006 Collard & Company/SQE V2.2
Number And Types Of Users
The mix of users(events) may vary by time
period Special events can alter the mix
Browsers
Buyers
8/3/2019 2006 Oct Web Seminar Power Point
9/12142005-2006 Collard & Company/SQE V2.2
Concurrency
8/3/2019 2006 Oct Web Seminar Power Point
10/12162005-2006 Collard & Company/SQE V2.2
Think Times
The time it takes a client (or virtual client) to
respond to an application may have asignificant impact on the number of clientsan application can support This is a key aspect of concurrency
8/3/2019 2006 Oct Web Seminar Power Point
11/12172005-2006 Collard & Company/SQE V2.2
Background Load (Noise)
What additional activities need to be
considered to accurately reflect theperformance degradation caused bynetwork and other application loads,
background noise?
8/3/2019 2006 Oct Web Seminar Power Point
12/12182005-2006 Collard & Company/SQE V2.2
Summary
A successful software performance test
plan starts with knowing what it is you wantto accomplish
What types of tests do you want?
What loads and mixes are are needed forthese tests
Operational profile
Recommended