04 test controlling and tracking

Module 03Test Controlling

and Tracking

Topics

Providing the client with sufficient insight into, and the opportunity to influence, the following:

• The progress of the test process

• The quality and risks of the test object

• The quality of the test process

Manage the test process, the infrastructure and the test products. Using the data thus obtained as a basis, and the analyses of possible trends.

http://www.tmap.net/en/tmap/4-essentials/structured-test-process/acceptance-and-system/control-phase

The Control Phase

Software Testing with Visual Studio

Reporting on Software Quality

Monitoring Quality Metrics

Available Test Reports

Rich Information

Rich Visualization

Harder to Customize

SQL Server Reports

Out of the Box

Easy to create your own

Easy to Customize

Excel Reports

All information inone place – the browser

Based on Excel Services

Customizable

Ideal for “Self-Service BI”

SharePoint/Web Access Dashboards

Manual/FunctionalTest Results

Microsoft Test Manager Results

Filters allow you to control

which builds you see

View the test and code coverage

results for each build to

determine quality

Line-by-line highlighting illustrates

which code is covered, uncovered,

or partially covered by test

Results show which methods are

covered by test and total coverage is

indicated by a percentage

Track total percentage hours

completed by user story

View real-time status of

each user story

Test results quickly display

quality status of each user story

Track active and resolved

bugs by user story

Demo

Quality Reports

Bugs and Defects

Manual Testing

Catching and Tracking Bugs

Rich Information

Customizable

Collect rich Information with Data Diagnostic Adapters

Customizable bug flow, states and reporting

Organize testing in multiple

configurations

Playback a prior recording to save

time with frequently-repeated

setup steps and prerequisites

Bind data to controls, to

support multiple iterations

and future automation

Pause, save, close, return, and

pick up where you left off

Filing Bugs

Rich Information

Customizable

Microsoft Test Runner

Microsoft Test Manager

TFS Web Access

Visual Studio

Feedback Manager*

3rd party tools*

IntelliTrace Logs

System logs & configurationDetailed status and history

visible to all team members

Audio & Video recordings

Action Recording

Video

Intellitrace

Test Impact

“Create your own”

Data Diagnostic Adapters

Get an overview of the test run

with summary pie charts, or drill

into the details for each test.

Analyze code coverage for manual

tests to determine which specific

parts of your code were tested .

Associate manual test runs

with builds and environments.

Demo

Creating and Resolving a Bug

The Bug Backlog

Put Bugs on theBacklog

Create your ownBug Workflow

Custom Reports

Relational Databases(TFS)

Data Warehouse(Reporting Services)

Creating Customized Reports

Creating Excel Reports for Test

Quality Status Reports“What is the status of testing of specific user stories or product areas?”

“What is the quality of builds based on the number of failed and passed tests?”

“How many test cases have never been run?”

“Which test cases have never been run?”

Quality Trend Reports“How many tests are blocked, passing, or failing over time?”

“How many tests are regressing?”

“How consistent is the manual test activity over time?”

Test Results - Data Points

Demo

Creating an Excel Pivot Table