Embed Size (px)
Citation preview
Unissons nos Talents
T O G E T H E RT A L E N T E D
1
A Visual Approach to Risk Based Integration Testing
Neil [email protected]
+44 (0) 121 506 9180 , +44(0) 7917 655939
A Visual Approach to Risk Based Integration Testing 01/12/09 2
Agenda
What is Risk Based Testing?
Misconceptions and problems with RBT
Heatmaps – A potential solution
Considerations and Challenges
Other uses of Heatmaps
Summary
A Visual Approach to Risk Based Integration Testing 01/12/09 3
What is Risk Based Testing?
Component Integration
Component Integration
System Integration
System Integration
System Testing
System Testing
ComponentTesting
ComponentTesting
AcceptanceTesting
AcceptanceTesting
Component Specification
Component Specification
TechnicalDesign
TechnicalDesign
FunctionalSpecification
FunctionalSpecification
Technical Architecture
Technical Architecture
BusinessRequirements
BusinessRequirements
Ris
k B
ased
Rep
ortin
g
Ris
k B
ased
Rep
ortin
g
Prio
ritis
ed E
xecu
tion
Prio
ritis
ed E
xecu
tion
Risk Based Tracking & ControlRisk Based Tracking & Control
Risk Identification & Risk Identification & AnalysisAnalysis
Risk Based Risk Based Testing Testing StrategyStrategy
Specification, Specification, prioritisationprioritisationand reviewand reviewof test casesof test cases
Risk Based Decision Risk Based Decision on Releaseon Release
A Visual Approach to Risk Based Integration Testing 01/12/09 4
Misconceptions and Problems with RBT
Misconceptions
Variety of interpretations on objective of RBT
RBT can be independent of order of software delivery
No high severity defects will be found in later phases
Problems
Obtaining “objective” risk assessment of multiple integrated systems
Focus tends to be on systems and not interfaces
Reporting does not focus on risks mitigated but on “numbers” of scripts executed
A Visual Approach to Risk Based Integration Testing 01/12/09 5
Heatmaps – what are they? Heatmaps represent information visually using colours
Weather forecasts, stocks and shares, swine flu infections
A Visual Approach to Risk Based Integration Testing 01/12/09 6
Heatmaps – How to use them in System Integration testing
A Visual Approach to Risk Based Integration Testing 01/12/09 7
Heatmaps – Prioritisation of Technical Risk
Technical risk
A Visual Approach to Risk Based Integration Testing 01/12/09 8
Heatmaps – Prioritisation of Business Processes
Critical Business Processes
A Visual Approach to Risk Based Integration Testing 01/12/09 9
Heatmaps – Prioritisation of Business Impact
Business Impact
A Visual Approach to Risk Based Integration Testing 01/12/09 10
Heatmaps – Mapping of Technical Risk & Business Impact
4
2
1
3
Technical Risk
Business Impact
Low Medium High Critical
Critical
High
Medium
Low
A Visual Approach to Risk Based Integration Testing 01/12/09 11
Heatmaps – Combined Mapping of Technical Risk & Business Impact
A Visual Approach to Risk Based Integration Testing 01/12/09 12
Heatmap Benefits?
Highlights the RBT approach visually
Provides ease of understanding for all Stakeholders
Incorporates technical risk into test design
Provides Risk Based reporting against specific interfaces & systems
Ability to agree coverage levels for each risk priority
A Visual Approach to Risk Based Integration Testing 01/12/09 13
Considerations and Challenges
Obtaining full buy in and getting Subject Matter Experts away from their day jobs
Understanding impact of “IT” driven processes
Agreeing organisational business impact
Ensuring use of up to date system architecture diagrams
Lack of availability of fully integrated test environments
A Visual Approach to Risk Based Integration Testing 01/12/09 14
Other uses of Heatmaps
Can be applied to prioritise System Testing
Prioritisation of defect fixing
Regression Testing prioritisation
Reassessing RBT for Incremental developments
A Visual Approach to Risk Based Integration Testing 01/12/09 15
Summary
RBT - different things to different people
More effective focus of System Integration testing effort
Heatmaps - a visual approach
Combines technical risk with business impact
Ensures common understanding
Needs full buy in!
A Visual Approach to Risk Based Integration Testing 01/12/09 16
Questions?
A Visual Approach to Risk Based Integration Testing 01/12/09 17
Thankyou
