Embed Size (px)
Citation preview
ISO/IEC/IEEE 29119:
The New International Software Testing Standards
© Mindtree Limited 2013. Confidential - for limited circulation only
Sylvia Veeraraghavan – Jun 8th 2013
Are software testing standards, required by the discipline?
• Demand for existing standards
• Gaps in the current testing standards provision
• A Baseline for the Testing Discipline
• Current industry practice lacking
• Buyers unclear on what is 'good test practice'
Confidential - for limited circulation only 2
ISO/IEC 29119 –Structure
BS 7925-1Concepts & Vocabulary
Part 1
Part 4 Part 3Part 2
Confidential - for limited circulation only 3
BS 7925-2 IEEE 829
Process
Assessment
‘Part 6’
Testing
TechniquesDocumentationProcesses
ISO/IEC 33063
Keyword-Driven
Testing
‘Part 5’
Justify the inclusion of content into standards?
• Input from existing standards
• Input from published texts
• ISO/IEEE Review processes
• Evidence-based inclusion
• Feedback from use
Confidential - for limited circulation only
Software Testing Concepts
Scope, Conformance, Normative References
Definitions
Part 1: Concepts & Vocabulary
Confidential - for limited circulation only
Testing in different life cycle models
Roles and responsibilities in testing
Annexes – Metrics, Examples, Bibliography
Part 2: Testing Processes
TEST MANAGEMENT PROCESSES
ORGANIZATIONAL TEST PROCESS
Confidential - for limited circulation only
TEST MANAGEMENT PROCESSES
DYNAMIC TEST PROCESSES
Part 3 – Test Documentation
Scope, Conformance, Normative References
Confidential - for limited circulation only
TEST DOCUMENTATION
ANNEXES - EXAMPLES
Part 4 – Test Techniques
TEST COVERAGE MEASUREMENT
Scope, Conformance, Normative References
TEST DESIGN TECHNIQUES
BLACK BOX WHITE BOX
Confidential - for limited circulation only
TEST COVERAGE MEASUREMENT
ANNEXE – TESTING OF QUALITY CHARACTERISTICS
ANNEXE – SELECTION OF TECHNIQUES
ANNEXE – TEST TECHNIQUE EFFECTIVENESS
ANNEXE – EXAMPLE APPLICATION OF TECHNIQUES
Test Policy ( Organizational Test Process)
Test Strategy ( Organization test process)
Organizational Test Process
Organizational test policy
Feedback on organizational test policy
Organizational test Strategy
Feedback on organizational test strategy
Instantiating Testing Processes
Confidential - for limited circulation only
9
(Project ) Test Management Process
Unit/System/Acceptance/Performance/ Usability etc( Test Management Process)
Unit/System/Acceptance/Performance/ Usability etc( Dynamic test process)
Test Management Process
Dynamic test process
Project test plan
Level test plan
Control directives
Test Measures
Level test completion report
Control directives
Test MeasuresLevel test plans
Test Management Processes
ORGANIZATIONAL TEST PROCESS
TEST MANAGEMENT PROCESSES
TEST
ORGANIZATIONAL TEST
DOCUMENTATION
FEEDBACK ON
ORGANIZATIONAL TEST
DOCUMENTATION
TEST PLAN UPDATES
TEST
COMPLETION
Confidential - for limited circulation only
TEST
PLANNING
TESTMONITORING
& CONTROL
TEST
COMPLETION
TEST
PLAN
COMPLETION
REPORT
DYNAMIC TEST
PROCESSES
TEST MANAGEMENT
PROCESSES
TEST PLAN,
TEST COMPLETION REPORT,
TEST MEASURESTEST MEASURES
TEST PLAN,
CONTROL DIRECTIVES
TEST PLAN,
CONTROL
DIRECTIVES
TEST
RESULTS
TEST MEASURES
Test Planning Process
OrganiseTest Plan
DevelopmentIdentify &
Analyse Risks
Design Test Strategy
Analyzed Risks
Scope
Identify Risk Mitigation
Approaches
Understand Context
Treatment
Approaches
Test Plan
Development Schedule
Confidential - for limited circulation only
StrategyDetermine
Staffing and Scheduling
RecordTest Plan
Schedule, Staffing
Profile
Test
Strategy
Gain Consensus on Test Plan
Approved
Test Plan
Draft
Test Plan
Test
PlanCommunicate
Test Plan & Make Available
DYNAMIC TEST PROCESSES
TEST
SPECIFICATION [NO ISSUES
(LEVEL) TEST MANAGEMENT PROCESS
TEST
CONTROL
DIRECTIVES TEST MEASURES
(LEVEL)
TEST PLAN
Dynamic Test Processes
Confidential - for limited circulation only
SPECIFICATION [NO ISSUES
NOTICED]
TEST
ENVIRONMENT
READINESS
REPORT
TEST
ENV’T
REQUIREMENTS
INCIDENTREP
ORT
Test design and implementation
Test
environement
set-up and maintenance
Test execution
Test incident
reporting
[ISSUE NOTICED or
RETEST RESULT]
TEST
RESULTS
Timelines
May May May May …
Parts 1, 2 & 3Parts 1, 2 & 3 Part 4Part 4
WDWD CD1CD1
DISDISFDISFDIS
WDWD CD1CD1
DISDISFDISFDIS FIS!!!FIS!!!
CD2CD2 CD3CD3
CD2CD2 CD3CD3
Part 5Part 5
CD4CD4
DIS-2DIS-2
Part 6Part 6
WDWD CD1CD1 CD2CD2 DISDIS FDISFDIS
FIS!!!FIS!!!
WDWD
FIS!!!FIS!!!
CDCD
Confidential - for limited circulation only
May
10
May
11
May
12
May
13…
• Working Draft (WD)
• Committee Draft (CD)
• Draft International Standard (DIS)
• Final Draft International Standard (FDIS)
• Final International Standard (FIS)
What is most likely to stop ISO 29119?
• Fear of change
• 'Not invented here' syndrome
• Perceived as competition
• Lack of required use
• Anti-standardization – craftsmen
Confidential - for limited circulation only
• No evidence of efficacy
• Cost of use w Complexity
• Lack of responsiveness
Is it applicable to your situation?
• Full vs tailored conformance
• Small and large organizations
• Agile and Traditional
• Games, Financial, Safety-Critical
Confidential - for limited circulation only
• Following Regulatory Standards?
• Can you afford not to?
Questions
• Do you have any?
• What do you think WG26 should do next?
• Are you already doing Risk-Based Testing?
Confidential - for limited circulation only
India | USA | UK | Germany | Sweden | Belgium | France | Switzerland | UAE | Singapore | Australia | Japan | China
Name
www.mindtree.com
