Measured Quality in Testing
Roman Civin, Moravia WorldwideQASight Business Unit
LRC-X Conference, LimerickSeptember 14, 2005
What to Expect
• What is quality in testing
• Defining criteria
• A process model
• See it work
• Q&A
What is Quality in Testing
• Product quality
• Bug database standards
• Project management
• Testing efficiency
• …
Criteria Examples
• Minimum quality check volume
Criteria Examples
• Bugs found during QA
Criteria Examples
• Database standards
Criteria Examples
• Quality management indicator
A Process Workflow
Testing project
Yes
Quality check performed
Quality check result
Pass
Fail
Is result correct?
Yes
TTL
Quality plan defined on project?
PM
No
RED FLAG Quality indicator (weekly report)
Follow up action
QA items assigned?
TTL
PM
No
RED FLAG Quality indicator (weekly report)
Follow up action
PM
AutoAssign to PM. Superiors
informed; RED FLAG Quality
indicator (weekly report)
Follow up action
No, assign to TTL
TE
CloseTE CloseTE
Testing project
Yes
Quality check performed
Quality check result
Pass
Fail
Is result correct?
Yes
TTL
Quality plan defined on project?
PM
No
RED FLAG Quality indicator (weekly report)
Follow up action
QA items assigned?
TTL
PM
No
RED FLAG Quality indicator (weekly report)
Follow up action
PM
AutoAssign to PM. Superiors
informed; RED FLAG Quality
indicator (weekly report)
Follow up action
No, assign to TTL
TE
CloseTE CloseTE
Using the Process and Data
• Outputs gathered at org level
• Process owner and project owners
• Quality tracked
• Project results, lessons learned
• Clients check indicators, not vendors
• Team evaluations
• “Quality has priority over timeliness”
Tool Example
Tool Example
Summary
• What makes testing quality
• Metrics examples
• Quality control as a process
• Usage and tools
THANK YOU!
• Discussion
Contact Details
Roman Civin
• E-mail: [email protected]
• Tel.: +420-545-552-142
• QASight: www.qasight.com
• Moravia: www.moraviaworldwide.com