27
How To Apply Lean Test Management Bob van de Burgt Professional Testing ® Ban Waste, Gain Efficiency 1

How To Apply Lean Test Management' by Bob van de Burgt

Embed Size (px)

DESCRIPTION

Cost reductions and the quest for more efficiency are more evident in today’s business world. It also follows that our testing processes will ultimately be affected. When test techniques and methods for structured testing are introduced, this results in improvements in the production of more consistent and predictable results. Introducing a risk based approach to testing makes it easier for the business to determine to what extent testing is necessary and most efficient. The resulting Go/No- Go decision process may not be sufficient for all companies so other creative methods need to be investigated. Many management theories speak about “Lean” as being one of the solutions. One of the key steps in using “Lean” is the identification of which steps add value to the customer and which do not. This track will give you information to start using “Lean” within testing and more specifically within test management. The presenter will also look at Lean Six Sigma as being one of the more popular theories that introduces the concept of “Lean” in combination with obtaining higher quality products. This subject will also be explained in combination with testing and test management. This track will focus on applying Lean Six Sigma techniques to test management processes using practical examples from customer cases. The audience can take home a practical “Lean Test Management” overview which they can apply in their own companies. This track is especially of interest to business managers, IT managers, QA managers and test managers that are involved in improving the quality of test management processes.

Citation preview

Page 1: How To Apply Lean Test Management' by Bob van de Burgt

How To Apply Lean Test Management

Bob van de Burgt Professional Testing®

Ban Waste,Gain Efficiency

1

Page 2: How To Apply Lean Test Management' by Bob van de Burgt

I will show you differently!

2

Page 3: How To Apply Lean Test Management' by Bob van de Burgt

- Lean Manufacturing

- Lean Six Sigma

- Roadmap to Lean Test Management

- Conclusions

Agenda

3

Page 4: How To Apply Lean Test Management' by Bob van de Burgt

What is Lean Manufacturing?

• Lean manufacturing is a company process improvement method. It is developed from a logistics viewpoint.

• Lean manufacturing concentrates on banning waste to become quicker and more efficient. Every process that does not add value for the customer is eliminated.

4

Page 5: How To Apply Lean Test Management' by Bob van de Burgt

History Timeline Lean Manufacturing

Image source = © 2005 Strategos, inc5

Page 6: How To Apply Lean Test Management' by Bob van de Burgt

Lean Manufacturing – the 7 wastes

• Overproduction• Waiting• Transporting• Inappropriate processing• Unnecessary inventory• Unnecessary / excess motion• Defects

6

Page 7: How To Apply Lean Test Management' by Bob van de Burgt

What is (Lean) Six Sigma

• Lean Six Sigma is a quality management method that offers a framework to manage quality. By many it is seen as a sequence of Total Quality Management (TQM) with a high use of Statistical Process Control (SPC) as underlying method. Processes can be controled when you know how each process goes and to know that you have to measure: to measure is to know! Measuring is the basis of Six Sigma.

• The aim is to work smarter and get a higher quality.

• Sigma (∂) is the standard deviation from the average. A statistical term that measures how far a given process deviates from perfection.

7

Page 8: How To Apply Lean Test Management' by Bob van de Burgt

History of Six Sigma

• Six Sigma is founded at Motorola in the mid 80’s as a solution for problems with product quality and customer satisfaction. Six Sigma got its big popularity when it was used on a broad scale at General Electric and gained billions over a period of multiple years.

8

Page 9: How To Apply Lean Test Management' by Bob van de Burgt

Defects with sigma level 2

-3 σ -2 σ -1 σ 3 σ2 σ1 σ0=target

σσ

MAX

2 σ = 69,1%

defe

cts defects

30,9 % defects

9

Page 10: How To Apply Lean Test Management' by Bob van de Burgt

Defects with sigma level 4

-3 σ -2 σ -2 σ 3 σ2 σ2 σ0=target

σσ

MAXde

fect

s defects

4 σ = 99,4%

0,6 % defects

10

Page 11: How To Apply Lean Test Management' by Bob van de Burgt

4 key elements

• Delight the customer• Improve processes• Teamwork• Data and facts

11

Page 12: How To Apply Lean Test Management' by Bob van de Burgt

• DMAIC:– Define– Measure– Analyze– Improve– Control

– Between every step is a tollgate

Roadmap to Lean Test Management

12

Page 13: How To Apply Lean Test Management' by Bob van de Burgt

• Purpose: To agree on what the project is.

• Example tools:– SIPOC– Value Stream Map

Define - Theory

Define

13

Page 14: How To Apply Lean Test Management' by Bob van de Burgt

Define – Example SIPOC

* Critical-To-Quality indicators (CTQ)

14

Page 15: How To Apply Lean Test Management' by Bob van de Burgt

Define – Example Value Stream Map

ETC

15

Page 16: How To Apply Lean Test Management' by Bob van de Burgt

Takt time

• Definition Takt Time: The desired time between units of production

output, synchronized to customer demand.

• The concept carries backward through a process stream. Ideally, every step synchronizes with the final output. Takt Time is fundamental to Lean Manufacturing.

16

Page 17: How To Apply Lean Test Management' by Bob van de Burgt

Takt time – a bomber an hour

Image source = © 2005 Strategos, inc17

Page 18: How To Apply Lean Test Management' by Bob van de Burgt

Measure - Theory

• Purpose: Evaluate the existing measurement

system, observe the process, gather data, and map the process in more depth.

• Example tool:– Pareto chart

18

Page 19: How To Apply Lean Test Management' by Bob van de Burgt

Measure – Example Pareto Chart

Pareto chart for long waiting hours during test execution

Failures in test environment 65Failures in test data 20Failures in test cases 8Not fully capable resources 5Rest 2

100

19

Page 20: How To Apply Lean Test Management' by Bob van de Burgt

• Purpose: Use collected data to confirm

the source of delays, waste, and poor quality.

• Example tools: – 5 Why’s– Ishikawa diagram

Analyze - Theory

20

Page 21: How To Apply Lean Test Management' by Bob van de Burgt

Analyze - Example 5 Why’s

Problem Statement:During test execution there

are long waiting hours.

1. Why are there long waiting hours

during test execution?

1. Because often there are failures in

the test environment

2. Why are there failures in the test

environment?

2. Because we often seem to have the wrong version of the test object.

3. Why do we often have the wrong

version?

3. Because someone installed the wrong version.

4. Why does someone install the

wrong version?

4. Because we don’t have proper version

control.5. Why don’t we have proper

version control?

5. Because we never got around to it, but it seems time to do it now. 21

Page 22: How To Apply Lean Test Management' by Bob van de Burgt

Analyze - Example Ishikawa Diagram

Long waiting hours during test execution

22

Page 23: How To Apply Lean Test Management' by Bob van de Burgt

• Purpose:To make changes in a process that eliminate defects, waste, cost, etc., which are linked to the customer need identified inthe Define phase.

• Example tool:– Pick chart

Improve - Theory

23

Page 24: How To Apply Lean Test Management' by Bob van de Burgt

Improve – Example Pick Chart

Implement Possible

Challenge Kill

Easy to implement

Hard to implement

Large result

Small result

1 7

4

8

2

3

69

5

24

Page 25: How To Apply Lean Test Management' by Bob van de Burgt

Control - Theory

• Purpose:To make sure that any gainsa team makes last.

• Example tool:– Control chart

25

Page 26: How To Apply Lean Test Management' by Bob van de Burgt

Control – Example Control Chart

Gain Sigma level

30,85% 1

69,15% 2

93,32% 3

99,38% 4

99,977% 5

99,99966% 6

AverageUpper limit

Lower limit

Triggers for actions

Unpredictable proces

Improved proces

Controlled proces

T3T1 T2

26

Page 27: How To Apply Lean Test Management' by Bob van de Burgt

Conclusions

• Test Management can benefit from Lean and Six Sigma

• Improvement from within your company

• Useful addition to “standard” Test Process Improvement models

• Better integration of test process with other processes

27