Measurement and Analysis, where do I Start? - Enrique Morey (Proqua)

Portugal

Measurement & AnalysisHow do you start?

Enrique MoreySenior Consultant & SCAMPI Lead Appraiser

Process Quality Engineering (ProQua)

2011-10-03

2

Process or metrics?

3

What do companies want?

4

Deliver on time

No failures

5

Increase incomes

Reduce costs

6

Impact of changes

Non-conformities

7

more

profitability

increase

incomes

reduce

costs

customer

satisfaction

deliver

on time

without

defects

without

over-costs

changes

requests

non

conformities

8

time deviation

post-production defects

effort deviation

change requests

non-conformities

9

time deviation

10

DescriptionPercentage deviation in time respect the estimated date, for completion of milestones and / or project

Type Schedule

Measurement objective

Are we accomplished the scheduled dates?

Unit Percentage

Data sourceSchedule / Project Plan

ProposalCollection method

Counting

Frequency Weekly / Biweekly / Monthly Goal 0%

Formula (real date – estimate date) / estimate date

Analysis criteria

• < 0, project is executing below the planning

• = 0, project is executing on time

• > 0, project is executing with deviation

Variations Counting the delayed days in absolute terms

time deviation

11

post-production defects

12

post-production defects

DescriptionDefects reported by the customer once the product has been delivered

TypeProduct quality

Measurement objective

Have we delivered the product without defects and / or mistakes?

Unit Defects

Data source Client’s incidentsCollection method

Counting

Frequency Monthly Goal 0

Formula N.A.

Analysis criteria

= 0, product has no detected defects

> 0, product was delivered with defects, and corrections have not an estimated/planned effort

Variations Counting effort to correct defects (hours, days)

13

effort deviation

14

Description

Percentage deviation in hours/date respect the estimated effort, for completion of tasks, milestones and / or project

Type Cost

Measurement objective

Are we performing the project with over-effort?

Unit Percentage

Data sourceSchedule / Project Plan

Effort estimationCollection method

Effort timesheet

Frequency Weekly / Biweekly / Monthly Goal 0%

Formula (real hours/days – estimate hours/days) / estimate hours/days

Analysis criteria

< 0, project is executing below the estimation

= 0, project is executing according to the estimation

> 0, project is executing with over-effort

Variations Counting the over-effort (hours/days) in absolute terms

effort deviation

15

change requests

16

DescriptionChange request from customers (external) and project team (internal)

TypeProduct stability

Measurement objective

Have we kept the scope and / or initial estimates of the project?

UnitChange requests

Data sourceChange request from customers and project team

Collection method

Counting

Frequency Monthly Goal 0

Formula N.A.

Analysis criteria

= 0, product has no change requests

> 0, product has change requests that could impact project parameters (size, effort, dates)

VariationsCounting effort to implement change requests (hours, days)

Comparing changed requirements vs. initial requirements

change requests

17

non-conformities

18

DescriptionDefects, errors and non conformities detected by project team, before delivery of the products to the client

TypeProduct quality

Measurement objective

Are we performing our processes and developing products as established?

Unit Defects

Data sourceQuality audits / Test Plans / Identified defects

Collection method

Counting

Frequency Monthly Goal 0

Formula N.A.

Analysis criteria

= 0, there have not identified defects or non conformities

> 0, there have identified defects or non conformities, and corrective actions has an impact in the project parameters

VariationsCounting effort to correct defects (hours, days)

Categorize them by project phase, defect type, etc.

non-conformities

19

Consolidation at organizational level

20

Responsibility

Continuous definition

Stability

Storage

Remind…

21

Let’s start to measure!

22

Questions?

23

Thank you for your attention…

Enrique Morey MatosConsultor Senior

C/ Santa María 17, Oficina B28231 Las RozasMadrid España

T +34 911 299 529M +34 600 516 439

emorey@proqua.eswww.proqua.es