Source: The 2014 IT Disaster

Hall of Shame

http://origsoft.com/news-

desk/2014-disaster-hall-shame/

debug unplanned

dev rework

debug

Testing schedule in theory:

Testing schedule in practice:

Analysis & Design Implementation & Execution Planning &

Control

Evaluate exit criteria & report Identify Design Build

Analysis & Des Implmt & Exec P & C c&r I&E

confirmation and

regression test

how many test cycles do you have?

debug

c&r I&E c&r

debug unplanned

dev rework

debug

Can get even worse:

Evaluate exit criteria & report

Analysis & D Implmt & Exec c&r I&E

confirmation and

regression test

c&r I&E c&r

wait … wait …

dbg

so we need to be prepared to help the developers

How much do defects cost?

02000400060008000

1000012000140001600018000

requ

irem

ents

spec

ifica

tion

initial te

st

system

/acc

epta

nce

live ru

nning

Folksam

Boehm

Cost of Quality

Internal

Failure costs –

fixing & retesting

bugs found

Detection costs – static &

dynamic testing

The testing

budget

Detection costs –

static & dynamic

testing

Prevention

costs – training,

prototypes

Internal

Failure costs –

fixing & retesting

bugs found

External Failure

costs – live

failures

Prevention

costs – training,

improvements,

prototypes

Cost of Quality

Internal

Failure costs –

fixing & retesting

bugs found

Detection costs – static &

dynamic testing

The testing

budget

Detection costs –

static & dynamic

testing

Prevention

costs – training,

prototypes

Internal

Failure costs –

fixing & retesting

bugs found

External

Failure costs

– live failures

Prevention

costs – training,

improvements,

prototypes

plan:

end date

early design review?

then: Extra

work

delay

result:

very

late

big problems later

manager: “let’s not

bother, we’ll sort it

out when we build it”

– but, risk that design needs re-writing?