66
Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato PMI-ACP, SA, CSP, CSM, PMP, ITIL Solutions Architect, CA Technologies [email protected] 10/18/2016 Agile Professionals Meetup Rally Software is now part of CA Technologies

Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

Work->Data->Insight->ActionCaseStudiesofContinuousImprovementthroughMetrics

JimDamatoPMI-ACP,SA,CSP,CSM,PMP,ITILSolutionsArchitect,[email protected]

10/18/2016

AgileProfessionalsMeetup

RallySoftwareisnowpartofCATechnologies

Page 2: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

2 ©2016CA.ALLRIGHTSRESERVED.

How long will it take a ScrumMaster to

screw in a lightbulb?

Page 3: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

3 ©2016CA.ALLRIGHTSRESERVED.

Two Points!

Page 4: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

4 ©2016CA.ALLRIGHTSRESERVED.

Page 5: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

5 ©2016CA.ALLRIGHTSRESERVED.

Page 6: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

6 ©2016CA.ALLRIGHTSRESERVED.

Me (without gray hair)

Page 7: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

7 ©2016CA.ALLRIGHTSRESERVED.

You?

Page 8: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

8 ©2016CA.ALLRIGHTSRESERVED.

Why a presentation on metrics?

Page 9: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

9 ©2016CA.ALLRIGHTSRESERVED.

Why a presentation on metrics?

Too many organizations don’t measure anything

Page 10: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

10 ©2016CA.ALLRIGHTSRESERVED.

Why do we measure?

Page 11: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

11 ©2016CA.ALLRIGHTSRESERVED.

Why do we measure?

If you can’t measure it, you can’t manage it

Page 12: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

12 ©2016CA.ALLRIGHTSRESERVED.

What are metrics for?

Page 13: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

13 ©2016CA.ALLRIGHTSRESERVED.

What are metrics for?

Finding your problems(aka Continuous Improvement)

Page 14: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

14 ©2016CA.ALLRIGHTSRESERVED.

Page 15: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

15 ©2016CA.ALLRIGHTSRESERVED.

How do we use metrics?

Page 16: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

16 ©2016CA.ALLRIGHTSRESERVED.

How do we use metrics?

Work -> Data -> Insight -> Action

ContinuousImprovementx/t

Page 17: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

17 ©2016CA.ALLRIGHTSRESERVED.

Virtue vs Sin

As a lever to drive someone else's behavior

For feedback to improve your own performance

Page 18: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

18 ©2016CA.ALLRIGHTSRESERVED.

What’s the most important measurement

in Agile?

Page 19: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

19 ©2016CA.ALLRIGHTSRESERVED.

Working software is the primary measure of progress.

What’s the most important measurement

in Agile?

Page 20: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

20 ©2016CA.ALLRIGHTSRESERVED.

9,192,631,770

Page 21: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

21 ©2016CA.ALLRIGHTSRESERVED.

9,192,631,770

Don’t be fooled by the fallacy of precision

Page 22: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

22 ©2016CA.ALLRIGHTSRESERVED.

Let’s look at some practice metrics

Page 23: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

23 ©2016CA.ALLRIGHTSRESERVED.

TotalTaskHoursToDo

TotalPointsAccepted

IdealTaskHoursBurndown

Page 24: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

24 ©2016CA.ALLRIGHTSRESERVED.

Unfinishediterationplanning

Acceptedhalfofuserstoriesplanned

Accepteduserstorieslateiniteration

Remainingworkhaspeaked

Burndownisflatperiodinthemiddle

Consistentacceptanceoncestarted

ProblemSolved?

Page 25: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

25 ©2016CA.ALLRIGHTSRESERVED.

Accepted

Defined In-Progress

Completed

Page 26: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

26 ©2016CA.ALLRIGHTSRESERVED.

Lateacceptance

Incompleteacceptance

Dropinworkon7thday

LotsofWorkinProgress

Workcarriedoverfrompreviousiteration

Page 27: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

27 ©2016CA.ALLRIGHTSRESERVED.

Page 28: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

28 ©2016CA.ALLRIGHTSRESERVED.

Considerations– You’re an Agile

coach– Arrived today– Know no history– Have the metrics

– What do we see in the data?

– What would we recommend?

Agile

Page 29: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

29 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1• Company 1

– Large engineering program (15 Teams)– Adopted SAFe (Scaling Agile)

• Team 1 Data:– Velocity - Iteration 2.3 thru 5.3– Iteration 5.1, 5.2 & 5.3

Page 30: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

30 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1 - Team 1 - Velocity

Page 31: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

31 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1 - Team 1 - Velocity

Page 32: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

32 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1 - Team 1 - Iteration 5.1

Page 33: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

33 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1 - Team 1 - Iteration 5.2

Page 34: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

34 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1 - Team 1 - Iteration 5.3

Page 35: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

35 ©2016CA.ALLRIGHTSRESERVED.

Scenario 1 - ObservationsTeam 1• Inconsistent Velocity•Acceptance work at iteration end•Lots of WIP•Not planning iteration well•Adding scope during iteration•Changing iteration length

Page 36: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

36 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2• Same Company 1

– Large engineering program (15 Teams)– Adopted SAFe (Scaling Agile)

• Team 2 Data:– Velocity - Iteration 2.3 thru 5.3– Iteration 5.1, 5.2 & 5.3

Page 37: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

37 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2 - Team 2 - Velocity

Page 38: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

38 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2 - Team 2 - Velocity

Page 39: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

39 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2 - Team 2 - Iteration 5.1

Page 40: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

40 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2 - Team 2 - Iteration 5.2

Page 41: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

41 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2 - Team 2 - Iteration 5.3

Page 42: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

42 ©2016CA.ALLRIGHTSRESERVED.

Scenario 2 - ObservationsTeam 2§ Good velocity, trending upward§ Not entering defects§ Early acceptance of work§ Better control of WIP§ Good planning of iteration§ Consistent scope during iteration§ Changing iteration length

Page 43: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

43 ©2016CA.ALLRIGHTSRESERVED.

Scenario 3• Same Company 1

– Large engineering program (15 Teams)– Adopted SAFe (Scaling Agile)

• Team 1 vs 2 Data:– Impact of changing timebox length

Page 44: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

44 ©2016CA.ALLRIGHTSRESERVED.

When are these the same?

Page 45: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

45 ©2016CA.ALLRIGHTSRESERVED.

/hour /hourandahalf

When are these the same?

Page 46: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

46 ©2016CA.ALLRIGHTSRESERVED.

35 35

28

35

35

28

Team

1Team

2

Page 47: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

47 ©2016CA.ALLRIGHTSRESERVED.

Scenario 3 - ObservationsTeam 1 vs 2§ DON’T CHANGE TIMEBOX!!!

Page 48: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

48 ©2016CA.ALLRIGHTSRESERVED.

Scenario 4• New Company!!!

– Single Agile Team– Practicing Agile for 2 years– Dedicated ScrumMaster– 2 wk sprints; 3 mo releases

• Single Team Data:– Single Iteration

Page 49: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

49 ©2016CA.ALLRIGHTSRESERVED.

Scenario 4 - Iteration

Page 50: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

50 ©2016CA.ALLRIGHTSRESERVED.

Scenario 4 - ObservationsIteration- Task actuals increase- Task burndown flat- Late acceptance- Work carrying over from previous iterations- Unfinished work moved to next iteration- Iterations are consistently over committed - Iterations velocity is consistent, but obviously lower than what the

scope of the release is.

What would we recommend?

Page 51: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

51 ©2016CA.ALLRIGHTSRESERVED.

Scenario 5 - Expert Level• New-New Company!!!

– Single Agile Team– Practicing Agile for 2 years– Dedicated ScrumMaster– 2 wk sprints; 3 mo releases

• Single Team Data:– Single Iteration– Entire Release

Page 52: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

52 ©2016CA.ALLRIGHTSRESERVED.

Scenario 5 - Expert Level

Page 53: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

53 ©2016CA.ALLRIGHTSRESERVED.

Scenario 5 - Performance Analytics

Page 54: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

54 ©2016CA.ALLRIGHTSRESERVED.

Scenario 5

Page 55: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

55 ©2016CA.ALLRIGHTSRESERVED.

Scenario 5 - Observations

What would we recommend?

?

Page 56: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

56 ©2016CA.ALLRIGHTSRESERVED.

How do I get metrics like that?

Page 57: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

57 ©2016CA.ALLRIGHTSRESERVED.

The first key to success?

Page 58: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

58 ©2016CA.ALLRIGHTSRESERVED.

The first key to success?

Estimation!

Page 59: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

59 ©2016CA.ALLRIGHTSRESERVED.

Page 60: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

60 ©2016CA.ALLRIGHTSRESERVED.

Page 61: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

61 ©2016CA.ALLRIGHTSRESERVED.

Page 62: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

62 ©2016CA.ALLRIGHTSRESERVED.

Page 63: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

63 ©2016CA.ALLRIGHTSRESERVED.

The second key to success?

Page 64: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

64 ©2016CA.ALLRIGHTSRESERVED.

The second key to success?

Daily updates of progress

Page 65: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

65 ©2016CA.ALLRIGHTSRESERVED.

TheEnd

Page 66: Work -> Data -> Insight -> Actionfiles.meetup.com/16525022/Agile Metrics Case... · Work -> Data -> Insight -> Action Case Studies of Continuous Improvement through Metrics Jim Damato

66 ©2016CA.ALLRIGHTSRESERVED.

(Imoustacheyouaquestion!)