View
218
Download
0
Tags:
Embed Size (px)
Citation preview
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Practical aspects of data collection in industry
Why is measurement so difficult to institutionalise?
FiSMA cases and lessons learned
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
”Measurement”?
Software and system measurement is closely related to, and essential part of
”Measurement programs”, ”Data collection” and ”Benchmarking”. There may be measurement without any other connections or any public indications like those three above, but such is very difficult to survey.
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Is measurement important?
• Both SPICE and CMMI standards demand evidence from measurement at higher maturity and capability levels.
• Common sense tells us that we need measurement and data collection if we want to set realistic business goals and quantify improvement.
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Finland and software measurement
• Finland is (in many ways) one of the top countries in the Measurement World.
• Activity in software project data collection is also an indicator of maturity level.
Where does the ISBSG data come? (2005)
per capita Finland and Australia are the most efficient so far
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
ISBSG data collection histogram
• Getting better year by year
• 2350 projects by the end of 2003
• 4000+ projects by today (2006)
• Data collection looks popular and important!
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Experience® data collection histogram• 750+ projects • The best
organisations at CMMI/SPICE level 4, several on level 3.
• SPI and project estimation training and consulting services are well established, benchmarking services available.
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
”Success” of measurement programs
Of 610 measurement programs in place in
1998, only 140 survived the two-year mark as reported in data collected by Howard Rubin. Moreover, Dr. Rubin's data points since 1988 show a consistent 78% or higher failure rate for measurement programs. [Dekkers and McQuaid, IEEE IT Pro, 2002]
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Introduction to FiSMA measurement methods and data collection tools
• Experience® Pro 3.1• Functional Size Measurement
and Project Delivery Rate (FSM & PDR, FP & h/FP)
• 21 productivity factors for development and 22 productivity factors for maintenance (ND21 & MT22)
• Context variables (5-30) and other metrics details
• Data quality criteria 2005 (max 100 points)
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
FiSMA measurement principle
Same metrics, same methods and same tools throughout the development life-cycle and maintenance.
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Sample of FiSMA cases – data collection 1990-2005
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Company-99 story (template)• Market position and
competition• Ownership and visible goals• Measurement training, metrics
specialist recruitment and R&D activity
• Method and tool adoption approach
• Recognition of success, rewarding and career opportunities
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Why do so many measurement programs fail? Critical success factors of SPI:
Source: P.Willman
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
CSF’s of FiSMA sample companiesCompany External
pressure Leadership and vision
Capable people
Actionable first steps
Rewards Current “ranking”
03 - + + + - 6 04 - - + + ? 4 06 + - ? + - 5 08 - - + + - 8 11 - + + - ? 3 12 - + + - - 7 14 + + + + + 1 16 + ? + - ? 2
3/8 4/8 7/8 5/8 1/8
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
”SPI trinity”
Improving measurement and estimation processes
Measurement process owner?
Top management connection?
Memberships in SMA-network?
Support and training?
etc...
Functional size measurement
Effort measurement rules
Classification rules
Situation analysis method
etc...
Experience Pro
MS Office tools
KnowledgePlan
ISBSG tools
etc...
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
People skills
• Situational leadership• Nonverbal language• NLP• Cultural aspects• Management by walking
around• One minute management• Statuses• etc ...
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Software Process Improvement Map
Software Technology Transfer
Pekka Forseliuswww.sttf.fi
Finland is known as a technologically advanced and exceptionally competitive country, where the software and systems development is well managed.
Conclusions
... but many Finnish companies have still lot to learn:
-Realistic goals: what do they want to reach?
-Correct timing: when to start measurement program?
-Best practices and methods: what should they measure?
Let’s keep learning from each other!
Thank you!