Software Project Management With Software Project Management With Usage of MetricsUsage of Metrics

Candaş BOZKURT - Tekin MENTEŞDelta Aerospace

May 21, 2004

DELTA AEROSPACE

In this presentation . . .In this presentation . . .

The importance of MetricsSPM and Usage of MetricsProblems in SPMSolution by using Metrics effectivelyDifficulties in collecting MetricsAutomated Metrics Collection ToolConclusion

DELTA AEROSPACE

MeasurementMeasurement

Measurement: process by which numbers or symbols are assigned to attributes of entities in the real world in such a way as to describe them according to clearly defined rules

“What is not measurable make measurable”, Galileo Galilei

“You cannot control what you cannot measure”, De Marco

DELTA AEROSPACE

Role of MeasurementRole of Measurement

Processes,Products &

Services

UnderstandUnderstand

PredictPredict

ControlControl

EvaluateEvaluate

DELTA AEROSPACE

Objectives of Software Measurement ?Objectives of Software Measurement ?

To collect objective information about the current state of a software product, project, or process.

To allow managers and practitioners to make timely, data-driven decisions.

To track your organization's progress toward its improvement goals.

To assess the impact of process changes.

DELTA AEROSPACE

Measurement ProgramMeasurement Program

ObtainOrganizational

Support

ProvideMeasurement

Resources

DefineMeasurement

Responsibilities

InitiateMeasurement

Process

DELTA AEROSPACE

MetricsMetrics

Metrics: Quantitative measurement

Important to the success of a project

Project Metrics: Used to track project progress

DELTA AEROSPACE

What are Software Metrics?What are Software Metrics?

AppliedTo

MeasurementBased

Techniques

AppliedTo

MeasurementBased

Techniques

Engineering &ManagementInformation

ToImprove

Engineering &ManagementInformation

ToImprove

SoftwareProcesses,Products &

Services

ToSupplySoftware

Processes,Products &

Services

ToSupply

DELTA AEROSPACE

Software MetricsSoftware Metrics

Components of Software Measurement– Process Metrics (e.g. Time, Effort, Cost)– Product Metrics (e.g. Size, Reliability)– Resource Metrics (e.g. Price,

Experience)

Goal – Question – Metric (GQM) ApproachMetrics Methodology / Framework

DELTA AEROSPACE

Difficulties When Using MetricsDifficulties When Using Metrics Lack of Management Commitment Measuring Too Much, Too Soon Measuring Too Little, Too Late Measuring the Wrong Things Imprecise Metrics Definitions Using Metrics Data to Evaluate Individuals Using Metrics to Motivate, Rather than to Understand Collecting Data That Is Not Used Lack of Communication and Training Misinterpreting Metrics Data

“If you are miles away from your target it doesn’t make sense to measure in millimeters.”

DELTA AEROSPACE

DON’TDON’T

Measure individuals

Use metrics as a “stick”

Ignore the data

DELTA AEROSPACE

Software Project Management Software Project Management ProblemsProblems“Projects without clear goals will not

achieve their goals clearly”, Tom Gilb

Management of the software development, or namely “Software project planning, monitoring and control”

DELTA AEROSPACE

Solution: Usage of Metrics to Solution: Usage of Metrics to Manage Software ProjectsManage Software Projects Use metrics in managing software project

management by directly forming, updating and monitoring

– software project planning, – schedule, – task assignment,– resource management and– software development processes

DELTA AEROSPACE

Impact on QualityImpact on Quality

A quantitatively managed process is a defined (capability level 3) process that is controlled using statistical and other quantitative techniques,

Quantitative objectives for quality and process performance are established and used as criteria in managing the process,

The quality and process performance are understood in statistical terms and are managed throughout the life of the process

DELTA AEROSPACE

Then, How to use Metrics?Then, How to use Metrics?

Project Management metrics collected should be used to support four functions of management

– Planning, – Organizing, – Controlling and – Monitoring

DELTA AEROSPACE

Measurement TailoringMeasurement Tailoring

Identify andPrioritize

Project Issues

Project Information and Risk Assessment Results

New Issues

Software ProcessCharacteristics

MeasurementPlan

ProposedChanges

ProposedChanges

Select andSpecify Project

Measures

Integrate Into the Software

Process

DELTA AEROSPACE

Usage of MetricsUsage of Metrics

Mainly four groups of Usable Data will be produced from the metrics, aiming:– Collection of objective information about the

current state of a software product, project, or process

– Managers and practitioners to make timely, data-driven decisions

– Tracking the project's progress toward schedule

– Assessing the impact of process changes

DELTA AEROSPACE

Metrics ProgramMetrics Program

Collect andProcess Data

Risk Management andFinancial Performance Results

InformationNew Issues

Periodic Assessment

MeasurementPlan

Analyze Issues

Make Decisions

Project Context Information

Questions

Actions

Data

DELTA AEROSPACE

Which of the Metrics Needed?Which of the Metrics Needed?

Schedule performance (milestones, variances)

Cost performance (actual vs. planned; variances)

Effort performance (actual vs. planned; allocations)

Requirements management (total, growth, traceability)

DELTA AEROSPACE

Which of the Metrics Needed? Which of the Metrics Needed? …continuing…continuingProgram size (SLOC, page counts -

planned vs. actual)Test performance (requirements

tested, passed test) Quality - Defect data status

(problems open, closed, density, origin, SPRs etc.)

DELTA AEROSPACE

Which of the Metrics Needed?Which of the Metrics Needed? …continuing …continuingProcess performance (tasks

completed, action items)Computer resource utilization

(memory loading, CPU loading)Management planning performance

(estimates vs. actual, re-planning etc.)

DELTA AEROSPACE

How to Collect Metrics?How to Collect Metrics?

Metrics Database

Collect Metrics mainly from– Project Manager– Development Team– Testing Team– Quality Team– Help Desk

DELTA AEROSPACE

Advantages of Using MetricsAdvantages of Using Metrics

Organizational software process and quality improvement,

Achieve “Quantitatively Managed Software” processes to be used in the company CMMI Level 4 Process Areas

Monitoring and controlling of the software development schedule, life cycle activities and the resulting risks

DELTA AEROSPACE

Earned Value Example Earned Value Example (Usage of Metrics)(Usage of Metrics)

15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 ..... end of project

CDR TRR

COSTVARIANCE

CONTRACT BUDGET BASE

SCHEDULEVARIANCE

NOW

$

}}

Projectedactual endcost

Actual cost of work performed

Planned cost of work scheduled

Planned cost of work performed

DELTA AEROSPACE

Future ImprovementsFuture Improvements

Improving Automated Metrics Collection Tool

Use Metrics in Decision Support Systems

Make Metrics directly affect the Project Plan.

DELTA AEROSPACE

Why Use a Tool ?Why Use a Tool ?

Efficient and Accurate Data CollectionReal Time Decision Support Data Security and PrivacyEffective Reporting

DELTA AEROSPACE

Use Automated Software Metrics Use Automated Software Metrics Collection ToolCollection Tool Usage of a distributed software project

management tool that supports – organizational level planning, – task assignment (including predecessor and

successor task assignments), – time and resource Management, – visual schedule preparation (Gantt Chart), – metrics collection and analysis, and – most importantly matching of the metrics data

with the project schedule and task assignment modules

DELTA AEROSPACE

EXAMPLE TOOLSEXAMPLE TOOLS

PACE by MilsoftPROMACS by Delta Software GroupMS ProjectSureTrack…

DELTA AEROSPACE

Tool ExpectationsTool Expectations

Metric collection tool should be integrated with Project Schedule

should force to gather accurate data (Smart Tools can be used)

should produce effective reports for decision making

Should produce suggestions in some points

Usage of Historical data

DELTA AEROSPACE

ConclusionConclusion To survive a software development organisation must

make accurate cost estimates and improve productivity and quality.

If you do not know where you are now you certainly won't know where you will be in the future.

To achieve accurate measurements of productivity and quality requires automated metrics collection and analysis.

In order to characterize, evaluate, predict and improve the process and product a metric baseline is essential.

DELTA AEROSPACE

Q & AQ & A

Questions and Answers:

– Are there any parts that needs to be clarified?

– Are there any questions regarding the concepts talked about?

– Are there any suggestions to improve this presentation?

DELTA AEROSPACE

Thank Your for YourThank Your for Your Attendance…Attendance…

The End