Embed Size (px)
Citation preview
Welcome!
Performance Measures with MeaningBy Anne Abbott, MPP
Audio for the webinar today will be via your computer speakers.
Please turn up your speaker volume and enjoy!
Performance Measures With Meaning
Anne Abbott, MPPIowa Center for Evaluation Research
University of Iowa School of Social Work
What are we even talking about?
Performance Measurement-process of monitoring and reporting on goals/accomplishments
2 Questions:-What am I trying to accomplish?-How do I measure progress/success?
PERFORMANCE MEASURE - a single measurement of progress made towards the attainment of a goal/goals
Why Bother?
• $$$- if you can’t demonstrate success it gets VERY hard to make your case for grants, other fundraising
• Without measurement how do we tell success from failure?
• If things don’t get measured they are hard to repeat
• Hard to learn from mistakes without measurement
What gets measured, tends to get done!
Six Steps:
• Identify the desired outcome or accomplishment• Identify the performance measure you will use to determine success• Obtain baseline or trend information• Set a target• Gather• Report/Analyze (can be flipped)
Five Steps:
• Identify the desired outcome or accomplishment• Identify the performance measure you will use to determine success• Obtain baseline or trend information- can be easy or very challenging• Set a target- takes time but is pretty straightfwd once first three steps
are complete• Gather- this is ongoing• Report/Analyze (can be flipped)- different ways to approach this
PM’s can measure a variety of goal types :Effectiveness- did things get done?
Efficiency - were they under budget, over budget, allocated in a certain way (cost per capita)
Process- to what extent did things go as planned?
Quality- did product/service meet customer/client needs and expectations?
Others- safety, responsiveness/timeliness, productivity
Part 1 of Step 1:
START WITH GOOD DEFINITIONS
Generally:
•Who?•What?•Where? •When? •Why?•How?
Answers we really need!
Specific•Target population•Program Model (what and how)•Location•Timeline and Dosage•Why are we doing things this way?
General•Who•What•Where•When•Why•How
The Coalition for Cupcake ReformationMission: Improve cupcakes for the citizens of Bakedgoodslandia
The Coalition for Cupcake Reform
Part 2 of Step 1:
Divide and Conquer
Part 3 of Step1Actually Identifying Your DesiredOutcome
Mixing DivisionObjective : Provide educational opportunities to 35-55 year olds
WHAT ARE THE OUTPUTS?
WHAT ARE THE OUTCOMES?
Goes Back To:• Effectiveness- CCR provides # educational
opportunities to 35-55 year olds• Efficiency - #/# were they under or on budget
with at least # in each training• Process- Trainings were led by staff with a
certain credential, Trainings were located in different parts of the city, Trainings always started on time• Quality- 75% of 35-55 year olds reported that
they “liked” the class? 80% reported mixing knowledge gains? 50% of reported behavioral change, Long Term:
FINALLY! Step 2: Identifying the performance measure you will use to determine success
Components of a Performance Measure
Indicator- what is the change to be measured?
Unit of Measure- how is the indicator quantified? (# or %)
Baseline- starting reference point (# or %)
Target- desired performance (# or %)
Steps 3 and 4: Obtain Baseline and Set Target
Step 4: Ct’dOutput/Outcome Targets Should Be:-Reasonably Attainable-Based on research or pre-existing data-Agreed upon by program staff- Revisited or negotiated often-%’s instead of absolute #’s
Six Steps:
• Identify the desired outcome or accomplishment• Identify the performance measure you will use to determine success• Obtain baseline or trend information• Set a target• Gather• Report/Analyze (can be flipped)
Good Performance Measures
• Define success based on mission and mandates (true result, not just activities)
• Can tell the story of how a program effects the external environment
• Should be divided into short and medium (interim) measures and long-term
• Go beyond outputs. Social programs should measure social outcomes, health programs should measure health outcomes!
