Upload
laura-mulrine
View
173
Download
0
Embed Size (px)
Citation preview
THINGS TO KEEP IN MIND• This webinar will be recorded and available on
our website along with the presentation slides and other resources about the topic
• If you have trouble with the audio quality, please try calling in with a phone
• Please be sure to fill out the evaluation that will be sent to you following the webinar
Poll #1What you most interested in learning about today?
a) Logic modelsb) Indicatorsc) Outcome measures
GUEST PRESENTERSJessica NobleCentral Hub ManagerYouthREXYork University
Corliss BeanResearch and Evaluation SpecialistYouthREXYork University
Eugenia DuoduVisions of Science Network of Learning
Outline1. Logic Models• Template available
2. OutcomeEvaluation
3. Indicators
4. Measures & Toolkit
5. CES Example
Why Evaluate?
• Supports program and strategic planning
• Helps communicate your program goals and progress
• Serves as a basis for ongoing learning to make your program more effective
What is a Logic Model?“… a picture of how your program works –the theory and assumptions underlying the program. This model provides a road map of your program, highlighting how it is expected to work, what activities need to come before others, and how desired outcomes are achieved.”
- W.K. Kellogg Foundation Evaluation Handbook, 1998
Logic Models• Summarize the key elements of your program
• Explain the rationale behind program activities
• Describe the link between activities and outcomes
• Provide an opportunity for stakeholders to discuss the program and agree on its description and intended results
• Serve as a useful communication tool to describe your program to others
Quick Tips Before We Begin:
Tip #1- When beginning to create your logic model you may want to consider-
What stakeholders should I involve?
• Stakeholders might include program staff, program clients, funders,
community representatives, and volunteers
• Their perspectives can enrich your program logic model by clarifying
expectations for the program.
Tip #2- Logic models take time!
• It is important to gather the feedback of your programs key stakeholders
• Take time to create, review, and revise your logic model
Elements of Logic Models
Resources/
InputsActivities Participation Outcomes Impact
Outputs Intended Outcomes
Create, Review, Revise, Update!ü Does your organization have adequate resources to implement the
activities and achieve the desired outcomes?
ü Have you included all the major activities needed to implement your program and achieve expected outcomes?
ü Would the activities list enable someone who is unfamiliar with your program to understand its scope?
ü Have you expressed your outcomes in terms of change?
ü Have you identified who/what will experience that change, and over what time period?
ü Have you considered a variety of perspectives?
What is Outcome Evaluation?
• Helps assess a program’s effectiveness at achieving its intended outcomes
Next steps: Moving from outcomes to indicators to measurement
• How do I measure the outcomes in my logic model?
• How do I select appropriate indicators for my expected outcomes?
What is an indicator?• Observable and measurable
“milestones” of the intended outcome– What you see, hear, read, etc.,
that indicates whether you're making progress toward your outcome target
Outcomes
Measures
Indicators
Examples of IndicatorsOutcome Indicator MeasureEngagement in School
Increased schoolattendance
• Number of full days one has attended school for year/month
• Change in number of full days attended school over time
Increased homework completion
• Frequency of on-time homework completion
Improved Academic Performance
Increased test scores
• In-class test scores• Standardized test scores
Improved grades • Test grades• Report card
Get SMART• Quantitative indicators should be SMART:–Specific
–Measurable
–Attainable
–Relevant
–Timely
Qualitative Model
SPICED–Subjective–Participatory– Interpreted and Communicable–Cross-checked and Compared–Empowered–Diverse and Disaggregated
YouthREX Inventory of Measures• Developed based on the Stepping Up 7 themes and 20
outcomes to foster well-being in youth
• WWW.YOUTHREX.COM/MEASURES
Lessons LearnedMeasure selection
o Program Involvemento Ongoing collaboration with frontline staffo Relevant to youth
Transparencyo Accountable to youth
Critical of your own organizationo How do you know your program is working?
Ongoing reflectiono Program Improvement based on youth voice