View
261
Download
5
Category
Tags:
Preview:
Citation preview
Logic ModelsHandout 1
Morehouse’s Logic Model [handout]
Handout 2
YRBS 2009 Key FindingsHandout 3
YRBS 2009 Key FindingsHandout 4
University of Wisconsin-Extension, Program Development and Evaluation
Social-economic-environmental improvements
Hierarchy of Effects
Source: Bennett and Rockwell, 1995, Targeting Outcomes of Programs
Reactions
Learning
Actions
Number and characteristics of people reached; frequency and intensity of contact
Degree of satisfaction with program; level of interest; feelings toward activities, educational methods
Changes in knowledge, attitudes, skills, aspirations
Changes in behaviors and practices
Participation
Handout 5
Pulling it Together
Theory Base
InputsResources available
to operate a program; personnel, fiscal and
other resources
Activities/StrategiesThings that
the program is doing. List
processes, tools, events and actions
Output:What is
delivered? services,
types, levels,
Output:Who is served?
Short-Term/
ImmediateOutcomes1-3 years; focuses on change in
knowledge, attitudes, and skills
Inter-mediate
Outcomes3-5 years;changes in behavior,
norms, and/or policies
Long-Term
Outcomes4-6 years;changes in organiza-tions and systems
Data sources to document accomplishment
Handout 6
University of Wisconsin-Extension, Program Development and Evaluation
Logic model and common types of evaluation
Needs/asset assessment: What are the characteristics, needs, priorities of target population?What are potential barriers/facilitators?What is most appropriate to do?
Process evaluation: How is program implemented? Are activities delivered as intended? Fidelity of implementation?Are participants being reached as intended? What are participant reactions?
Outcome evaluation: To what extent are desired changes occurring? Goals met?Who is benefiting/not benefiting? How? What seems to work? Not work?What are unintended outcomes?
Impact evaluation: To what extent can changes be attributed to the program? What are the net effects?What are final consequences? Is program worth resources it costs?
Handout 7
Typical Activity Indicators to Track
Activities Outcomes Measures
SAC Interventions Improved Grades GPA Student interview Parent Interview Report Card
Improved Attendance UA school and class
Reduced Disciplinary Infractions
ODRsPolicy Violations
Increased Coping Skills Student Survey Pre-Post
Increased Resiliency Student Survey Pre-Post
Increased Perceived Social Support
Student Survey Pre-Post
Decreased or delayed substance use
State Risk Survey
Handout 8
University of Wisconsin-Extension, Program Development and Evaluation
Staff
Money
Partners
Parents increase knowledge of child dev.
Parents better understand their own parenting style
Parents use effective parenting practices
Improved child-parent relationsResearch Facilitate
support groups
Parents gain skills in new ways to parent
Parents identify appropriate actions to take
To what extent is stress reduced?To what extent are relations improved?
To what extent did behaviorschange? For whom? Why? What else happened?
To what extent did knowledge and skills increase? For whom? Why? What else happened?
Who/how many attended/did not attend? Did they attend all sessions?Supports groups? Were they satisfied – why/why not?
How many sessions were held? How effectively?#, quality of support groups?
What amount of $ and time were invested?
Parents of 3-10 year- olds
Deliver series of 8 interactive sessions
EVALUATION QUESTIONS
# Staff$ used# partners
# Sessions held
Quality criteria
INDICATORS
#,% attended per session
Certificate of completion
#,% demonstrating increased knowledge/skills
Additional outcomes
#,% demonstrating changes in behavior
Types of changes
#,% demonstrating improvements
Types of improvements
Develop parent ed curriculum
Reduced stress
Parents gain confidence in their abilities
Strong families
Parent Education Example: Evaluation Questions, Indicators Handout 9
Logic Model Resources
Document DeveloperBibliography: Logic Models in Program Evaluationhttp://www.cdc.gov/eval/logic%20model%20bibliography.PDF
CDC Evaluation Working Group
Everything You Wanted to Know About Logic Models But Were Afraid to Askhttp://www.insites.org/documents/logmod.pdf
Connie C. Schmitz and Beverly A. Parsons
Learning from Logic Models: An example of a Family-School Partnership Programhttp://www.gse.harvard.edu/hfrp/projects/afterschool/resources/learning_logic_models.html
Harvard Family Research Project
Making Logic Models More Systemic: An Activityhttp://www.insites.org/documents/lmact.pdf
Beverly A. Parsons
Source: CDC Evaluation Working Group
Handout 10
More Resources
Document Developer
Logic Model Development Guide http://www.wkkf.org/pubs/tools/evaluation/pub3669.pdf
W.K. Kellogg Foundation
Some Practical Tools for Planning and Evaluation http://www.innonet.org/index.php?section_id=64&content_id=185InnoNet
Innonet
Successfully Enhancing Program Performance Through Logic Models http://www.uwex.edu/ces/lmcourse/
Logic Model Toolshttp://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
Univ. of Wisconsin Cooperative Extension
Source: CDC Evaluation Working Group
Handout 11
Recommended