Embed Size (px)
Citation preview
Sharing information to improve evaluation
How to navigate the maze of evaluation methods and
approaches
Simon Hearn & Ron Mackay
A BetterEvaluation Podcast
The Challenge: Overwhelming number and diversity of PME tools
Wikipedia page for Evaluation Methods
Steps Taken: Tools are just too many, focus on Log Frame and Outcome Mapping
Image: Michael Heilemann. http://www.flickr.com/photos/heilemann
Image: 8lettersuk. http://www.flickr.com/photos/8lettersuk/
Image: Lottery Monkey. http://www.flickr.com/photos/lotterymonkey/
Image: Simon Kneebone. http://simonkneebone.com/
Image: Susan Kistler. http://aea365.org
Image: Reven. http://www.flickr.com/photos/reven/
Image: russelldavies. http://www.flickr.com/photos/russelldavies//
Image: nickherber. http://www.flickr.com/photos/nickherber/
Simple organisational cycle
Plan
Act
Assess
CIPP Model
Inputs Process Product
Context
Image: meg_riordan. http://www.flickr.com/photos/meg_riordan/
Evaluation is the activity of systematically collecting, analyzing and reporting information so that it can be used by appropriate people to answer their questions so that they can make decisions about the future of a project or program.
• Who carries out the ‘activity’?
• Who or what is an evaluator?
• How does an activity become ‘systematic’?
• What activites and skills do ‘collecting, analysing and reporting’ involve?
• How do you go about ‘collecting, analysing and reporting’?
• Is that an exhaustive list of ‘the activity’ that is called ‘evaluation’
• What kind of ‘information’ is being referred to?
• What is the thing or things you collect information about?
• Who should be involved in an evaluation?
• Who are the ‘appropriate people’ who ‘use’ the ‘information’ supplied by an evaluation?
• And for what purposes can they ‘use’ this information?
• What kinds of questions can they ask?
Rainbow Framework
Over 200 methods/options
related to 35 tasks
in 7 clusters
Rainbow Framework
Over 200 methods/options
related to 35 tasks
in 7 clusters
BetterEvaluation.org
See IOCE.net for a list of national evaluation societies
Evaluation Competencies
1.Reflective Practice 2.Technical Practice 3.Situational Practice 4.Management Practice 5.Interpersonal Practice
Competencies for Canadian Evaluation Practice, Canadian Evaluation Society
Evaluation Standards
1.Utility Standard2.Feasibility Standards 3.Propriety Standards 4.Accuracy Standards 5.Evaluation Accountability
Standards
The Program Evaluation Standards developed by the JCSEE
How to navigate the maze of evaluation methods and
approaches
Simon Hearn & Ron Mackay
A BetterEvaluation Podcast
