17
Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal Evaluator Centre for Education Statistics and Evaluation Department of Education

Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

Embed Size (px)

Citation preview

Page 1: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

Better commissioning for better evaluations

Dr Carmen Huckel-Schneider

Principal Analyst

Knowledge Exchange Division

Sax Institute

Duncan Rintoul

Principal Evaluator

Centre for Education Statistics and Evaluation

Department of Education

Page 2: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Commissioning in the evaluation lifecycle

A simplified

Page 3: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

Commissioning in the evaluation lifecycle

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Page 4: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

Commissioning in the evaluation lifecycle

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Page 5: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

Commissioning in the evaluation lifecycle

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Page 6: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

useimplementation/management

furtherplanning

initialplanning

procurement/engagement

Commissioning in the evaluation lifecycle

Page 7: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

scenario1You need to be able to explain your program to an outsider

Better commissioning

for better evaluations

Page 8: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

scenario2You program needs to have clear and reasonable objectives

Better commissioningfor better evaluations

Page 9: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

scenario3

You need to be able to explain how your activities are supposed to lead to your intended outcomes

Better commissioning

for better evaluations

Page 10: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

1. Know your program well

Logic modelling is a great tool for this

Better commissioning

for better evaluations

Page 11: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

scenario4Be open-minded about what the evaluation may discover

Better commissioning

for better evaluations

Page 12: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

scenario5Be open to methods and approaches that you are unfamiliar with

Better commissioning

for better evaluations

Page 13: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

6Anticipate use: Who is going to find the evaluation helpful, and for what purpose?

Better commissioning

for better evaluationsscenario

Page 14: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

1. Know your program well2. Commission for use

Better commissioning

for better evaluations

Page 15: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

1. Know your program well2. Commission for use3. Build evaluation in early

Better commissioning

for better evaluations

• baseline data• comparison• built-in data collection

Page 16: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

1. Know your program well2. Commission for use3. Build evaluation in early4. Prioritise in light of the trade-off

between cost, time and quality

Better commissioning

for better evaluations

Page 17: Better commissioning for better evaluations Dr Carmen Huckel-Schneider Principal Analyst Knowledge Exchange Division Sax Institute Duncan Rintoul Principal

Better commissioning for better evaluations

[email protected]

[email protected]

1. Know your program well2. Commission for use3. Build evaluation in early4. Prioritise