Basic Impact Evaluation Basic Impact Evaluation CourseCourse

Poverty Analysis Initiative (C102)Poverty Analysis Initiative (C102)

World Bank InstituteWorld Bank InstituteAttacking Poverty ProgramAttacking Poverty Program

23-04-21 2

ContentContentModule 1: Introduction

Module 2: Monitoring and Evaluation Definitions

Module 3: Monitoring and Evaluation: Tools to Measure Progress

Module 4: Evaluation: General Characteristics

Module 5: Questions and Criteria for Evaluations

Module 6: Evaluation Methods and Techniques

Module 7: Evaluation: Quality and Standards

Module 8: Stages in the Evaluation Process

Module 9: Contribution of Program Evaluation to Poverty Reduction

Module 10: Available Resources

Module 11: Developing a Training Workshop for Evaluators

Module 12: Evaluation of the Workshop

Module 1 - IntroductionModule 1 - Introduction

23-04-21 4

Overview of the ModuleOverview of the Module

• Opening remarks/introduction• Introductions/expectations• Individual test/questionnaire• Workshop objectives• Program and case studies• Nature and values of the workshop• Practical considerations

Opening Opening Remarks/IntroductionRemarks/Introduction

23-04-21 6

Introduction of ParticipantsIntroduction of Participants

• First name and surname

• Organization

• Function / profession

• Project, program and evaluation

experience

• Topics of interest in the workshop

23-04-21 7

Individual Test/QuestionnaireIndividual Test/Questionnaire

• This questionnaire is designed for your personal use. The questionnaires will not be collected.

• Fill out the questionnaire. (5 min)• Keep it. It will give you a more

concrete sense of your progress at the end of the workshop.

23-04-21 8

Purpose of the WorkshopPurpose of the Workshop

• To contribute to the improvement of public programs’ efficiency, more specifically poverty reduction programs

23-04-21 9

Overall ObjectiveOverall Objective

• To prepare national partners for the design and implementation of quality evaluations in their countries and for the transfer of program evaluation principles and techniques

23-04-21 10

Operational Objectives• At the end of this workshop, participants:

– Will have been made aware of the value of evaluations as well as of the contribution to development of current evaluation practices

– Will know general program evaluation principles, the range of evaluation methods and techniques, as well as the process that must be followed and the conditions that must be met to ensure the quality of the results that are obtained

– Will know the aspects that are specific to the evaluation of the impacts of poverty reduction programs

– Will have practiced, individually and in groups, on specific cases, some aspects of program evaluation

– Will know where to find methodological resources and information on evaluation

– Will have thought about the role their institution can play in the transfer of evaluation practices, by providing training in particular

23-04-21 11

From Objectives to Modules

Make participants more aware of the value

of evaluation

and familiarize them with how it is

being transferred

Make participants understand: Overall principles, methods

and techniques, processes,

determinants of quality, and specifics of evaluation in the context of poverty

reduction(provide opportunities for practice on specific

examples)

Indicate where to

find additional resources

in evaluation (methods,

case studies, general

information)

Reflect together on the

role each institution can play

To prepare national partners for the design and implementation of quality evaluations in their countries and

for the transfer of program evaluation principles and techniques

23-04-21 12

Nature of the WorkshopNature of the Workshop

• Adult training– An adult learns when he / she talks, acts

and becomes involved• We remember approximately:

– 10% of what we read– 20% of what we hear– 30% of what we see– 50% of what we see and hear– 80% of what we say– 90% of what we put into practice*

23-04-21 13

Nature of the WorkshopNature of the Workshop• Adult training

– Refers to his/her experiences, shares them, takes a step back, thinks, achieves a deeper understanding and broadens his / her knowledge

Workshopactivities

1 – First-hand experience

3 - Generalization ofthe experience

4 - Application

Adult learning cycle

2 - Reflection onthe experience

• Sharing of experiences• Methodological presentations• Group discussions and reflection• Practical Exercises

23-04-21 14

General FormatGeneral Format

• General notions• Practical exercises on the concepts that need to

be understood (short exercises in plenary sessions)

• Small group exercises on the use of several concepts

• Group study, with as much open discussion as possible, of a " poverty " case study

• Creative thinking (what role for my institution)• Practical group exercise on design

50% methodological presentations

50% reflection, sharing of ideas and group exercises

23-04-21 15

AgendaAgendaMonday Tuesday Wednesday Thursday Friday

9:00

9:30

10:00 Reflection in 2 sub-groups: What role for

your institution?10:30 Quality of an evaluation Report

11:00

11:30

12:00

12:30

1:00

1:30

2:00 Reflection in 3 sub-groups:

2:30 1.    Evaluation needs in your country?

3:00 2.    Is there a demand?

3:30

4:00

4:30

5:00

5:30

Welcome, Presentation, Agenda

Definitions (evaluation and monitoring)

Specific aspects of the evaluation of the

contribution of projects or programs to poverty reduction: introductory debate and in-depth

exploration

Workshop evaluation, conclusions and closing

remarks

Report and conclusions: Evaluation’s dynamics

Practical exercise in 3 sub-groups and report

Report on exercise in plenary session

Lunch Break Lunch Break

Evaluation methods and techniques

(presentation with examples and discussion)

Exercise in sub-groups: Design of an evaluation for a specific program Presentation of the

evaluation of a poverty-reduction program’s contribution Exercise in 3 sub-groups and report. Comparison with real case

Reflection in 2 sub-groups: Design of a

training workshop for evaluators*

Evaluation: An instrument of progress

The process

Lunch Break Lunch Break Lunch Break

Broad characteristics of evaluation (presentation

and discussion)

Methods and techniques: Conclusions

Available resources on evaluation

Questions and criteria (presentation with

examples & discussion)

Determinants of quality: Review

Monday Tuesday Wednesday Thursday Friday

9:00

9:30

10:00 Reflection in 2 sub-groups: What role for

your institution?10:30 Quality of an evaluation Report

11:00

11:30

12:00

12:30

1:00

1:30

2:00 Reflection in 3 sub-groups:

2:30 1.    Evaluation needs in your country?

3:00 2.    Is there a demand?

3:30

4:00

4:30

5:00

5:30

Welcome, Presentation, Agenda

Definitions (evaluation and monitoring)

Specific aspects of the evaluation of the

contribution of projects or programs to poverty reduction: introductory debate and in-depth

exploration

Workshop evaluation, conclusions and closing

remarks

Report and conclusions: Evaluation’s dynamics

Practical exercise in 3 sub-groups and report

Report on exercise in plenary session

Lunch Break Lunch Break

Evaluation methods and techniques

(presentation with examples and discussion)

Exercise in sub-groups: Design of an evaluation for a specific program Presentation of the

evaluation of a poverty-reduction program’s contribution Exercise in 3 sub-groups and report. Comparison with real case

Reflection in 2 sub-groups: Design of a

training workshop for evaluators*

Evaluation: An instrument of progress

The process

Lunch Break Lunch Break Lunch Break

Broad characteristics of evaluation (presentation

and discussion)

Methods and techniques: Conclusions

Available resources on evaluation

Questions and criteria (presentation with

examples & discussion)

Determinants of quality: Review

23-04-21 16

Values to be Shared During the Workshop• Simplicity – we no longer have

responsibilities or wear a specific hat• What is discussed here will remain among

us. The content of our discussions will not be reported. Everyone can express his/her views freely

• Openness, critical thinking, tolerance• Everyone must participate actively in order

to be both an actor and a beneficiary over these few days spent working together

• Focus on participants’ concrete concerns and experiences, remain down to earth

23-04-21 17

Practical ConsiderationsPractical Considerations

• Schedules• Rooms• Breaks• Lunches• Format• Questions?