Upload
ophelia-hines
View
212
Download
0
Embed Size (px)
Citation preview
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d
Managing for Development Results
Results-Oriented Monitoring and Evaluation
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d Managing for Development Results
Results-based monitoring takes in the whole
results chain, from inputs, via activities and outputs through to the outcomes and impacts.
The distinctive feature is that this kind of monitoring focuses not only on what has been done, but attempts to identify the changes generated by what has been done.
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
dFor impact monitoring, one has to clearly
differentiate the three levels of the LogFrames:
• What are the goods and services to be provided by your programme/ component? (This is to be found in the activities and output statements)
• How are your immediate target groups expected to make use of these goods and services, to apply or utilise them (utilisation)? Statements of this logical level represent the first level of impacts, usually labelled Immediate Objectives, Purpose, or Outcomes.
• Which kind of benefits can be directly attributed to the utilisation of the programme/component services by the immediate target groups? This is impact level 2, usually labelled Development Objective.
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
dPast
Programm/
ProjectInitiati
onPlannin
gProgramme/ Project Implement
ationPrimary Role of Monitoring and/ or EvaluationIn the Cycle
Evaluation:Providing lessons learned: successes and failure of the past
Monitoring:Assessing progress of programme/ project in achieving its objectives
Obtaining early indications of potential problems and/or success as a basis for decision- making
Mid-term or Terminal Evaluation
Providing a basis for decision-making and identifying initial lessons learned
Completion and Follow
up
Construction of baseline dateClarify of objectivesAgreement on results, indicators and performance targetsAllocation of budget and responsibilities for monitoring and evaluation
Ex-post Evaluation:Measuring and assessing actual impact
Identify lessons learned for dissemination as best practices
Prerequisite of Effective Monitoring and Evaluation
FutureProgramme / Project
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d M&E and Program Initiation
• Pre-Formulation: Searching for Lessons Learned
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
dProject Planning: Preparing and Monitoring and Evaluation Plan
Monitoring and Evaluation Planning Framework
• Construct baseline date on problems to be addressed.• Clarify programme or project objectives and set specific
targets.• Establish stakeholders’ consensus on indicators.• Define date collection process requirements and usage.• Agree on the generation and utilization of information.• Specify reporting requirement (format, frequency,
distribution).• Establish monitoring and evaluation schedule.• Assign monitoring and evaluation responsibilities.• Provide adequate budget for monitoring and evaluation.
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
dProject Implementation: M & E as
Support to Decision-Making and Learning
• Monitoring:
• Assessing progress of programme/ project in achieving its objectives
• Obtaining early indications of potential problems and/or success as a basis for decision- making
• Mid-term or Terminal Evaluation
• Providing a basis for decision-making and identifying initial lessons learned
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
dProject Completion: Dissemination
of Lessons Learned
• Ex-post Evaluation:
• Measuring and assessing actual impact
• Identify lessons learned for dissemination as best practices
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d
RelevancePerformance
SUCCESS
Substantive Focus
Program Quality
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d Key criteria
• relevance – the degree to which the objectives of a programme remain valid and significant;
• performance – progress of a programme towards achieving its objectives, in terms of effectiveness, efficiency and timeliness;
• success – attaining a measurable level of benefits that can be directly attributed to the programme, in terms of impact, sustainability and capacity development.
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d M&E Standard Criteria
• Relevance Development Issues Target Groups Direct Beneficiaries
• Performance Effectiveness Efficiency Timeliness of inputs and results
• Success Impact Sustainability Contribution to Capacity Development
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d SELECTION OF INDICATORS
• What are the objectives of the programme or project?
• Who are the target groups and what are their needs and expectations?
• What changes are anticipated as a result of the programme or project?
• To what extent and how efficiently is the programme or project achieving its objectives?
• What are the criteria for judging the success of the programme or project?
Pro
ject
Man
age
me
nt
Le
arn
ing
Pro
gra
m23
Mar
– 3
Ap
rl 2
009,
Mek
on
g In
stit
ute
, Kh
on
Kae
n, T
hai
lan
d SMART Indicators
• Specific
• Measurable
• Attainable
• Relevant
• Trackable
• A good balance should be achieved between theory and practice, i.e., between what should be and what can be measured
Indicators are "yardsticks" that can be used to demonstrate that changes have (or have not) taken place. They provide meaningful and comparable information on changes.