3rd Results- Based M&E Workshop

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1

3rd Results- Based M&E Workshop

3rd APCoP-MfDR Results-Based M&E Workshop

Session 1 Finalizing the M&E Capacity Gaps on the Four Attributes covered

during the 2nd WorkshopBallroom 1

Intercontinental Hotel Phnom Penh, Cambodia

28-30 June 2011

04/24/23 Institutionalizing M&E System in Cambodia 1

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 104/24/23 Institutionalizing M&E System in Cambodia 2


Summary of 2Summary of 2ndnd M&E Workshop M&E Workshop Objectives: Institutionalizing M&E System Objectives: Institutionalizing M&E System

To determine the gaps To determine the gaps in institutionalizing in institutionalizing M&E System M&E System

To assess the level of To assess the level of understanding of MfDR understanding of MfDR and M&Eand M&E

Harmonized Capacity Building Strategies Harmonized Capacity Building Strategies for Institutionalized M&E System for Institutionalized M&E System

MfDR and M&E: Relational Function Institutionalizing M&E System in Country Settings Briefers on Core Attributes of M&E System

Break Out Break Out SessionsSessions

Plenary Plenary Sessions Sessions

Shared Knowledge-Resources Shared Knowledge-Resources In RDMs In RDMs

RDM PanelRDM PanelPresentationsPresentations

To identify Capacity Building To identify Capacity Building Strategies in institutionalizing Strategies in institutionalizing M&E SystemM&E System

Identified capacity gaps in delivering M&E functions

Capacity Development Needs M&E System by RDMs

Opening Session: In

troduction


2nd Results- Based M&E Workshop


Monitoring

Reports progress to managers and alerts them to problems

Routinely collects data on these indicators, compares actual results with targets

Translates objectives into performance indicators and set targets

Links activities and their resources to objectives

Clarifies programme objectives

Provides lessons, highlights significant accomplishment or program potential, and offers recommendations for improvement

Explores unintended results

Examines implementation process

Assesses specific causal contributions of activities to results

Analyses why intended results were or were not achieved

Evaluation

Complementary Roles of Results-Based Monitoring and Evaluation


2nd Results- Based M&E Workshop


Monitoring

Analysis and reporting specified

Data Management Systems specified (Data encoding, programming, processing and reporting)

Institutional responsibilities defined

Indicators from planning

Stakeholders engagement

Results dessiminated or shared

Institutional responsibilities defined

Methodology formulated or designed

Evaluation

With reference to APCOP MfDR Framework Attributes of Results-Based Monitoring and Evaluation


Level of Results

66MfDR in Rural Development Workshop MfDR in Rural Development Workshop

6/7 December 20106/7 December 2010


A paper or computer-based tracking mechanism which is indicator-driven, outcome-led and impact-based derived from developed results of any specified intervention strategy, capturing changes contributing to the effectiveness and efficiency of any program development initiatives and setting.

M&E System Defined


2. Indicators

Or Perfo

rmance

Measures

1. Project Goals, Purposes, Objectives, and Specific Objectives

3. Results-Based Management Logframe

8. Information

Sharing and

Exchange or

Feedback Mechanism

Results

4. Development of tools

and forms

5. Data Management : Data Collection, Encoding and Programming Information Processing and Analysis

7. Interim Evaluation:Formative or Summative

6.Insti

tutional

Arrangem

ent

M&E System and Capacity Building Framework

M&E System

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1904/24/23 Institutionalizing M&E System in Cambodia

Key Results

Capacity development gaps identified

IndicatorsTools and FormsDatabase ManagementInstitutional Responsibilities

Identified the Capacity Gaps by RDMs

Across RDMs, Database Management needs a comprehensive capacity plan

Covered Four Core Attributes in M&E

Participants (27): MAFF, MRD, MOWRAM, MOP and ADB

Refine the Capacity Development Actions

Discussion on the capacity development actions for each gap identified

Summary of the 2nd Workshop

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1AP-CoP MfDR

Participants’ Feedback

•The capacity gaps in delivering M&E system were identified

•The attributes of M&E to the results-based public sector management framework were linked.

•The conduct of the workshop was effective, timely and relevant to the need of the ministries.

•The sessions facilitated their learning in appreciating MfDR, Results-Based Public Sector Management (RBPSM) and M&E

•The changes of their management in the respective ministries should be encouraged towards adopting the use of M&E system specifically on tools and forms, among others;

•The discussions on M&E and Results-based PSM should continue and the participants see themselves as part of the country based networks or CoPs.

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1AP-CoP MfDR

Comments: 2nd M&E Workshop

Current M&E staffs either delegated or appointed are “trainable” individuals whose current skills could be “up-scaled” if and when appropriate M&E learning packages were to be designed;

Interfaces on the functionality of the M&E system via institutional arrangement has to be integrated within the line ministries, national agencies and partners by adopting a common mechanism across RDMs;

Despite an approved sub-decree creating Monitoring and Evaluation System, as a function within the Ministry of Planning and with the RDMs has not been established

A Monitoring and Evaluation System have not been established. However, some components of the M&E system which have been existing were not linked to each other’s functionality and in some ways disjointed;


Welcome to the 3rd APCOP-MfDR Results-Based M&E

Workshop for Rural Development Ministries in Cambodia

Session 3 : Identifying Capacity Development Gaps and Actions for

Institutional Logframe

04/24/23 12Institutionalizing M&E System in Cambodia

Results-Oriented M&E Workshop

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 104/24/23 13Institutionalizing M&E System in Cambodia


Elements M&E Core Attribute 5: Determining Capacity Gaps in developing Institutional Logframe

Yes/No

If YES, Specific Capacity

Gap

Specific Action(s) Remarks

1Program or Project goals are clearly stated

No ASDP, BSP

2Linkage between activities, results, purpose and objectives of the program, project, or policy in a hierarchy indicated

No Some line Departments not link to ASDP

3Performance indicators of projects or programs identified

No Report not reflect to the Annual plan

4Sources of information for the indicators identified

No Information by report

5Assumptions for the performance indicator agreed

No Need to update

6Risks of achieving the performance indicator documented

No Not align

7 The 4 x 4 (Four by Four) Matrix showing the methodical manner and causal logic developed

No Need correction

8 Project or program operational plans assisted with reference to the logframe developed

No Need Update

Note(s):




Session 5 : Identifying Capacity Development Gaps and Actions for Data Quality Assessment, Analysis

and Reporting





Elements M&E Corel Attribute 6: Determining capacity gaps in completing Data Quality Assessment, Analysis and Reporting

Yes/ No

If YES, Specific

Capacity Gap

Specific Action(s)

Remarks

1 Critical indicators identified No Reporting2 Procedures to assess critical indicators

followedNo M&E Report

3 Variables for the indicator(s) encoded and processed

No Completed form M

4 Variables validated No5 Sampling or selection strategy

identified No

6 Quantitative and or qualitative analysis designs utilized

No Annual Report

7 Linking quantitative and qualitative data No Report8 Statistical measures in quantitative

data used No

9 Deductive or inductive method of analysis in qualitative data used

No

10 Format of reporting of results agreed No11 Schedules of reporting specified No12 Reports published or shared No13 Implementing partner(s) or agencies

informedNo

14 Specific visit(s) or mission(s) scheduled NoNote(s):




Session 7 : Identifying Capacity Development Gaps and Actions for Evaluation Designs, Methodology

and Approaches





Elements M&E Corel Attribute 7: Identifying capacity development gaps in Evaluation Designs, Methodology and Approaches

Yes/ No

If YES, Specific

Capacity Gap

Specific Action(s) Remarks

1 Evaluation designs or models determined

2 Evaluation methodologies specified

3 Evaluation plan matrix agreed

4 Parameters or measures established

5 Sampling methodologies identified

6 Baseline data collected

7 Critical data used for evaluation quality-assessed

8 Data analysis addressed

9 Results level subject to evaluation clarified

10 Changes in interventions documented

11 Indicators for evaluation exercise addressed

12 Statistical models for evaluation formulated

13 Evaluation conduct specified (sub-contract, external, joint, etc)

14 Effectiveness, efficiency and relevance directly responded

15 Presenting evaluation results planned

16 Evaluation results reported and shared

17 Ethical concerns (standards, guidelines, etc. ) addressed




Session 8 : Identifying Capacity Development Gaps and Actions for

Feedback Mechanism





Elements M&E Corel Attribute 8: Feedback mechanism

Yes/ No

If YES, Specific Capacity

Gap

Specific Action(s)

Remarks

1 Feedback questionnaires for key stakeholders developed

2 Evaluation results supported3 Evaluation results as tool for

decision making used

4 Assumptions and risks to project implementation reviewed

5 Key stakeholders’ opinions shared

6 Exchange of opinions documented

7 Feedback from stakeholders available in customized e-portals or other forms of information sharing mechanism

8 Response(s) on effectiveness and efficiency of projects/program recorded.

Note(s):

Documents

3rd Results- Based M&E Workshop