Monitoring and Evaluation Final (Backup)

8/7/2019 Monitoring and Evaluation Final (Backup)

http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 1/36

Dr. Ritu AgrawalMedical Consultant,NIHFW, New Delhi



` Regular observation (Systematic & Purposeful)

` Recording of activities on all aspects of the

programme (Data Collection)

` Measurement of progress towards programmeobjective

` Feedback to the donors, implementers and

beneficiaries

` Reporting of gathered information to be used indecision making for improving the project



3

PLANNING CYCLE

Assessmentof health need

Establish

goals&objectives

Assessment

of resources

Establishment

of prioritiesDesign

alternative

programme

Select the

best

alternative

Action

plan

Time

frame

Implementation

of programme

Monitoring

Evaluation GOALS&OBJECTIVES

No

Yes



GOALS_

` Describes the hoped for result of a programme

` Are achieved over a long period of time` Through the combined efforts of multiple programme

OBJECTIVES-

` Specific results to be achieved

`

Time bound` Details the desired results/accomplishments of the

programme



` S- SPECIFIC

` M-MEASURABLE

` A-ATTAINABLE

` R-RELEVANT` T-TIME



� Important for project planning &implementation

� Analyzing the situation in the community

� Determining whether the inputs are well utilized

� Identifying problems in the project

� Ensuring all activities are carried out properly by theright people and in time

� Using lessons from previous project

� Determining whether the way project was planned is

the most appropriate way of solving the problem athand



` Preparation of action plan

` The plan should specify what needs to be done, who is

going to do it, and when it is to be done

` Inadequacy in planning will result in inadequacy in

monitoring

` The plan should identify key result areas and define

how they will be measured

` The plan should specify prioritize activities, so that

they receive adequate emphasis during monitoring

` The plan should cater to local variations

7



` Detecting deviations from plans

` Diagnosing causes for deviations

` Taking corrective action

8



` INPUT-Resources going into conducting and carrying out the

project. Staff, finance , materials and time

` PROCESS-Set of Activities in which programme resources

(human and financial) are used to achieve the result (NO. of

workshops or training session )

` OUTPUTS-Immediate results obtained by the programme

through the execution of activities (no. of staff trained)



` Measuring how much, how many, quantity

` Tends to document number associated with programme

` Focuses on which and how often programme elements

are carried out

` Tends to involve record keeping and numerical counts

` Monitoring and its associated activities should be

integrated into the project timeline



` How well the programmes are carried out

` EX. Changes in people attitude towards the

programme, behaviour change , how information

permeates the at-risk society` Works also as a Feedback System

` METHODS-

` Open ended methods to investigate



` Provides a means to assess the quality of the

project and programme implementation

`

Compliments quantitative, input-outputprogress monitoring

` Is a tool for institute learning and taking

corrective action in innovative and adaptive

projects





� Benchmark calendar

� List of planned key activities arranged by dates

� Activity Based Budget Estimates of inputs required to

undertake benchmarked activities� Comparison chart

� Compares plans and budgets against occurrence and

spending

�

Deliverable schedule� Indicates what is due for a project to offer within a set

time



It is a systematic way of learning from experienceand using the lessons learnt to improve current

activities and promote better planning by carefulselection of alternatives for future action

15



` To review the implementation of and services provided by health programmes

so as to identify problems and recommend necessary revisions of the

programme

` To assess progress towards desired health status at national or state levels

and identify reasons for gap, if any

` To contribute towards better health planning

` To document results achieved by a project funded by donor agencies

` To know whether desired health outcomes are being achieved and identify

remedial measures

` To improve health programmes and the health infrastructure

` Allocation of resources in current and future programme

` To render health activities more relevant, more efficient and more effective

16



` Review of Records` Monitoring`

Case studies` Qualitative studies` Controlled experiments and intervention studies` Sample surveys

17



` Evaluation of structure

` Evaluation of Process

` Evaluation of Outcome

18



The process of evaluation consists of the followingcomponents:

1. Specify the particular subjects2. Information support

3. Verify relevance

4. Assess adequacy

5. Review progress

6. Assess efficiency

7. Assess effectiveness

8. And assess impact

19



` It determines Programmeefficiency

` It establishes standard of performance at the activitylevel

` It forms a basis for Programme accountability

` It alerts the managementof discrepancy

` It identifies strong &weakpoints of programmeoperations

` It determines Programme

effectiveness

` It identifies inconsistencies

between the programme

objectives and activities

` It alerts the management of

discrepancies between actual

and anticipated levels of

programme impact

` It suggests changes in

programme procedures,operation and objectives

` It identifies the possible side

effects of the programme

20

Monitoring Evaluation



Types of Monitoring and Evaluation:

Formative Assessments

and Research (concept and

design)

Monitoring (monitoring

inputs, processes, and

outputs;

Evaluation (assessing

outcome Impact)

Cost-Effectiveness

Analysis (including

sustainability issue

Questions Answered by the Different Types of Monitoring and Evaluation:

�Is an intervention

needed?

�Who needs theintervention?

�How should the

intervention be

carried out?

�To what extent are

planned activities

actually realized?

� How well are the

services provided?

�What outcomes are

observed?

�What do the

outcomes mean?

� Does the program

make a difference?

�Should program

priorities be

changed or

expanded?

�To what extent

should resources be

reallocated?



` Monitoring involves counting what we are doing.

` Monitoring involves routinely looking at the

quality of our services.

` Evaluation requires study design.` Evaluation sometimes requires a control or

comparison group.

` Evaluation involves measurements over time.

` Evaluation involves special studies.



23

INDICATORS

` OPERATIONAL

` RELIABLE

` VALID` SPECIFIC

` SENSITIVE

` AFFORDABLE

` FEASIBLE



` To describe information to be measured

` Monitoring is EXPENSIVE & TIME CONSUMNG

` For Reporting and Analysis in Simplest form

` To generate important information` For management decision making

` Words like improved ,increased , gained do not

belong to an indicator



� Information unit of measurement documentation of

change

� Evidence of how much has been or has not been

achieved1. Qualitative (Narrative/Observation)

2. Quantitative (Number/%)

� Anything you can think to measure



` To highlight problems

` Act as early warning signs

` Tells where support corrective actions required

` Evaluate effectiveness of management actions` To determine achievements



27

Quality Indicator in RCH Project

�% Pregnancy Registered before 12 weeks

�% ANC with 5 visits

�% ANC receiving all RCH services

�% High risk cases referred

�% High risk cases followed up

�% deliveries by ANM/TBA�%PNC with 3 PNC visits

�% PNC receiving all counseling

�% PNC complications referred

�% Eligible couple offered FP choices

�% women screened for RTI/STDs

�% Eligible couple counseled for prevention of RTI/STDs

�% ADD given ORS

�% ARI treated

�% children fully immunized



` Monitoring & Evaluation are necessary to

ensure efficiency and effective uses of measure` Efficiency is usually measured by the ratio of

activity to input

` Effectiveness is measured by the ratio of output

to activities

28



` � Show how goals/objectives are related to results

` � Describe how objectives will be achieved/measured

` � Identify data needs

` � Define how the data will be collected and analyzed

` � Describe how results will be used` � Anticipate resources needed for M&E

` � Show stakeholders how program will be accountable

` The content and organization of an M&E work plan areflexible. They should be appropriate for the

` level (e.g., country, region, district, community, or organization) and the program areas.



` Monitoring involves counting what we are doing.

` Monitoring involves routinely looking at the quality of our

services

` Evaluation requires study design

` Evaluation sometimes requires a control or comparison

group.

` Evaluation involves measurements over time.

` Evaluation involves special studies.



31

The 5 year RCH phase II is being launched inTamilNadu on 2005 with a vision to bring aboutoutcomes as envisioned in the MillenniumDevelopment Goals, the National Population Policy2000 (NPP 2000), the Tenth Plan, the National Health

Policy 2002 and Vision 2020 India, minimizing theregional variations in the areas of RCH and populationstabilization through an integrated, focused,participatory programme meeting the unmet needs of the target population, and provision of assured,equitable, responsive quality services.



32

IndicatorTenth Plan

Goals (2002-2007)

RCH II Goals(2005-2010)

NationalPopulation

Policy2000 (by

2010)

MillenniumDevelopmentGoals (B

y 2015)

PopulationGrowth

16.2% (2001-2011)

16.2%(2001-2011)

- -

InfantMortality Rate

45/1000 35/1000 30/1000 -

Under 5Mortality Rate - - - Reduce by2/3rds from1990 levels

MaternalMortality Ratio

200/100,000 150/100,000 100/100,000

Reduce by3/4th from1990 levels

Total FertilityRate

2.3 2.2 2.1 -

CoupleProtection Rate

65% 65% Meet100%needs

-



33

THE ACTION PLAN FOR CARRYING OUT R.C.H SERVICES

Goal: ³Health For All´

Objective: Population stabilization by 2045

Target : Total fertility rate to the replacement

level by 2010 and to achieve the otherindicators of health for all

Programme: Comprehensive R.C.H services

Plan : High quality, integrated, decentralized,

needs based and holistic approach

Monitoring & Evaluation: R.C.H indicators/Feedback data



Monitoring and evaluation are essential management

tools which help to ensure that health activities areimplemented as planned and to assess whether desiredresults are being achieved.

` Monitoring:1. To provide concurrent feedback on the progress of activities2.To identify the problems in their implementation3.To take corrective action

` Evaluation:To assess whether the desired results of a

programme have been achieved if not how it should beredesigned

34



` Identify all inputs to be provided

` Activities to be carried out

` Outputs desired for the programme

` Select the key inputs, activities, output variables formonitoring

` Identify the indicators for measuring the variables

` Prepare a plan for collecting and processing theinformation on the selected indicators

` Prepare a format for giving feedback on theseindicators to managers responsible forimplementation

35



Thank You

Documents

Monitoring and Evaluation Final (Backup)