M&E PresentationStrengthening the Dairy Value Chain Project

CARE Bangladesh

5th September 2012

Presented By

Toufique AhmedApurba Kumar Datta

PartnershipIFPRI Schulich School of Business Individual Researcher

SDVC M&E System

Project Management(MIS Support)

Project Monitoring• TPF- Monthly• LPF- Monthly• CPF-

Quarterly• GPF- Semi-

Annually• PPT- Semi-

Annually• Case-Study- Need

Base

Inputs, Progress, output and

Outcome Indicators

Data Sources

(For all Indicators)

Project M&E Unit

(Analyzed By)

Outcome and Impact Indicators

Evaluation• Baseline

Survey• Mid-Term

Evaluation• End line

Evaluation

Information

Product

Donor Report(Progress update)

SDVC Information Flow

Technical Coordinator-M&E

Technical Coordinator-M&E

Technical Officer-M&ETechnical Officer-M&EM&E Support OfficerM&E Support Officer

Project OfficersProject Officers

Field FacilitatorsField Facilitators

Project participantsProject participants

CARE-BCARE-B SDVC Staffs & Mgt.

SDVC Staffs & Mgt.

DONORDONORCARE-USACARE-USA Other International AudiencesOther International Audiences

Team level

Field level

Region & National level

International level

GOB/Private sectors/INGOGOB/Private sectors/INGO

Tools Used

Tools Respo. Coverage Freq.

Team Progress Assessment Format (TPF)

Project Participants

Teams’ activity progress and output

Monthly

Livestock Health Workers Progress Assessment (LPF)

Livestock Health Worker (LHW)

Service, Income, expenditure, linkages

Monthly

Collectors’ Progress Assessment (CPF)

Collector Collection, service area, Income

Quarterly

Cont…

Tools UsedTools Respo. Coverage Freq.

Participatory Performance Tracking (PPT)

Producer Group members

Individual practice tracking and groups’ maturity scoring

Semi-annually

Group Members’ Progress Assessment (GPF)

Producer Group members

Production, consumption & sales, Income

Farm mgt. technical Knowledge & Practice

Input Service used Client satisfaction- LHW, collector Women access and control over

resources Unintended success

Semi-annually

Case Study Producer, LHW, Collector, Farmer Leader, others

Success and failure of System , progress.

Need based

Videos, Photos Successful and challenging actors

Success and failure of System , progress.

Need based

How do we support to integrate

6

Collecting information through-·M&E formats, Other formats

·Success case, learning & Challenges (Qualitative Information)

Team level Documenting & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)·Other formats (Price, Training, Etc.)

As per M&E & Other schedule

TASKSTASKS FREQUENCYFREQUENCY

Regional mgt. team documentation & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)·Other formats (Price, Training, Etc.)

Regional all staff level documentation & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)

·Other formats (Price, Training, Etc.)

SDVC Key Mgt. level documentation & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)

·Other formats (Price, Training, Etc.)

Monthly

Quarterly

By-monthly

Six-monthly

[

CARE-Bangladesh

·

UBORA – PQAT

·

30-minutes or other informal way of reflection

Six-monthly

PartnershipIFPRI Schulich School of Business Individual Researcher

SDVC M&E System

Project Management(MIS Support)

Project Monitoring• GPF- Semi-

Annually• TPF- Monthly• LPF- Monthly• CPF-

Quarterly• PPT- Semi-

Annually• Case-Study- Need

Base

Outcome and Impact Indicators

Inputs, Progress, output and

Outcome Indicators

Data Sources

(For all Indicators)

Project M&E Unit

(Analyzed By)

Evaluation• Baseline

Survey• Mid-Term

Evaluation• End line

Evaluation

Information

Product

Donor Report(Progress update)

SDVC M&E Partnership

Partnership help us to learn different new things and bring our learning into working strategy.

Schulich School of Business, York

University

ILRI-IFPRI University of Michigan Business

Georgia Tech University

Analyze SDVC findings and Showcasing the success stories and learning globally through a win-win partnership with SCHULICH PhD scholar and faculty.

Gender Agriculture and Asset project (GAAP). To enhance control over resource and access to resource by women and measuring the contribution factor in achieving the target.

Worked for developing Business plan for Krishi Utsho. 4 MBA student came here and did the rigorous things for SDVC.

Develop and implement EMS system for shop performance reporting

SDVC M&E Partnership

Partnership Model

Gender, Agriculture and Asset Project ( GAAP)

GAAP Focus Area

• How the project is impacting key, tangible asset ownership (livestock, cash) for men and women

• How the project is impacting asset disparities• How the project modalities (for example group mobilization and

farmer education) impact intangible assets• How these impacts combine to sustainably effect household and

community gender norms and women’s empowerment

The Tools We Used to research Tools Purpose Tool type

FGD Explore women’s access to asset ownership, to mkt & credit and project impact on WE

Research and M&E

Life History Analysis Explore project impact and WE process Research and M&E

PPT Group performance assessment (ranking) by members & develop improvement plan

Research and M&E

Group Progress Survey Regular monitoring on milestones including gender Research and M&E

Gender equity format analysis

To aware on gender discrimination and importance of equity

Gender Awareness

24 hr clock analysis To reduce women’s workload Gender Awareness

Asset ownership pattern analysis

To aware on importance of asset ownership and access to income

Gender Awareness

Women barrier Checklist

Follow up on barriers for women in DVC Gender Awareness, research /M&E

Barrier Tree analysis To aware on barrier, its cause, consequences Gender Awareness

Peer review To assess men and women’s perception on their need and document project impact on the change

Gender Awareness, research and M&E

The Major challenges for SDVC Social norms and customs of rural community limits women with some

barriers for that SDVC face challenges to include women in VC

Barriers Affects

Barriers with women’s mobility • Face difficulty to join jobs outside home• Difficulty to purchase input and services , sale milk• To join training, meeting workshop

Lack of recognition of women’s contribution

• Lose of encourage in dairying

Limited access to asset and income management

• Can hardly make any vital decision• Face difficulty in purchasing input and services

Overburdened with Household work

• Can allocate less time for IGA• Can’t take care of child and personal health

Key Findings

Economic interventions have high spillover ratio, empowerment interventions do not – IFPRI MTE

Change at agency level fosters an increase in asset ownership ( 7.4% increase in cattle owner ship)

Cattle keeping can be used to empower women to step into new spaces traditionally closed off by ensuring participation in various parts of the value chain. (GAAP baseline study)

Men’s engagement can be the strategy to ensure women’s participation

• Project theme new, thus needed to set M&E by trial & error method.• Project strategy changed over time.• Large area covered vs. previously M&E staffing strength• Respondents (Collector, LHW) are mostly indirect participants, hesitates in

giving correct data• Various dairy-related registry systems not strong, thus info flow not systematic

and reliable and SDVC needs to invest directly, distracting field staff from implementation

• Collectors are not fully dependent on SDVC participants, so their register don’t reflect full picture

• Collectors and LHWs don’t want to disclose their business secrecy • Group members are not literate and aware enough to keep their records• Institution based M&E-PM&E system introduction• Donor focused more with numbers, thus required more info as per milestones.

Challenges we have experienced

Track market trends and secondary data not only project performance

When in doubt, triangulate

Design data collection tools to make it easy and valuable for participants

Align data collection processes with partner – or target partner – priorities and project needs

Value chain projects evolve and learn over time. The M&E system needs to be flexible and dynamic.

All project staff are the part of the M&E Team.

Use M&E data to guide implementation and project strategy purpose

Learning about M&E for VC projects

SDVC M&E Cost

Cost Area Cost Share (%)

Monitoring 3%

Evaluation 10%

Total 13%

THANKS

SDVC Evaluation System• International Food Policy Research Institute (IFPRI) is our

evaluation partner• They completed Baseline survey and produced report• Double-difference method used to compare the change

between project participants and non participant• Propensity Score Matching (PSM) approach will be used for

constructing the comparison.• For better comparison the study took the following system-

Treatment Group Control-1 Control-2

SDVC Group which was developed on Year 1

Village nearer to SDVC group

Village from another Upazila of the SDVC working district

Tool Description - TPFDescription• Overall activity progress information collected.• First introduced May 2009.• Format revised 2 time.

Outcome• Overall project activity progress

Tool Description - LPFDescription• Used to collect LHWs’ overall progress.• All trained LHW covered.• First introduced January 2009.• Format revised 2 time. Also frequency changed.

Outcome• Service coverage and linkage• Income growth

Tool Description - CPFDescription• Used to track collectors overall progress.• All collector (trained or not) engaged with SDVC

group to purchase milk covered.• First introduced February 2009.• Format revised 2 time. Also frequency changed.

Outcome• Income and milk collection growth

Tool Description - GPFDescription• To Grab Household level overall progress• Questionnaire survey. Mostly quantitative and proxy

qualitative• First introduced March 2009.• Revised 2 time. Frequency- 3 month to 6 month. Content

based on requirement.• Used Multi-Stage Random Sampling. 1st Group, 2nd

member• External people done survey and data entry. SDVC M&E

done analysis and reporting

Outcome• Household dairy income expenditure• Other achievement

Tool Description - PPTDescription• Participatory Performance Tracking (PPT)• Done in semi-annually by group members.

CARE staff only facilitate it.• First introduced on March 2010.• Two major revision done. Frequency And

scoring guideline.

Outcome• Overall practice level of individual producer• Group Maturity score

Cont…

Tool Description – PPT

Cont…

Step- 1

Tool Description - PPT Step- 2

• A Category- 70% & above• B Category- 50% 69%• C Category- 30% - 49%• D Category- 0 - 29%

eMIS-Krishi Utsho M&E

Field Staff

Sales & Clients submitted each week

Routine shop performance monitoring on smart

phones

Shop Owners