1

Adaptive Management Strategy:

Monitoring and Evaluation

Defining Concepts

Monitoring & Evaluation

- a surveillance & evaluation system- recording of changes after the project has been implemented to see that:

- everything goes according to plan- resources are not wasted

- a continuous process throughout project lifetime?check the progress of the project against

plan and modify if necessary

2

•• Observing a specified area/resource and Observing a specified area/resource and noting changes that occurs over time.noting changes that occurs over time.

•• Taking pictures at regular Taking pictures at regular periods and comparingperiods and comparing

23 June 2004

28 Dec 200428 Dec 200428 Dec 2004

Banda Ache, IndonesiaBanda Ache, Indonesia

3

Coral breakageCoral breakage

beforebefore

afterafter

due to stormsdue to storms

Evaluation

?assessment of design, implementation and results of the project to determine:?Relevance?Efficiency?Effectiveness?Impact?Sustainability

?provide recommendations on future course of the project or management programs?draw lessons for other projects or programs

4

PM&E Indicators

? Key factors which tell about the progress or changes

? Analyze the “costs” and benefits of project

? Types:- process indicators- outcome indicators

Concepts• Monitoring and the importance of benchmarking activities

to obtain information against which succeeding monitoring results shall be compared with

• Monitoring and evaluation (M&E) completes the adaptive management cycle, allowing management to be responsive to the changes that may occur while implementing the intervention (e.g. MPA)

• M&E fosters good governance principles of transparency (e.g. timely feedback), accountability (e.g. clear roles/functions, functional mgt. body) and participatory decision-making (high involvement by community).

5

ADAPTIVE MANAGEMENT CYCLE

Issue Identification/ Planning

Project Design

Implementation & Management

Monitoring & Evaluation

ImpactPerformance

Incentives/Disincentives

accountability

participatory

partic

ipator

yaccountability

functionalitytransparency

How can we make things more effective and sustainable?

Is information feedback accurate and timely?Is the budget allocated appropriately?How much involvement by stakeholders in implementation?

Sustainable management

Sustainable Use Sustainable Benefits

? Management bodiesManagement bodies?? Management plans Management plans and ordinancesand ordinances?? Budgets allocated Budgets allocated for CRMfor CRM?? Implementation Implementation programs functional & programs functional & effectiveeffective

? Increase fish Increase fish size and biomasssize and biomass? Adult and larval Adult and larval spilloverspillover?? Improved Improved habitats and habitats and ecosystemsecosystems? Regulated useRegulated use

? Increased income Increased income for beneficiariesfor beneficiaries?? Increase in Increase in equitable allocationequitable allocation?? Enhance Enhance stewardship stewardship arrangementsarrangements?? Improved quality Improved quality of lifeof life

~ 3 – 5 years

~ 5 – 10 yrs

~ > 10 yrs

Towards Sustainable Development in CRMTowards Sustainable Development in CRMBy Improving Adaptive ManagementBy Improving Adaptive Management

6

Why Monitor?

• To measure the impact of the MPA on the environment and communities (impact assessment)?Biophysical?Socio-Economic

• To evaluate the performance of the management body/group who is implementing the MPA (performance tracking)

7

Guide to Indicator Selection? Choose indicators which are

- valid - reliable- relevant - sensitive- specific - cost-effective- timely - simple- easily measured

? Select indicators by brainstorming? Select a few and measure well? Complementary and not overlapping? Choice by group consensus

Communicating and Acting on Information

? Learning from the experience- achievements analysis- progress review meetings

? Formal reporting requirements- timeliness for action- avoid duplication- consider cost- periodic assessment of usefulness ofreports to users

8

How does PM&E Work?

? Encourage participation of all stakeholders (allow first-hand knowledge on project status)

? Collect baseline information on coastal situation before the start of the project

? Build on participatory experience? Enhance local capability via training? Use various tools for collecting information? Immediate validationcan be simple or complicated

- as long as it works for your project

Preferred conditions for Success

? Mandates are clear and consistent? Incorporate sound theory identifying causal

linkages to policy objectives? Existing legislation to maximize the chance that

implementing officials and target groups will perform best

? Leaders of implementing agency have management and political skills

? Program is supported by constituency groups and key legislators

? Priority of objectives is not influenced by conflicting policies

9

Why monitor MPAs?

? Determine changes in habitat quality & amount of resources? Live vs dead coral? Abundance, diversity and biomass of

fish & other resources (invertebrates, seagrass, seaweeds and mangroves)

Main Sources of Info & Data

? Surveys/rapid assessment (e.g. PCRA)? Visual checking and accurate measurements? Discussion and meeting? Questionnaires? Interviews? Other methods

*Always record informationAlways record information*Prepare reports for implementers and others uses*Prepare reports for implementers and others uses

10

M&E METHODS/TOOLS:

A. Impact Assessment

1. Biophysical (including resilience and effect size)

2. Socio-Economic (including effectiveness and sustainability)

1. Biophysical Variables

-Manta Tow-Snorkel survey-Line/Point intercept (LIT/PIT)-Video transect

Percent CoverLive Coral Cover

inside and outside the MPA Design

Fish Visual Census-Type of fish-Length/Size-Number of fish

Fish BiomassCoral Reefs(% of total area under protection)

MethodMinimum Data Requirements

IndicatorHabitat

11

Manual for participatory reef monitoring

Observing Corals & Algae: Manta Tow

12

119.7 119.72 119.74 119.76 119.78 119.8 119.82 119.84 119.86 119.88 119.9

east longitude

4.98

5

5.02

5.04

5.06

5.08

nor

th la

titud

e

119.7 119.72 119.74 119.76 119.78 119.8 119.82 119.84 119.86 119.88 119.9

east longitude

4.98

5

5.02

5.04

5.06

5.08

nor

th la

titud

e

Dive sitesManta tow areas

Corals and reef fishes study sitesCorals and reef fishes study sites

Bongao Is.

Sanga-Sanga Is.

13

119.7 119.72 119.74 119.76 119.78 119.8 119.82 119.84 119.86 119.88 119.9

east longitude

4.98

5

5.02

5.04

5.06

5.08

north

latit

ude

Ungos-ungos

0

0.5

1

1.5

2

2.5

3

3.5

1 2 3 4 5 6 7 8 9 10 11 12 13

tow numbersc

ore

Ungos-ungos

0

0.5

1

1.5

2

2.5

3

3.5

1 2 3 4 5 6 7 8 9 10 11 12 13

tow numbersc

ore

Manta tow dataManta tow data

113

Pababag

0

0.5

1

1.5

2

2.5

3

3.5

1 2 3 4 5 6 7 8 9 10 11

tow number

scor

e

Pababag

0

0.5

1

1.5

2

2.5

3

3.5

1 2 3 4 5 6 7 8 9 10 11

tow number

scor

e

1

11

HCSCDC/AR

A combination of relatively good hard and soft coral cover is seen in Pababag and Ungos-Ungos.

A combination of relatively good A combination of relatively good hard and soft coral cover is seen in hard and soft coral cover is seen in Pababag Pababag and and UngosUngos--UngosUngos..

Observing Corals & Algae: Snorkel Survey

14

lifeform transition lengthCF 57 57AA 60 3ACD 80 20AA 89 9CM 100 11AA 102 2CM 104 2A 122 18ACB 136 14AA 141 5CM 166 25AA 173 7SC 214 41AA 217 3CM 224 7AA 231 7CF 251 20CS 272 21

Line intercept

SC200

SC175HC150

AL125

HC100

HC75HC50

HC25

HC0

lifeformpoint

0

25

50

75

100

125

150

175

200

point intercept

• Note substrate below points along x-sect

• Note segment on x-sect where substrate change occurs

15

•• Concrete blocks are laid along the line to Concrete blocks are laid along the line to permanently mark the sitepermanently mark the site

•• Can be used to monitor recruitment in areaCan be used to monitor recruitment in area

Verde Island – Marker Blocks

Only sponges have settled after two years being laid

Siltation is of concern to recruitment

Twin Rocks –Marker Blocks

Good diversity of recruitment after 15 years

Good diversity of recruitment after 15 years

Tubbataha recruitment blocks are nearly 10 years

Good recruitment, survivorship and growthGood recruitment, survivorship and growth

Recruitment, survivorship and growthRecruitment, survivorship and growth

Observing Reef Fishes

Fish Visual Census

16

Expected Output:

FISH GRAPHING FORMSite Name: Tuka Reef Municipality & Province: Kiamba, Sarangani

Zone/Sector: Outside Outside Outside Inside Inside Inside

Month & Year: Oct 1998 Mar 1999 Apr 2000 Oct 1998 Mar 1999 Apr 2000

Types/groups

Groupers

Snappers

Sweetlips

Jacks

Fusiliers

Parrotfishes

Surgeonfishes

Rabbitfishes

2. Socio-Economic Variables

-Logbook/ record keeping

-Types of threats/ disturbance-Frequency of disturbance

-Human -Natural

Threats/ Disturbance

Barangay with the MPA and adjacent barangays

Design

-Fish catch monitoring of individual fishers-Focus group discussions (FGD)-Gear mapping

-Total number of fishers-Major gear types-No. of fishers by gear type-Area of fishing-Average catch per trip (kg)-Frequency of fishing (days, months)-Types of gears used per month

-Gear Map-Catch Per Unit Effort (CPUE)

Fisheries

MethodMinimum Data Requirements

IndicatorVariable

17

18

Fish Catch Monitoring: How to do it on field?

a) Team member collecting catch information (Form 6B)

b) Many individual fishers voluntarily recording their own catches 5 times per month and submitting their forms (Form 6C)

c) Collect and sort data according to gear type

d) Compute for total catch per gear

e) Compute total effort per gear per month

f) Compute for catch per unit effort for each gear per month

g) Plotting of CPUE by gear type

19

20

M&E METHODS/TOOLS:B. Performance Monitoring

1. MPA Rating System (Adopted from CCEF 2005)

• A system intended to assist local governments and communities to improve MPA management

• Minimum set of criteria/activities for every level needs to be satisfied first to be assigned that particular level

• Each criterion/activity will be ranked with high, medium or low according to the governance principles of transparency, accountability and participatory decision-making (TAP).

• High – Activity/criterion satisfies all TAP features

• Medium – 2 out of 3 TAP features are evident• Low – only 1 of the TAP features is evident

Level 1 – MPA is initiated

Management body membership tentatively determined(Management core group starting to conduct regular meetings with proper documentation)

Preliminary management plan drafted (Management plan should include policies, structures & responsibilities, strategies & programs, financial plan and M&E)

Resolution and/or ordinance drafted

?MPA concept accepted(Orientation on MPAs for affected stakeholders from various sectors conducted.Social acceptance sought through community consultations/public hearings composed of representatives from various sectors)

*P*A*TScoreCriteria/Activity Satisfied

Education program raising awareness about MPA functions and benefits started(Conducted a series of public education activities)

Site surveyed using standard methods with baseline assessment complete, preferably conducted in a participatory process(Reports completed on fish abundance, coral cover and profile on community and coastal management)

? Site selected with community acceptance(Based on PCRA and good governance process with public consultat ions)

Minimum criteria/activities to be satisfied are indicated by a star (?)

21

Level 2 – MPA is established

? Budget for Year 1 implementation allocated(LGU has committed a budget for the establishment and implementation activities of the MPA)

IEC activities conducted (e.g. dissemination of MPA rules & regulations; initial stakeholder knowledge assessment conducted)

Boundaries delineated(Anchor buoys, marker buoys and/or boundary marks installed)

Signboards/billboards posted(Should show either map/zones, rules & regulations and/or other relevant details)

MPA outpost or other structures constructed(Guardhouse and/or other MPA-related structures constructed)

Biophysical monitoring includes local participation(Locals were trained to do biophysical surveys using standard methods)

? Management activities started(Conducted initial MPA activities such as guarding, patrolling and surveillance, etc.)

?Management plan adopted and legitimized by the LGU or PAMB(Adoption of management plan supported by resolution/ordinance; plan went through community consultations with multi-sectoral stakeholders prior to approval/legitimization)

?Management body formed(Composition of management group and committees identified; roles & responsibilities clarified and accepted; initial meetings conducted )

? Ordinance passed and approved by the Municipal Council

Community acceptance gained and documented (Documented through public consultation documents, e.g. barangay resolution)

*P*A*TScoreCriteria/Activity Satisfied

Level 3 – MPA is enforced

? Regular participatory biophysical monitoring being conducted(Documented surveys conducted at least once annually using standard methods)

? Collaborative patrolling and surveillance conducted by mandatedenforcement group and local community volunteers(Enforcement group supported by legal instrument; enforcement plan prepared and implemented, e.g. day/night shifts, by mandated enforcement groupwith assistance from local community volunteers)

MPA billboards, boundary markers/anchor buoys maintained(Funds allocated for maintenance of enforcement support structures. May be part of municipal CRM budget)

Management body functional and supported by legal instrument(Implements the management plan including enforcement and monitoring activities based on annual operation plan; conducts regular meetings; provides venue to resolve conflict / issues)

*P*A*TScoreCriteria/Activity Satisfied

? Illegal and destructive fishing reduced outside of MPA(Violations/apprehensions reportedat least or at minimum within 5 km from the MPA boundaries have been reduced by 80% for the past year. This implies that baseline violation repots have been estimated or at least based on the pervious year.)

? Fishing effectively stopped inside the sanctuary zone(No fishing-related violations/apprehensions reported inside sanctuary for the past year or if violations occurred these have been prevented or duly dealt with such that no overall adverse effect on the ecosystem has resulted)

Budget from LGU or from other sources allocated and is accessible for MPA management(There is a legal document by the LGU or an agreement with the private sector allocating budget for MPA management; Financial reports being prepared)

? Education program sustained public awareness and compliance(A long term IEC program is currently being implemented in support of enforcement and the general MPA objectives)

22

Level 4 – MPA is sustained

?Management body regularly monitored and evaluated(Performance monitoring program in place and conducted regularly for 2 consecutive years or more; reporting system for ordinary citizens to complain w/o fear of consequences available and widely known)

?Enforcement system fully operational(Mandated enforcement group implementing regularly prepared enforcement plan; enforcement support structures maintained & patrolling activities sustained over the years; effective reporting system in place)

MPA billboards, boundary markers/anchor buoys maintained(Site development structures and equipment maintained for 3 consecutive years or more)

Management body capable to run the MPA independently(Management body supervises/facilitates management activities [enforcement, budgeting & financial management, M&E, IEC, etc.] and coordinates activities with partners)

*P*A*TScoreCriteria/Activity Satisfied

Socio-economic monitoring regularly conducted(Fisheries and/or socio -economic variables being regularly monitored by local monitoring team; data summaries/reports are available and easily accessible)

Annual participatory biophysical monitoring and timely feedback of results being implemented for at least 2 consecutive years or more after establishment(Documented surveys using standard methods; reports available ; results posted in billboards)

MPA management plan and/or ordinance reviewed in a participatory process(Management plan and/or ordinance amended with the participationof various stakeholders)

Budget from LGU or from other sources is being allocated and accessed for 2 or more consecutive years(Financial reports being regularly prepared , audited and reported; proper procurement & contracting procedures are strictly being followed and transparent)

Environment friendly enterprise and/or fees collected as a sustainable financing strategy(Environment-friendly products/goods to sold tourists, impose collection of user-fees, etc.)

? Illegal and destructive activities stopped inside and within the vicinity of MPA(No violations/apprehensions reported inside and within 5 km of the MPA boundary or violations prevented or duly prosecuted and sanctioned for 2 consecutive years or more)

*P*A*TScoreCriteria/Activity Satisfied

Level 4 – MPA is sustained (continued)

23

Level 5 – MPA is institutionalized

Effective coordination with appropriate national & local agencies on CRM/MPA policies and with other LGUs achieved(Coordination on implementation and resolution particularly of issues that transcend local boundaries)

Evaluation of impacts on ecology and socio-economy conducted completed and feedback mechanisms are in place(Assessment of resource status and long -term trends conducted; Analysis of change in local economy and long -term trends of user groups conducted; Reports of these studies have been completed and reported back to stakeholdersand/or conference or symposia)

Formal commitment from the Provincial Council giving MPA stronger political support(Gives MPA institutional support to strengthen enforcement and collaboration)

Management body capacitated for fund sourcing(Can prepare and submit proposals to seek financial assistance from external sources)

? MPA management plan incorporated in the LGU development plan(MPA incorporated within the long-term LGU area-wide development plan)

Support facilities constructed/added(e.g. tourism facilities, guardhouse expanded into an education/training center, etc.)

Expansion strategies or enhancement programs initiated(MPA coverage is expanded, e.g. from a sanctuary to a park; or scope of conservation activities is heightened, e.g. coral reef restoration, culturing of clams, etc .)

Management plan refined for adaptive management(Incorporates further refinements after gaining much experience and lessons to improve strategies)

*P*A*TScoreCriteria/Activity Satisfied

?Performance M&E linked to an incentive system regularly conducted(Recognition/awards are regularly being given to outstanding member, law enforcer, etc.; incentives can also include priority for granting of available loans or alternative livelihood opportunities; feedback mechanisms for the communities such as suggestion box, complaint desk in the LGU, pulong-pulong, are available)

? IEC program on MPAs maintained over the years(Information dissemination activities sustained according to long -term IEC program ; citizens can conveniently access MPA-related info and LGU-disseminated materials such as minutes of meetings, leaflets, etc.)

Advance IEC materials developed and disseminated with assistancefrom partners and/or private sector grants (e.g. video production)

? MPA emphasizes on public education and is being used as a studytour site, residents advocate for MPAs(After much experience, members are ready to share learningsand impart knowledge; presence of identified group that conducts tours and capable of giving talkson MPAs; paper/s written on their success stories published)

*P*A*TScoreCriteria/Activity Satisfied

Revenues from enterprise and/or fees sustained and accounted for(Existing sustainable financing mechanisms are well-managed and well-documented; financial reports easily accessible)

Level 5 – MPA is institutionalized (continued)

24

M&E METHODS/TOOLS:B. Performance Monitoring

2. Perception Survey

? An independent performance evaluation for the marine sanctuary in complementation with the MPA Rating System

? Objectives:? To validate the impacts of MPA management? To gauge the level of management

effectiveness? To evaluate the performance of the

management body

Design:

? At least 20 respondents from different sectors/ stakeholders within the barangay where the MPA is located

? At least 10 respondents coming from different sectors/stakeholders in each of the adjacent barangay where the MPA is located

? At least 50% of the respondents should be direct stakeholders (e.g. fishers, resort owners, etc.)

25

? Questions:

• Do you know about the marine sanctuary in (state the name of the sanctuary and place)?

? Yes or No? If yes, how did you know?? If no, why do you think did you not know about it?

? Do you think there is an improvement in the area because of the marine sanctuary?

? Yes or No? If yes, what are the improvements?? If no, why do you say that there is no improvement?

? Do you think the marine sanctuary efforts can be sustained?? Yes or No? Why do you say that?

? Do you think the MS management group is functional?? Yes or No

? If yes, in what way is it functional?? If no, why do you think it is not functional?

? Do you support the continued management of the marine sanctuary?

? Yes or No ? If yes, how will you support it?? If no, why will you not support it?

Embedding M&E in CRM programsEmbedding M&E in CRM programs

Among zones and programsAmong zones and programs?? M&E for IEC, social marketing and capacity M&E for IEC, social marketing and capacity buildingbuilding?? M&E for Enforcement and ComplianceM&E for Enforcement and Compliance?? M&E for financing and business plan M&E for financing and business plan implementation for each zonesimplementation for each zones?? M&E for ecological interaction with social and M&E for ecological interaction with social and economic dimensionseconomic dimensions?? M&E for policy and legislative actionsM&E for policy and legislative actions

26

Drawing Up a M&E Program

• Objective of the M&E • What to monitor (parameters)• How to monitor (methods to be used)• Where to monitor (stations inside and outside the marine sanctuary or barangay (village),• Within and among municipalities within nested hierarchical designs and marine biogeographic regions• When to monitor (importance of benchmarking)• Who will monitor (monitoring team; self-assessment)• Logistical needs & support mechanisms• Feedbacking of results

Review of data summarization and analysis-Trainees, local dev’t. workers and external trainers collect data (on the benthos, reef fishes and invertebrates) together. --Supervise data summarization by trainees. - Interpreting Observations- Evaluation & Action

Season 2

A contest-conference amongst various trainee teams may help teams share insights with each other.

POST-EVENT

Trainees collect data (on the benthos, reef fishes and invertebrates) together with technical team.

Data summarization-Trainees/ local monitoring team will collect data (on benthos and reef fishes). - Trainees will use the data collected during the previous monitoring exercises to practice data summarization under the supervision of the trainors.

Trainees/ local monitoring team will collect data (on benthos and reef fishes) together with technical team. Continue practice on data transcription by the trainees.

Review data collection and recording steps-Trainees/ local monitoring team will collect data - If data collection and transcription skills are good by this time, trainorscan begin teaching the data summarization steps. Otherwise, these may be taught on the following season.

Review of basic reef ecology and management-Trainees will practice collecting data while technical team may collect baseline data (on the benthos and reef fishes; survey of invertebrates is optional).

-Orientation on participatory monitoring & evaluation to key community leaders. -Check the site for appropriate bio -physical and socio -economic conditions, logistics and counterpart arrangements

Season 2 Season 1

YEAR 2

Season 2 Season 1

YEAR 3

Season 1

YEAR 1PRE-EVENT

M&E Training Program

27

Area

of co

ral re

ef un

der g

ood p

rotec

tion

STANDARDS

At least Ecogov Level 2 to form into a network.

MPA 1 MPA 2 MPA 3

PERFORMANCE Mgm’t. Body IMPACT

-Biophysical-Socio-EconMPA

NetworkManag

emen

t Effe

ctive

ness

Incentives

Awards

Trust FundsConditionalGrantsTechnicalAssistance

*EG Level 1 – TA in improving MPA*EG Level 2 – TA for MPA networks*EG Level 3 –expected output*EG Level 4 – by Project LOP

Sustaining development through adaptive management

28

Drawing an M&E Plan

Management Performance1.

2.

Socio-Economic1.2.

Biophysical Monitoring1.2.3.

Responsible group

BudgetaryRequirement

Time Frame/Frequency

M&E Activities