1

Pride Reporting InitiativesBeta Pilot Program Launch

2

Reminder of Goals & Progress

• Simplify the reporting process• Make reporting align to

management actions• Have some kind of standard

reporting system to build a common vocabulary

• Reporting system must have some consistent standard and frameworks that go from campaign-level to cohort to region to Rare (3Cs) to avoid duplication of work

• Frequency of reporting may vary from weekly data points, to monthly, to quarterly based on how often data really changes

• Align to the Rare and Departmental BSC as much as possible to reduce complexity

Goals Progress

• Clarified the 3C language on existing Weekly Flash Reports

• Removed RarePlanet supporters from the Pride Scorecard

• Agreed to continue to use the 3Cs framework

• Agreed to focus on linking to the BSC

• Agreed to dramatically reduce the size of the Weekly Flash Report

• Agreed to focus on a monthly reporting structure

• Regional meetings create draft actionable metrics

• Designing data export features from RarePlanet

• Alpha version of Weekly Flash Reports and Pride Scorecards complete

• Generally align on piloting process

Original Project Roadmap

Consensus• System– does not

meet our reporting and project management

• We need a standard template for core activities

• We want some regional flexibility

Charter a TeamClear Scope: well defined, tangible, actionable• Clear Roles: advisory group + deciders + doer

Clear Ownership: to VPs

Clear RequirementsCore definedOpenness to additional features

Team MeetingConfirmed rolesConfirmed requirements

Developed design principals

Confirmed timelines

Development Rapid prototype Validation meeting Improvement4. Validation meeting5. Improvement6. Test (multi-users)7. Review and Decide8. Launch

Support• Imbedded instructions in tool• Manual• TBD – integrated into CM training• TBD – continuous improvement

TBD - Improvements

3

Current Phase

4

Today’s Focus: Piloting ProcessWeekly Flash Reports & Monthly Pride Scorecards

Key Proposed Changes to the Weekly Flash Report• Much shorter• Revised language around compliance with campaign agreements •Focus on project status vs. monthly goals• Only asks next steps overall (not by 3Cs)• Links to Prideforce comments

Key Proposed Changes to the Pride Scorecard• Tighter alignment to the DBSC – completing Pride Scorecard creates an input to DBSC• PPMs are expected to complete a monthly report• Mix of checklist and scoring• Each question is intended to drive specific actions• All inputs can be easily exported to Excel

Things that Stay the Same• Main tool for data collection is still RarePlanet• We will still do partner surveys and support visit reports that link to Pride Scorecard• Regions will still have their own cohort-level reporting system

5

Ideal Reporting Process

Campaign Manager(s)

PPM Cohort Director

Vice President

• Work Plan + RarePlanet• Weekly Calls / Support

Visits• Project Management

Issues• Technical Issues

• Weekly Flash Reports• Pride Scorecard• Cohort Tracking Tool• Regular Meetings

• Pride Scorecard• Cohort Tracking Tool• CPP / Cohort Issues

Data Flows Via RarePlanetResults Shared with QMI, Dale, LT, Board

6

How This System Supports Cohort Reports

Weekly Flash Reports

Campaign Milestones

Pride Scorecard

Fully Exportable from RarePlanet to Excel(In development November)

• Manual (For Now) input into cohort management tools / Report• Recommend posting these to monthly accessible space

Prideforce

Exports TBD

7

Why Pilot

What is Pilot?

• Understand how the process mechanics may work • Correct any misunderstandings• Generate list of key training /

support needs• Identify key supporting activities• Test understanding of process,

definitions, actions• Allow PPMs/Cohort Directors to use

it in a practice mode• Enable comparing / contrasting

outcomes with the old system• Ensure participation

• Serving as a tentative model for future experiment or development: a pilot project.• Serving or leading as guide.

Source: answers.com

Key Benefits

8

Who PilotsEssential that key stakeholders are involved

Who What How Much Time

1 PPM per Region

• Attend orientation call• Use the form 2x over 2 months• Complete regular reporting criteria• Provide feedback• Be patient!

About 10 - 15 hours of incremental time

1 Cohort Director per Region

• Review and discuss the reports with PPM• Attend feedback calls• Attend session on how reporting drives

action• Work with Keith / Daniel on improvements

About 10 hours of incremental time

Training Director Organize a meeting of PPMs to help list actions

~ 8 hours

VP • Attend meetings• Provide feedback• Determine if we should launch

~ 6 hours

What the Pilot Looks Like

Set Objective

Generated Metrics

Prototype

Proc

ess

to D

ate

Test Revise Review & Decide

Regional Pilot• What questions

need clarification• What is missing or

duplicative• How do these new

criteria change:• PPM & Rare

behaviors• CF activities• Implementation

partner activities• Is this system

better, or just different

Pilot Process About Two Months

Test Build System

1. Feedback: Great!Next Step: Design & launch

2. Feedback: Small IssuesNext Step: Revise, Design & launch

3. Feedback: Big IssuesNext Step: Revise, Test Design & launch

4. Feedback: FailureNext Step: Revamp project

Midcourse corrections - tweak

Team Review• How different

are results• Have we met

our design goals• Is this system

better, or just different

10

Barrier Removal StrategyWhat tools are needed to overcome barrier to adoption and make this successful?

• Recommend that the PPMs / TMT Provide feedback on:• What actions are being driven by

the report• What changes need to be made

to make sure these actions are viable, e.g.:• Better training for PPMs• Clearer escalation to Cohort

Director or VP• Local partner engagement

activities• CM training

• Vice Presidents should map out their desired reporting and outcomes

Supporting Activity

The purpose of the reporting system is to support behaviors that will improve campaigns. What is needed to support sustained behavior change?

Potential Outcomes

• Training materials• Better instructions on

RarePlanet• Clearer roles and

responsibilities

11

Proposed Timeline for Pilot

Activity Nov 14

Nov 21

Nov 28

Dec 5 Dec 12 Dec 19 Dec 26 Jan 2 Jan 9 Jan 16 Jan 23 Jan 30 Feb 6

Complete Beta model

Agree on pilot

Train new PPM

PPMs begin Note – many staff / partners on vacation

?

Reports due 1 2 3 4 Contig- ency

Team fixes / clarifies issues

TMT – BR Meeting

Each region decides when this should occur

Report out on the finding

Exac

t dat

es R

egio

n by

Reg

ion

12

How the pilot reflects regional feedback

13

CHINA Proposal for New IdeasMeasure Description Data source or Process Frequency of

data captureCapacity

CM ability to train campaign team

LAP satisfaction with CM performance

Training CM provided to campaign team

LAP director or supervisor feedback on CM performance

CM report on RP

LAP survey

Quarterly

Quarterly

Constituency

LAP adoption of Pride methodology

% of (threat-causing) Target Audiences changing attitude

LAP adopts Pride methodology to apply within organization

Of the target audience (e.g. fishers) what percentage of them do we expect to change their attitidu through the BR solution

LAP survey

Survey

End of campaign

End of campaign

Conservation

Scientifically Rigorous Conservation Result Monitoring Plan

Implementation of monitoring plan

The quality of the monitoring plan

Status of the conservation monitoring plan implementation

PPM evaluation on monitoring

monitoring data collection uploaded on RP

Planning phase

Quarterly (depending on the indicator)

14

PEP Proposal for New Ideas

15

Guad Proposal for New Ideas - Capacity

Groups

CM/LAP Go Beyond

Involve/train others on Campaign

Barrier Removal Management

Communication Negotiation Skills Conservation vision

Project Management

CM/LAP are proactive

High attendance to meetings/events

Number of Barriers VS Number of successful solutions

Weekly communication 

Conflict resolution Betters understanding of conservation

Good project management

CM/LAP gain support and funds

Train others on Campaign processes

Great management of Barrier removal Strategies

Clear Communication

Excellent negotiator Separates important/strategic from urgent (prioritize)

CM/LAP Replicate campaign

There is evidence on how others are involved 

Effectively communicates campaign progress

Number of problems VS successful solutions

Work Plan and other documents are submitted on time

CM develop his/her professional skills outside of Rare training

Teamwork is reflected

Listening, asking and growing skills

Rare Planet Milestones are on time

CM/LAP shows initiative 

CM involve LAP and train others on his/her team 

CM feels comfortable in front of big audiences

Well organized

CM/LAP strategic vision goes beyond campaign

Number of persons from LAP involved on campaign

Multitasking skills

Number of Pride and BR activities developed

Adaptive Management

CM/LAP implement numerous activities on campaignSocial Mkt activities are applied

16

Guad Proposal for New Ideas - Constituency

Partners supporting campaign Social outreach Replication / Adaptation interest 

Number of partner organizations involve A group of volunteers is supporting the campaign

Number of interest expressions on campaign replication

Number or activities other groups do to support the campaign

Number of people that agree to support campaign BR strategies

Number of organizations that want a campaign (as a product of watching or participating on a ongoing campaign)

Number or successes in terms of BR (i.e. ARAs signed)

Number of persons that act on favor of BR strategies

Relationship management with local partners

Percentage of audiences attending to Pride events

Number of organizations and people participating on the campaign

Resilience (Diversity of groups supporting the campaign)

Organizations that have embraced the campaign and support campaign activities

Number of people involved on the campaign

Number or partners collaborating with the campaignNumber of agreements achieved with partners 

Could measure this against a plan?Number of donors supporting the campaign 

Could also be total $ (cash and inkind) raised

17

Guad Proposal for New Ideas - Conservation

Brainstorming ideas of conservation metrics • Proxies (sub results)• Follow up on biological indicators measurement• Follow up on LAP to be monitoring CR indicators• Communicate with monitoring partners• Follow up on BROP development

18

Bogor

Finding• There is still big gap between Departmental Balance Score Card

and Pride Score Card also between Pride Score Card and Individual Balance Score Card. Pride balance score card mainly assess progress based on subjectivity of the PPM and lacking verifiers that justify the assessment.

• Current Pride balance scorecard is mainly based on coincident performance metric and does not yet reflect the actual condition of the campaign, we will need to have some additional lagging and leading performance metric.

• A good performance metric should at least meet three criteria, i.e. simple, accurate and reliable, while some of current performance metric (Pride balance scorecard) are less accurate and reliable.

19

Bogor - Capacity

Original Pride BSC as found on Rare Planet

Proposed Change or Modification Measurement method

Type of performance metric

Note

CAPACITY

Grades on assignments (university grade form)

PPM score on key deliverable: Project plan, work plan, creative brief, key marketing element (logo, slogan), final report, marketing mix

Weekly during pride phase

Lagging

Partner’s assessment of CM Capacity (Partner survey)

Supervisor’s assessment on CM capacity, administered by PPM

- Pre-pride- Planning phase- Implementation phase- Final phase

Lagging Not self administer survey and specific to supervisor because the supervisor works closely with the CM

Ability to demonstrate and/or teach at least two pride tools (Miradi, Survey Pro, ORID, FGD, Consensus workshop) to team members in the IP / stakeholder / local leader

Quarterly Leading Source: Monitoring trip, CM report, supervisor report

Timeliness of past 4 campaign deliverable (milestone)Note to Daniel: why ‘past 4 campaign deliverable’

Timeliness of past 4 campaign deliverable (milestone)

Weekly (flash report)

Leading Keep this performance metric

Draft project plan submitted at least one week before module 3 launch

Before Phase 2 university

Leading

Post survey completed one week prior to module 4 launch

Before phase 3 university

Leading Additional from existing

Partner satisfaction Can be found in Strategic Pillars on DBSC Partner satisfaction index rating

Region’s assessment of progress toward capacity goals (weekly flash report)

Removed It’s already covered by above measurement

20

Bogor - Constituency

CONSTITUENCY

Region’s assessment of progress toward constituency goals (weekly flash report)

Number of campaign media distributed (K)

Weekly (flash report)

Leading

Number of agreement, endorsement or involvement achieved (A)

Weekly (flash report) or quarterly

Leading

Number of local innovators identified (P)

Weekly (flash report)

Leading

Assessment of BC (support visit report)

Number of identified people showing behavior change (depend on each cohort/campaign’s BC objective)

Weekly (flash report)

Lagging It can be measured from Weekly flash report, but the report format should provide option such as: > 10 people (good)10-30 people (very good)> 30 people (excellent)

Number of key influencer involve in campaign -> at least one key influencer/ village

Quarterly Leading

Assessment of IC (support visit report)

Percentage of target audience exposed to interpersonal communication campaign activity (K)

Weekly (flash report)

Leading

21

Bogor – Conservation

CONSERVATION

Region’s assessment of progress toward conservation goals (weekly flash report)

Number of identified people showing behavior change (depend on each cohort/campaign’s BC objective)

Weekly (flash report)

Leading

Likeliness of target audience to change behavior

Weekly (flash report) or quarterly

Leading

PPM’s assessment of Quality Deliverables (milestones page)

Number of key influencer involve in campaign -> at least one key influencer/ village

Quarterly Source: Monitoring trip, CM report, supervisor report. The report format should provide option such as: > 10 people (good)10-30 people (very good)> 30 people (excellent)

Region’s assessment of BR progress (weekly flash report)

Progress status toward plan as shown in the approved BROP

Weekly (flash report)

Leading

22

Meeting with Amielle

• Good to align with BSC and RBSC• Focus on modifying:• “Assessment Towards Progress on Conservation Goals” to:

• Assessment Towards Progress on Biological Monitoring Plan• Assessment Towards Progress on Threat Reduction Plan

These should be assessed by the relevant expert within the region• Amielle can help develop a template

• She suggest we document the “extras” that campaigns do:• Help develop Bright Spots/Signature campaigns• Help highlight other sources of success

We should do the fundraising DBSC as a capacity measure / constituency measure?