Upload
leanh
View
215
Download
2
Embed Size (px)
Citation preview
UNDP Strategic Plan 2014-2017
Streamlined Integrated Results and Resources Framework (IRRF)
Executive Board Informal Consultation, 30 January 2015
Bureau for Policy and Programme Support (BPPS) Development Impact Group
Contents Sources of evidence used by UNDP
Big picture: What is the IRRF?
Big picture: IRRF structure
IRRF: key principles
Producing the IRRF: timeline
Streamlining the IRRF: process and summary of changes made
Who does what to populate the IRRF?
UNDP “footprint”
Examples of indicators
Monitoring & Evaluation capacity in UNDP
Next steps
Sources of evidence used by UNDP 1
Performance and Results
SP Integrated Results and Resources
Framework (IRRF)
Programme Results
Frameworks
Results Oriented Annual Reports (ROAR)
Project Monitoring
Independent Evaluations
Decentralized Evaluations
Partner Assessments
Internal Data
Systems UNDP uses evidence derived from various sources for results-based management.
Using multiple sources of evidence is crucial to capture a comprehensive view of UNDP’s performance at global, regional and country levels.
Integrated Results and Resources Framework (IRRF)
The IRRF translates the
Strategic Plan into results
UNDP Strategic Plan 2014-2017 Integrated Results and Resources
Framework (IRRF)
The IRRF allows UNDP to…
Monitor and report on
performance and results Hold the organization accountable for the
results and resources entrusted to it.
Big picture: What is the IRRF?
Big picture: IRRF Structure
DEVELOPMENT IMPACT
Eradication of poverty and significant reduction of inequalities and exclusion
DEVELOPMENT OUTCOMES
7 development outcomes representing UNDP’s global development priorities
DEVELOPMENT OUTPUTS
39 development outputs representing results through specific support by UNDP
ORGANISATIONAL EFFECTIVENESS AND EFFICIENCY
9 results areas related to making UNDP more effective and efficient
Tier 1
Tier 2a
Tier 2b
Tier 3
Results Framework Integrated Budget
Impact
Programme Outcome
Output
Organizational Effectiveness and Efficiency
Development Effectiveness
UN Development Coordination
Management
Special Purpose
IRRF: Key Principles 1
Results in the IRRF are designed to capture development changes that are most relevant to UNDP’s contribution.
OUTCOMES
Development change in UNDP’s priority areas achieved as a result of all partners involved, i.e. not limited to UNDP.
OUTPUTS Results achieved by national partners for which UNDP has
provided specific and direct support, e.g. through the schemes, services, plans, actions etc.
Producing the IRRF: timeline
2nd Regular Session (Sep 2013)
IRRF submitted
EB Decision 2013/12: “UNDP to further develop the indicators, baselines, milestones and targets”.
1st Regular session (Jan 2015)
“Technical note on Streamlining the UNDP IRRF” for informal consultation, with baselines 2013, milestones 2014 and 2015, and targets 2017.
Annual session (Jun 2015)
Annual Report of the Administrator will be submitted with IRRF containing BMTs and 2014 results.
Annual session (Jun 2014)
• Populated IRRF submitted, with baselines 2013, milestones 2014 and targets 2017.
• EB Decision 2014/11 requested “UNDP to make any necessary adjustments to the IRRF” and “finalize the maximum number of first and second year milestones and 2017 targets” by the first regular session 2015.
Streamlining Process
Simplifying terminologies, disaggregation and rating scales.
Removing indicators for which methodologies are yet to be developed, or data collection is premature.
Editing indicators to reflect key thematic content of UNDP’s contributions, outlined in the Strategic Plan.
Ensuring that revised indicators continue to rely on the best available international knowledge, directives, guidance, standards and practices for measuring attributable contributions.
Merging indicators under different outputs to eliminate redundancy.
Breaking down a complex output indicator into separate indicators to increase robustness of data captured.
Streamlined IRRF: summary of changes
1 Tier 1
IMPACT
Statement No change
Indicators No change (maintained 4 indicators)
Tier 2a
OUTCOME
Statement No change
Indicators
Streamlined from 32 to 25 indicators
• Removed: 7
• Streamlined: 12
Tier 2b
OUTPUT
Statement
• 3.1 - Edited
• 3.6 – Moved to Outcome 7 as Output 7.8
• 4.5 – Removed
Indicators
Streamlined from 92 to 67 indicators
• Removed: 22
• Streamlined: 27
• Merged: 10 (into 5 indicators)
• Split: 1 (into 3 distinct indicators)
Tier 3
ORGANIZATIONAL Indicators
• Removed: 2
• Streamlined: 4
• Enhanced with sub indicator: 1
Total number of development indicators Before streamlining 128 After streamlining 96
Total number of organizational indicators Before streamlining 50 After streamlining 48
Content of the populated IRRF
Full development results chain includes impact, outcome and output levels.
An integrated framework includes development and organisational results to measure, monitor and report on the relationship between UNDP’s development results and organisational effectiveness and efficiency.
The results and resources framework sets out the indicative resource envelope and results for the four years of the Strategic Plan.
Harmonized indicators with other UN agencies at outcome and output levels, including 10 common QCPR indicators.
2013 baselines, 2014 and 2015 milestones, and 2017 targets are populated.
Priority has been given to data disaggregation by sex
1
Who does what to populate the IRRF?
Translate IRRF indicators into data components
Develop methodological notes for indicators
Develop corporate system to capture
data
Training, technical support, data analysis and quality assurance
Link country results with
the SP results
Identify indicators to
report
Set baselines, milestones and targets
(BMTs)
HQ Bureaux
with Regional
Hubs
Country Offices and HQ Bureaux
Populated IRRF
UNDP’s “footprint”
1,727
1,004
836
101
409 283 377
451
$1,176
$642
$1,705
$33
$244 $346
$172 $154
$-
$200
$400
$600
$800
$1,000
$1,200
$1,400
$1,600
$1,800
-
200
400
600
800
1,000
1,200
1,400
1,600
1,800
2,000
Outcome 1Inclusivegrowth
Outcome 2Voice
Outcome 3Public services
Outcome 4Gender
Outcome 5 Riskreduction
Outcome 6Early recovery
Outcome 7Thought
leadership
NON_APPLIES
Outputs and Resources per SP Outcomes
Number of Country Outputs (January 2015) 2014 Budget (USD million)
Number USD million
Data collected across 136 Country Offices and 154 programme countries.
Target Setting Principles: Outcome Level
TYPE 1: Indicators that track internationally-agreed development targets E.g. Indicator 4.4: Proportion of decision making positions (executive, legislative and judicial) occupied by women at national and sub-national levels - 30% by 2017 (based on ECOSOC target)
TYPE 2: Indicators that track expected direction of travel, based on past trends E.g. Indicator 6.4: Percentage of (monetary equivalent) benefits from temporary employment / productive livelihoods options in the context of early economic recovery programmes received by women and girls (UNSC 1325 - led by UNDP & UN Women) – 40% by 2017 (UNDP estimate)
TYPE 3: Indicators that are tracked but no targets are set, as it is not possible to set a credible target
E.g. Indicator 3.3: Access to justice services
Outcome indicators enable UNDP to analyse progress against the Theories of Change, in order to adjust planned UNDP contributions (outputs) as needed.
Monitoring Principles: Output Level
• Evidence is gathered through programme and project monitoring, and must be objectively verifiable and come from a credible data source.
• Monitoring: tracks only results that are specifically supported by UNDP based on national demand.
• Baselines, milestones and targets (BMTs) are generated from aggregate data provided by country offices for countries where results are expected, based on ongoing and planned projects/programmes, during the period of the Strategic Plan.
• BMTs evolve to reflect closing of existing projects/programmes and starting of new ones.
• Qualitative indicators use internal methodologies (objective rating scales) to track whether UNDP’s support is directly contributing to desired results.
• Results captured represent the sub-set of UNDP results that are being measured through indicators, and not the entire set of results achieved. Resources, on the other hand, are captured in totality.
Gender Equality in the IRRF Gender specific indicators (Outcome 4)
• 4 outcome indicators • 6 output indicators
Gender mainstreaming indicators (under other outcomes) • 11 gender sensitive indicators • 12 sex-disaggregated indicators • 2 gender sensitive institutional indicators
[VALUE]
[VALUE]
[VALUE]
[VALUE]
0
5000
10000
15000
20000
25000
30000
2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target
Example 4.4.2 Number of women benefitting from private and/or public measures to support women’s preparedness for leadership and decision-
making roles (22 linked countries with data reported)
tbc
Indicator 1.1.1 (jobs component) Number of
new jobs generated
Indicator 1.3.2 (jobs component) Number of new jobs created through management of natural resources, ecosystem services, chemicals and waste
Example of Indicators: Jobs and livelihoods
112 countries linked
For women
in 71 Countries 2,413,098
For men
in 69 Countries 4,765,749
For women
in 52 Countries 179,871
For men
in 53 Countries 85,516
For women
in 19 Countries 62,315
For men
in 19 Countries 100,603
104 countries linked 32 countries linked
Indicator 6.1.1 (jobs component) Number of people benefitting from emergency jobs and other livelihoods in crisis or post-crisis settings
The IRRF has three indicators that measure the number of jobs created and livelihoods strengthened with direct support from UNDP. Data below summarizes targets for one of the data components – number of jobs created – disaggregated by sex. (Baselines are set to zero to capture new jobs created from 2014 onwards.)
Overall: 2013 Baseline Overall: 2017 Targets
New jobs for women 0 2,655,284
New jobs for men 0 4,951,868
Total 0 7,607,152
Examples of Output Indicator BMTs Number of Countries
26
45
tbd
65
0
18
28
tbd
46
-
20
40
60
80
100
120
2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target
2.3.1 Number of countries with strengthened operationalinstitutions supporting the fulfillment of nationally andinternationally ratified human rights obligations
1.1.2 Number of countries with policies, systems and/orinstitutional measures in place at the national and sub-nationallevels to generate and strengthen employment and livelihoods
Output 2.3 - 66 countries linked
Output 1.1 - 112 countries linked
80 countries
46 countries
Examples of Output Indicator BMTs Number of new development partnerships
Output 2.3 - 66 countries linked
Output 1.1 - 112 countries linked
80 linked countries with data reported
46 linked countries with data reported
113
215
tbd
509
0 39
107 tbd
139
0
100
200
300
400
500
600
2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target
1.5.1 Number of new development partnerships with funding for improvedenergy efficiency and/or sustainable energy solutions targeting underservedcommunities/groups and women
7.6.1 Number of new public-private partnership mechanisms that provideinnovative solutions for development
67 countries
Output 1.5 - 85 countries linked
Output 7.6 - 25 countries linked
19 countries
1. Percentage of country programme outcomes that are reported as either on-track or achieved (cross checked with evaluation findings)
25. Percentage of all staff surveyed who feel empowered in their job
4. Percentage of CO annual results reports which meet or exceed expected organizational quality standards
36. Percentage of partners perceiving UNDP as a valued partner to their organization
Examples of BMTs Organizational Effectiveness and Efficiency Indicators
[VALUE] [VALUE] tbd
90%
[VALUE]
[VALUE]
[VALUE]
tbd
[VALUE]
57% 57% 60%
tbd 65%
50% 55% 57%
tbd
60%
50%
55%
60%
65%
70%
75%
80%
85%
90%
95%
2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target
Monitoring & Evaluation capacity in UNDP
Data Source: 2013 Annual Report on Evaluation, Independent Evaluations Office
Data Source: 2013 Results Oriented Annual Report (ROAR)
71
382
0
50
100
150
200
250
300
350
400
450
Number of dedicated M&E specialists atcountry level
Fulltime equivalent staff performing M&Efunctions
Next Steps Data extraction and data integrity checks to populate IRRF indicators
with 2014 actual results – mid-February
Aggregation and analysis of 2014 actual results from IRRF and other UNDP sources of evidence – end of February
Submission of the Annual Report of the Administrator – June 2015 Adjusted “footprint”
Streamlined indicators
Higher rate of data coverage
Milestones for 2014 and 2015
Targets for 2017 Actual Results for 2014
Setting of 2016 milestones – January 2016 Mid-term review of the Strategic Plan – June 2016
Thank you