IDB’s Office of

Evaluation

and Oversight

Cheryl Gray

Director

ABOUT US

What is OVE?

• Similar model to other Multilateral Development Banks

• Reports directly to the Board of Executive Directors through the

Policy and Evaluation and Programming Committees

• Will serve both IDB (public sector) and IIC (expanded private

sector) beginning January 2016

• About 30 staff and 25 research fellows/ consultants, US$9.4m

annual budget

Independent office established in 1999

Mandate

“To improve development effectiveness [through] both accountability

for development results and learning”

Objectives

• To produce clear, timely, evidence-based, and constructive evaluations

• To be useful to the Board, the IDB, member countries, and people of LAC

OVE’s Independence

OVE staff have full access to all IDB

information needed to do the job

OVE submits to Board in final form for

discussion or information, not

approval

Director selected solely by Board

- 5 year term

(renewable once)

- Removable only by Board

on performance or ethics

grounds

- Cannot work for IDB again

in any capacity

Director selects and manages all OVE staff and consultants

- Follows IDB’s HR and

budget rules

OVE’s work program and budget approved and monitored by the Board

g

- 2 year rolling plan

- Fixed share of

administrative budget

(1.5%)

- Semi-annual monitoring

report to Board

Evaluation Criteria and Process

Approach paper

review and

disclosure

Evaluation draft

for review by

management

(and country

counterparts)

Final evaluation

to Board (PEC or

Programming

Committee)

Board discussion

and decision on

OVE

recommendations

Management

response to

Board

Evaluation

disclosure

Outreach activities

(publications,

website, newsletter,

events)

Recommendation

Tracking System

(ReTS) for

Board-endorsed

recommendations

Evaluation process

• OECD-DAC criteria:

Relevance, Effectiveness,

Efficiency, Sustainability

• Effectiveness judged against

counterfactual for attribution

• Methodology depends on

evaluation questions

• quantitative and qualitative

methods both important

Objectives-based criteria

Types of Evaluations

• OVE evaluates individual Bank projects

and programs (loans and grants),

country strategies and programs, broad

sector/thematic approaches, and

corporate functions and initiatives

• Different types of evaluations are of

primary interest to different groups

(Board, management, staff, countries)

• OVE supports the development of a

strong evaluation architecture

OVE Evaluations by Topic Area, 2011-2016

Sector 2011-2014 2015 2016-17

Infrastructure and Environment

Climate change

Watershed management

IDB9 (environment strategy)

Bus rapid transport

Rural water Infrastructure PPPs Urban transport and poverty Traffic safety Energy

Rural Development Land titling and admin Agriculture & food security

Urban Development and Housing Procidades (Brazil) Sustainable Cities

Housing

Human Development

Secondary education

Indigenous peoples policy

IDB9 (HD strategy)

CCTs (C. America) Gender and diversity Labor and employment

Economic Policy and Public Sector MGMT

Citizen security (2 evaluations)

IDB9 (anticorruption, institutional devt) 2015 Annual Report (PBLs) Public financial management

Private Sector, Trade, Competitiveness, and Financial Markets

Transnational programs

IDB9 (private sector)

Subnational NSG lending

IDB support through

financial intermediaries Productive development programs (Brazil) Science and technology

Corporate

IDB9 Mid-term Evaluation MIF2 IDB Realignment IDB Special Programs Indep Cons & Investigation Mech (ICIM) Opportunities for the Majority (OMJ) Japanese Trust Fund 2014 Annual Rep (growth & poverty) PCR/XSR design & validations

PCR/XSR design & validations IDB operational efficiency

IDB as a knowledge bank

Equity investing

Impact evaluations in IDB

Contingent lending instruments

2016 Annual Rep (IDB9 progress report)

2017 Annual Rep (IDB-IIC collaboration)

PCR/XSR validations

Country Program Evaluations 22 countries Colombia, Panama,

Bolivia, Brazil, Uruguay

Argentina, Haiti, Trinidad & Tobago, Suriname,

Peru, Guatemala, Guyana, Dominican Rep.

ABOUT US

Some influential evaluations

• IDB9 Mid-term Evaluation: presented to IDB Governors at Annual Meetings

in 2012; has influenced IDB’s agenda since

• IDB Realignment: heightened the attention to Bank incentives and efficiency

• IDB Special Programs: prompted review of technical cooperation ($100m/yr)

Corporate evaluations

Project and sector evaluations

• Bus Rapid Transport: influencing new BRT system designs in LAC

• Climate Change: helped prompt new IDB approaches to sustainability

Country program evaluations

• Colombia and Panama: questioned design of policy-based lending

• Chile and Uruguay: prompted review of lending instruments for higher

middle-income borrowers

• Haiti (2016): will review results of IDB’s intensive support ($200m/yr)

Evaluation Capacity Development

• Multi-donor trust fund (World Bank,

IDB, Dfid, SIDA, Rockefeller

Foundation, others)

• Six CLEAR centers to date

• 2 LAC CLEAR centers supported by

IDB: CIDE in Mexico City (Spanish)

and Getulio Vargas in Sao Paulo

(Portuguese)

Multi-donor initiative:

Centers for Learning on Evaluation and Results (CLEAR)

THANK YOU!

Visit us at:

www.iadb.org/evaluation