15
Indian and Northern Affaires indiennes Affairs Canada et du Nord Canada Performance Measurement and the New Federal Framework for Aboriginal Economic Development Canadian Evaluation Society Conference Victoria, British Columbia May 3-5, 2010

Performance Measurement and the New Federal Framework for ... · Logic model Linkages between ... Last policy framework for Aboriginal economic development ... Federal Framework for

Embed Size (px)

Citation preview

Indian and Northern Affaires indiennesAffairs Canada et du Nord Canada

Performance Measurement and the New Federal Framework for

Aboriginal Economic Development

Canadian Evaluation Society ConferenceVictoria, British Columbia

May 3-5, 2010

OUTLINEIntroduction

Why measure performance?

Performance measurement in the Federal Government

Performance measurement at Indian and Northern Affairs Canada (INAC)

New Federal Framework for Aboriginal Economic Development

Framework origins and description

Approach to Framework Performance Measurement Strategy

Lessons learned

2

To know your destination, how to get there and to avoid surprises!

3

WHY MEASURE PERFORMANCE?

PERFORMANCE MEASUREMENT IN THE FEDERAL GOVERNMENTNew roles and responsibilities introduced under Transfer Payment Policy (2008) and Evaluation Policy and Directive (2009):

Deputy Minster responsible for ongoing performance measurement throughout the department in support of program evaluation

Director of Evaluation to provide advice on Performance Measurement Strategies (PM Strategy) and submit an annual report on the state of performance measurement

Program Managers must develop and implement a Performance Measurement Strategy to ensure credible and reliable performance data are being collected

4

Performance Measurement

Strategies

MANAGING FOR RESULTS

5

Program profilePublic relevance, objectives, alignment with PAA, target population, stakeholders, governance, resources

Logic modelLinkages between inputs, activities, outputs, outcomes, assumptions, PAA linkages

Performance indicator matrix (for ongoing monitoring)PAA linkages, indicators for outputs and outcomes, targets, frequency, link with evaluation questions

Implementation planDetailed data collection plan, including warehousing and access, collection roles and responsibilities; frequency, reporting commitments; and indicator templates

Risk AssessmentProgram risks identified and assessed and risks related to PM identified; mitigation strategies and challenges also identified

Evaluation strategyRequirements, timelines, responsibilities, draft evaluation matrix with core evaluation issues, level of effort tailored to program risks and characteristics

PM STRATEGY KEY ELEMENTS

6

Trend Analysis of OAG Audits and INAC Evaluations (2005)Audits and evaluations completed between 2000 and 2005 contained recommendations that have been first and foremost about implementing and/or improving performance measurement, monitoring and reporting

RMAF Study (summer 2008) Found some INAC RMAFs had weak logic models, emphasized outputs versus outcomes, data sources and responsibility for data collection not clearly defined, data only being collected for 43% of performance indicators

State of Performance Measurement Benchmark Study (2009)INAC assessed against 10 key characteristics of organizations that measure results well

PERFORMANCE MEASUREMENT AT INAC

7

INAC PM STRATEGY IMPLEMENTATION1. Benchmark (where we are) and Plan (where we want to be)

PM Strategies integrated into 5 year Evaluation Plan

2. Engage Senior Management (leadership is critical)Governance framework established, including Evaluation, Performance Measurement and Review Committee (EPMRC)

3. Build capacity (it’s about culture change)Develop support tools (e.g. Guidance and Templates; Thematic Indicators Study; PM Strategy Models and best practises)

4. Collaborative model (measuring results is a shared responsibility)

Internal Services experts support team (SPPD, SRAD, IMB, EPMRB, CFO). Expanding collaboration

5. Measure / Assess progressImplementation monitoring

8

FRAMEWORK ORIGINSLast policy framework for Aboriginal economic development released in 1989 as the Canadian Aboriginal Economic Development Strategy (CAEDS)

Conditions, needs, opportunities and relationships associated with Aboriginal Canadians and economic development have changed significantly in the past twenty years

In June 2009, the Government of Canada launched the new Federal Framework for Aboriginal Economic Development

9

THE FRAMEWORK: AT A GLANCE

10

PM Strategy: Dec ‘09

PM Strategy: May ‘10

PM Strategy: June ‘10

PM Strategy: Winter ‘11

PM Strategy: May ‘10

PM Strategy: May ‘10

11

Loan Loss Reserves &

Major Resources and Energy

Development Initiative

Addition to Reserve

Reserve Land and

Environment Management

Program

Procurement Strategy for Aboriginal Business

Strategic Partnership

Initiative

Lands and Economic

Development Programs

The Federal Framework for Aboriginal Economic Development

FRAMEWORK-RELATED PM STRATEGIES

FRAMEWORK OUTCOMES

12

Aboriginal Human Capital

Cooperation and

Collaboration

Aboriginal Entrepreneurship

Enhanced Value of Aboriginal

Assets

Strategic Federal

Investments

A Skilled Aboriginal Workforce

Opportunity Ready Communities

Viable Aboriginal Businesses

Increased participation of Aboriginal Canadians in the economy

APPROACH TO THE FRAMEWORK PM STRATEGY

To develop an overarching PM Strategy for the Framework a Working Group with representatives from each Framework-related program was established in Fall ’09

Met weekly to provide input and feedback on the Framework logic model and performance indicators and peer reviewed individual PM Strategies

EPMRB provided ongoing advice, guidance, and support to the Working Group and also worked individually with program areas to develop initiative-level PM Strategies

EPMRB engaged internal services partners

Framework PM Strategy approved in December 2009 along with Loan Loss Reserve & Major Resource and Energy Development Investments

13

LESSONS LEARNEDClustering of related initiatives

Increased cooperation and understanding between programs, allowed for identification of common outcomes, and identified opportunities for reduced reporting burden

Capacity buildingAll Framework PM Strategies developed in house with advice and guidance from EPMRB and other internal partners

Collaborative approachWorking Group engaged INAC’s Aboriginal economic development branches and other internal partners

Senior leadership The CAEE and Evaluation Performance Measurement and Review Committee approved PM Strategies

14

Evaluation, Performance Measurement and Review Branch, INAC

Jason PelletierTel: (819) 997-9146

E-mail: [email protected]

Britt WatsonTel: (819) 953-2516

E-mail: [email protected]

Policy and Coordination Branch, INAC

Kelly MooreTel: (819) 953-7337

E-mail: [email protected]