GOVERNMENT OF ROMANIAGOVERNMENT OF ROMANIAMINISTRMINISTRY OF PUBLIC FINANCEY OF PUBLIC FINANCE

MANAGING AUTHORITY FOR COMMUNITY MANAGING AUTHORITY FOR COMMUNITY SUPPORT FRAMEWORKSUPPORT FRAMEWORK Evaluation Central UnitEvaluation Central Unit

Development of the Evaluation Development of the Evaluation Community in RomaniaCommunity in Romania

EvaluationEvaluation driverdriver

•Chapter 28 – Financial controlChapter 28 – Financial control•Chapter 21 – Regional policyChapter 21 – Regional policy•Political criteria – increasing Political criteria – increasing the accountability of the the accountability of the Public Administration; Public Administration; enhancing policy formulationenhancing policy formulation

– European CommissionEuropean Commission– Civil Society/mediaCivil Society/media

The strategy of public The strategy of public policypolicy

• To develop a simple and efficient system To develop a simple and efficient system for formulation of public policiesfor formulation of public policies– Setting the structure and the role of each Setting the structure and the role of each

public policy documentpublic policy document– Defining the hierarchy between the Defining the hierarchy between the

documentsdocuments– Defining the link between national and Defining the link between national and

sectoral public policiessectoral public policies– Introduction of Introduction of impact analysisimpact analysis of the public of the public

policiespolicies• It is coordinated by the Secretariat It is coordinated by the Secretariat

General of the GovernmentGeneral of the Government

Raising Raising Awareness on Awareness on

evaluationevaluation• Action Plan for raising awareness on evaluationAction Plan for raising awareness on evaluation

– May – June 2006May – June 2006– 6 conferences on evaluation for specific target 6 conferences on evaluation for specific target

groupsgroups– Focus on utility of evaluation, international Focus on utility of evaluation, international

experience with evaluation, EU requirements experience with evaluation, EU requirements concerning evaluationconcerning evaluation

– The booklet “Evaluation – essential component in The booklet “Evaluation – essential component in the European process of public interventions the European process of public interventions formulation and implementation”formulation and implementation”

– Questionnaire elaborated and distributedQuestionnaire elaborated and distributed

Private market Private market development – first development – first

stepssteps•35 potential evaluators selected from local 35 potential evaluators selected from local

consultancy companies, universities and NGOsconsultancy companies, universities and NGOs•Purpose: Purpose: Romanian organisations in the private, Romanian organisations in the private,

academic and civil society sectors will be able to, academic and civil society sectors will be able to, in the coming years:in the coming years:

tender for evaluation contracts commissioned by tender for evaluation contracts commissioned by the European Commission, the Ministry of Public the European Commission, the Ministry of Public Finance, and other Government Ministries and Finance, and other Government Ministries and public bodiespublic bodies

successfully carry out the evaluation contracts to successfully carry out the evaluation contracts to qualitative standards.qualitative standards.

Others to be Others to be done in 2006done in 2006

• Evaluation Working Group for Structural Evaluation Working Group for Structural InstrumentsInstruments– Designing the model of interim evaluationDesigning the model of interim evaluation– Steering the ex-ante evaluation of the operational Steering the ex-ante evaluation of the operational

programmesprogrammes– Evaluation standardsEvaluation standards– Evaluation procedures, including the setting up of the Evaluation procedures, including the setting up of the

evaluation functions inside the managing authoritiesevaluation functions inside the managing authorities

• Translation in Romanian and distribution of the Translation in Romanian and distribution of the Guide for evaluation of socio-economic Guide for evaluation of socio-economic development programmesdevelopment programmes

• THE NATIONAL EVALUATION STRATEGYTHE NATIONAL EVALUATION STRATEGY

Steps to developing Steps to developing the National the National

Evaluation StrategyEvaluation StrategyPrincipal stages:Principal stages:

Assessment of the Romanian evaluation Assessment of the Romanian evaluation culture (to mid-July) culture (to mid-July)

Engage in consultations with main Engage in consultations with main stakeholdersstakeholders

Drafting the National Evaluation Strategy Drafting the National Evaluation Strategy (based on best-practice from other MS(based on best-practice from other MS

Disseminate draft for comment (to end Disseminate draft for comment (to end AugustAugust

Finalise and launch NES (September)Finalise and launch NES (September)

Assessment of the Assessment of the Romanian evaluation Romanian evaluation

cultureculture Assessment against EU “9+3” criteria (identified in “International Atlas on Assessment against EU “9+3” criteria (identified in “International Atlas on

Evaluation”). The criteria include:Evaluation”). The criteria include:

• Evaluation takes place in many policy domainsEvaluation takes place in many policy domains• There is a There is a supply of domestic evaluators in different disciplinesupply of domestic evaluators in different discipline• There is a There is a professional organisation of evaluatorsprofessional organisation of evaluators• There is a There is a degree of institutionalisation of evaluation in Governmentdegree of institutionalisation of evaluation in Government• There is a There is a degree of institutionalisation of evaluation in Parliamentdegree of institutionalisation of evaluation in Parliament• There is a There is a pluralism of institutions or evaluators performing pluralism of institutions or evaluators performing

evaluations within each policy domainevaluations within each policy domain• There is an There is an evaluation function within the Supreme Audit Institution.evaluation function within the Supreme Audit Institution.

The three additional criteria for candidate countries are:The three additional criteria for candidate countries are:

1.1. There is There is monitoring capacitymonitoring capacity2.2. There is There is diversity of evaluation: strategy, policy, programme, projectsdiversity of evaluation: strategy, policy, programme, projects3.3. There is There is an information flow within government relating to evaluationan information flow within government relating to evaluation ..

The National The National Evaluation StrategyEvaluation Strategy

Assessment will be of both demand and supply side:Assessment will be of both demand and supply side:

level of evaluation activity and capacity at both the level of evaluation activity and capacity at both the local and central levels of governments, for all local and central levels of governments, for all publicly-funded interventions, regardless of funding publicly-funded interventions, regardless of funding source (e.g. EU, national budget, etc.)source (e.g. EU, national budget, etc.)

Level of evaluation activity and capacity within the Level of evaluation activity and capacity within the academic, civil society and private sectorsacademic, civil society and private sectors

Will identify gaps in evaluation knowledge and Will identify gaps in evaluation knowledge and capacitycapacity

Will outline some potential policy choices to be Will outline some potential policy choices to be further elaborated in the NES draft documentfurther elaborated in the NES draft document

National National Evaluation Evaluation StrategyStrategy

• The draft NES will take into account:The draft NES will take into account:

– the “the “Strategy for improving the public policy Strategy for improving the public policy planning and formulation system at central level’’planning and formulation system at central level’’

– Assessment of the Romanian evaluation legal Assessment of the Romanian evaluation legal frameworkframework

– Evaluation models proposed for the 2007-2013 NSRF Evaluation models proposed for the 2007-2013 NSRF and OP processand OP process

– Twinning support to Parliament on impact Twinning support to Parliament on impact assessment of legal actsassessment of legal acts

• Taking into account external environment, Taking into account external environment, and experience of other EU Member States, and experience of other EU Member States, the NES will primarily focus on development the NES will primarily focus on development of evaluation culture rather than on systems.of evaluation culture rather than on systems.

The National The National Evaluation Evaluation StrategyStrategy

- - This will include:This will include:

– Roadmap of further evaluation capacity Roadmap of further evaluation capacity buildingbuilding

– Training, guidelines, national “society of Training, guidelines, national “society of Romanian evaluators”Romanian evaluators”

– Liaison with the wider evaluation community Liaison with the wider evaluation community (civil society, Universities, etc.)(civil society, Universities, etc.)

– Other capacity building activitiesOther capacity building activities

• By 2010, NES should outline the milestones to By 2010, NES should outline the milestones to develop systems for incorporation of evaluation develop systems for incorporation of evaluation practices into all publicly-funded programmes practices into all publicly-funded programmes

The National The National Evaluation Evaluation StrategyStrategy

- - This will include:This will include:

– Roadmap of further evaluation capacity Roadmap of further evaluation capacity buildingbuilding

– Training, guidelines, national “society of Training, guidelines, national “society of Romanian evaluators”Romanian evaluators”

– Liaison with the wider evaluation community Liaison with the wider evaluation community (civil society, Universities, etc.)(civil society, Universities, etc.)

– Other capacity building activitiesOther capacity building activities

• By 2010, NES should outline the milestones to By 2010, NES should outline the milestones to develop systems for incorporation of evaluation develop systems for incorporation of evaluation practices into all publicly-funded programmes practices into all publicly-funded programmes

ImplementaImplementation of the tion of the NESNES

PHARE 2005 – PHARE 2005 – €2m€2m- ““DeDevelopment of a Professional velopment of a Professional

EEvaluavaluation Communitytion Community” ” able to initiate, able to initiate, perform and use evaluations perform and use evaluations – – €1m€1m- Target groupTarget group

- Public administrationPublic administration- Evaluation firmsEvaluation firms / evaluator / evaluatorss- Support organizationsSupport organizations – profes – professsionalional

organizationsorganizations//networksnetworks, academic, academic environment environment- ActivitiesActivities::

- Evaluation guidelinesEvaluation guidelines, procedur, procedures andes and standard standardss- Ethics codesEthics codes- Developing competencesDeveloping competences – – establishing establishing

evaluation curriculaevaluation curricula, , training activitiestraining activities

ImplementaImplementation of tion of the NESthe NES

- ““Evaluation Evaluation FacilitFacilityy”” – – €€11mm

- Main objectiveMain objective: : encouraging public encouraging public bodies to initiate and use evaluations of bodies to initiate and use evaluations of their own interventionstheir own interventions

- Secondary objectiveSecondary objective: know-how : know-how transfer transfer to the indigenous evaluation marketto the indigenous evaluation market

- MACSF ECU will be highly involved in the MACSF ECU will be highly involved in the implementation, quality assurance implementation, quality assurance activities and supporting the activities and supporting the implementation of the evaluation implementation of the evaluation recommendationsrecommendations