On the organization and conduct of expert examination in science and technology in the USA and the European Union Scientific Research

On the organization and conduct of expert examination in science and technology in the USA and the

European Union

http://www.extech.ru

Scientific Research Institute – Federal Research Center for Project Evaluation

and Consulting Services (SRI FRCEC)

Director of Department of Information-Analytical Center for Complex Scientific Research of

Scientific&Technological and Innovation Activity (IAC KINTID) of SRI FRCEC

Alexei B. Logunov

2Scientific Research Institute - Federal Research Center for Project Evaluation andConsulting Services (SRI FRCEC)


1-st version of classification of the advisory committees of the USA:On political issues. Gives recommendations in the field of policy planning on the national level.Non-scientific programs.Scientific and technological programs.Grants (recommendations on issuance of grants and awards).On national regulation.Other Committees (either included in several categories, described above, or not included into any of them).On Specific Issues.

2-nd version of classification of the advisory committees of the USA:Expert (created with the aim of providing recommendations and conclusions on issues within the sphere of responsibility of executive power Bodies); Policy Development (deals with social aspects of policy, including regulation and conduct of political dialogues based on consideration of the views of a large number of stakeholders);Regional (does not deal with national issues, but with a certain geographic area which is most typical, for example, for negotiating the issues of ecology and environmental protection; and includes a large number of practitioners and public representatives).

Classification of the Advisory Committees of the USA

3Scientific Research Institute - Federal Research Center for Project Evaluation



Expert Examination at the US National Science Foundation

Selection of applicationSelection of application

Scientific communityScientific

community

National Scientific Foundations (NSF)National Scientific Foundations (NSF)

Manager of NSF Programs

Manager of NSF Programs

Internal Evaluations

Internal Evaluations

Expert PanelExpert Panel

Combination of internal and

panel evaluation

Combination of internal and

panel evaluation

Manager of NFS Programs

Manager of NFS Programs

Department of grants and business

expert examination


expert examination


expert examination


expert examination


expert examination


expert examination

fault

accept




Assessment of the Project level is according to the following issues:

1.The importance of research proposed for knowledge development and understanding of the problem inside the given sphere of science or several spheres of science simultaneously.2.The skill level of the applicant.3.The extent to which the research proposed is a “breakthrough”.4.How justified is the proposed research?5.Are there sufficient resources to carry out the research?

Evaluation of applications at the US National Science Foundation

Scientific LevelScientific Level

Criteria of Project EvaluationCriteria of Project Evaluation

Possibility of wide spreading (implementation) of results

Possibility of wide spreading (implementation) of results




1. Selection of assessment panel members based on application links, recent publications in scientific journals, bibliographic databases, etc.;

2. Verification of presence of the conflict of interests including in the selection of panel members. Each of the program managers annually passes training on this issue;

3. Synthesis of conclusions and comments of experts;

4. Drafting of recommendations on grant issuing of rejecting of application, including the consideration what kinds of research are funded by other departments of NSF.

Tasks of the Program Manager of National Science Foundation



Types of Groups of Experts

Types of Groups of Experts

FormalFormal

InformalInformal

PermanentPermanent

TemporaryTemporary

Functions of Expert GroupsFunctions of

Expert Groups

Playground for brainstorming and forum

for exchange of views

Playground for brainstorming and forum

for exchange of views

Generating recommendations for

European Commission

Generating recommendations for

European Commission

Chairman (EC Representative)Chairman (EC

Representative)

Experts serving in their personal

capacity

Experts serving in their personal

capacity

Members of Expert Groups

Members of Expert Groups

Experts representing the interests of the organizations

Experts representing the interests of the organizations

Authorities of EU Member States

Authorities of EU Member States

Organizations (companies,

associations, IGOs and NGOs, trade

unions, universities, ЕС Agencies)

Organizations (companies,

associations, IGOs and NGOs, trade

unions, universities, ЕС Agencies)

Created by EC services

Created by EC services

Work of Expert Groups

Work of Expert Groups

Single Register Of

Expert Groups is conducted

Single Register Of

Expert Groups is conducted

Experts’ work is free of charge,

transport expenses

reimbursed

Experts’ work is free of charge,

transport expenses

reimbursed

Sub-groups may be created

Sub-groups may be created

Organization of expert work of the European Commission



European Commission continues to search for experts for Program "Horizon 2020" The European Commission has called on Expert Community to take part in formation of competition topics for the future EU Program of funding research and innovation «Horizon 2020» for (2014 – 2020). The European Commission expects experts in different fields to help develop innovation ideas, create sustainable growth and new jobs in Europe. Expert groups will be set up in priority areas of research (such as climate change, renewable energy, food security and solving aging problems). They will help the authorities to establish the dialogue with representatives of civil society and business communities of EU Member States, as well as be able to influence the allocation of EU funding of research and innovations within the framework of “Horizon 2020” Program. Experts can register on website: http://ec.europa.eu/research/horizon2020/index_en.cfm?pg=h2020-experts

Invitation for participation in forming of research topics within the framework of EU Program «Horizon 2020» (2014 – 2020)

Thank You for Your Attention!


Scientific Research Institute - Federal Research Center for Project Evaluation andConsulting Services (SRI FRCEC)

8

Documents

On the organization and conduct of expert examination in science and technology in the USA and the European Union Scientific Research