www.uis.unesco.org
UIS activities in the collection and analysis of
R&D indicators
WHO workshop - monitoring R&D resource flows
London, UK
14 February 2013
www.uis.unesco.org
Global survey on Research and
Development (R&D) Statistics
Forms part of the Institute's strategy to improve its statistical programme and to develop and deliver timely, accurate and policy-relevant statistics.
Objective: to collect the most recent data on resources devoted to R&D: R&D Personnel and R&D Expenditure.
Follow the OECD Frascati Manual guidelines.
Expected to capture data on all institutions carrying out R&D activities (all sectors of performance, all fields of science).
Biennially: 2004, 2006, 2008 and 2010 R&D surveys completed. 5th round was launched in June 2012.
Survey cycle: around 9 months
www.uis.unesco.org
Global survey on Research and
Development (R&D) Statistics conti…
Data and metadata released on UIS website (UIS Data Centre: http://stats.uis.unesco.org) and also contribute to other agencies.
Data are available from 1996 onwards.
UIS sends the questionnaire to around 140 countries and territories.
OECD and Eurostat provide data for their Member States (44 countries).
RICYT provides data for Latin America and for a few Caribbean countries (19 countries).
A joint data collection with the AU/NEPAD African STI Indicators (ASTII) Initiative is under discussion (28 countries in ASTII Phase 2; leads to production of African Innovation Outlook 2013).
www.uis.unesco.org
UIS 2010 and 2012 R&D Surveys:
response rates & published data
Regions
(Countries and Territories covered)
Effective
responses
Q 2010
Effective
responses
Q 2012*
Data published
based on all
surveys since 2004
(by June 2012)
Sub-Saharan Africa (45) 12 27% 30%
7 16% 15%
31 69% 69%
Arab States-Africa (9) 4 44% 1 11% 6 67%
Asia (31, excl. Arab States & OECD) 16 52% 51%
11 35% 33%
24 77% 67%
Arab States - Asia (12) 6 50% 3 25% 5 42%
Americas (14, excl. RICYT & OECD) 0 0% 1 7% 4 29%
Europe (16, excl. OECD & Eurostat) 7 44% 4 25% 11 69%
Oceania (17, excl. OECD) 0 0% 0 0% 3 18%
Sub-total (143) 45 31% 27 19% 84 58%
Data from other sources:
OECD + Eurostat (44) 44 100% 44 100% 44 100%
RICYT (26, incl. 10 Caribbean) 19 73% 19 73% 19 73%
Total (214) 108 50% 90 42% 147 69%
Note: Effective responses: number of returned questionnaires with data. *being conducted
www.uis.unesco.org
R&D Survey: Data collection
R&D Personnel
By occupation, sector of employment,
qualification, and field of science
(incl. Medical and health sciences)
In headcount and Full-time
equivalents (FTE); By gender
R&D Expenditure
By sector of performance and source
of funds
By field of science, type of costs and
type of activity
Metadata
Contact details, scope/coverage,
methodologies followed
www.uis.unesco.org
Challenges/limitations of data from
developing countries: data gaps/quality
• Lack of data from Pacific, Caribbean, Sub-Saharan
Africa (improving), Arab States (improving).
• Lack of coverage (data from Business enterprise and
Private non-profit sectors are under-reported).
• Lack of data related to R&D Personnel in Full-time
equivalents (FTE). E.g. CIS countries.
• Lack of comparability with Frascati Manual guidelines.
E.g. secondary data from budget instead of actual R&D
expenditure.
• Unavailability of all data by some breakdowns.
E.g. By field of science (SSH), types of activity.
• Lack of time series data: frequency of national surveys;
biennial UIS R&D survey.
www.uis.unesco.org
Challenges/limitations of data from
developing countries: data collection
Discussed in UIS Technical Paper 5: Measuring
R&D: Challenges Faced by Developing Countries.
• Structural issues: Lack of interest/understanding of
importance of S&T (indicators), lack of political will and
action, lack of coordination, lack of technical knowledge,
lack of trained personnel, weak statistical institutions.
• Measurement problems:
» Budget data vs. surveys
» Measuring “real effort” (full-time equivalents)
» Private sector R&D
» Specific fields of R&D activity (e.g. Clinical trials)
» Role of foreign internationally controlled entities
www.uis.unesco.org
Opportunities to expand/improve data
and ability to compare data
Data sharing with other partner institutions.
Capacity building: STI statistics workshops:
Regional, National (targeted countries).
Methodological developments:
• Measuring R&D in Developing Countries: Technical
Paper and Annex to the Frascati Manual (2010).
• Guide for the conduct of R&D Surveys in Developing
Countries: 2012-2013.
Annual UIS R&D Survey with more breakdowns +
shorten the survey cycle.
www.uis.unesco.org
Extra slides
www.uis.unesco.org
A snap-shot of R&D intensity.
Gross domestic expenditure on R&D (GERD) as a
percentage of GDP, 2010 or latest available year
0.00%–0.25%
0.26%–0.50%
0.51%–1.00%
1.01%–2.00%
Data not available
2.01% and above
Source: UIS, Oct 2012
www.uis.unesco.org
What are the national research densities?
Researchers per million inhabitants, 2010 or
latest available year
0–100 per million
101–300 per million
301–1000 per million
1001–2000 per million
Data not available
2001 per million and above Note: Data in this map are based on FTE. However, figures in headcounts (HC) were considered for the following countries since
the FTE figures were not available: Armenia; Azerbaijan; Bangladesh; Belarus; Benin; Botswana; Cameroon; Central African
Rep.; Cuba; Dem. Rep. of the Congo; El Salvador; Gabon; Gambia; Georgia; Guinea; Honduras; Jordan; Kazakhstan;
Kyrgyzstan; Libya; Mauritius; Mongolia; Montenegro; Nauru; Nicaragua; Peru; Saint Lucia; Saint Vincent and the Grenadines;
Saudi Arabia; Sudan; Tajikistan; Tanzania; Trinidad and Tobago; Uganda and U.S. Virgin Islands. This has to be taken into
account when interpreting the data. Source: UIS, Oct 2012
www.uis.unesco.org
Researchers by field of science, 2010 or latest
available year: Americas
Source: UIS, Oct 2012 Note: *only aggregated breakdowns are available (NSE and SSH). Data in this graph are based on
FTE data (# based on HC data). -1=2009, -2=2008, -3=2007, -5=2005, -7=2003.
www.uis.unesco.org
Researchers by field of science, 2010 or latest
available year: Europe
Source: UIS, Oct 2012 Note: *only aggregated breakdowns are available (NSE and SSH). Data in this graph are based on
FTE data (# based on HC data). -1=2009, -2=2008.
www.uis.unesco.org
Researchers by field of science, 2010 or latest
available year: Africa, Asia and the Pacific
Source: UIS, Oct 2012 Note: *only aggregated breakdowns are available (NSE and SSH). Data in this graph are based on
FTE data (# based on HC data). -1=2009, -2=2008, -3=2007, -4=2006, -5=2005, -8=2002.
www.uis.unesco.org
GERD by field of science, 2010 or latest
available year: Americas
Source: UIS, Oct 2012
Note: *only aggregated breakdowns are available (NSE and SSH). -1=2009, -2=2008, -7=2003.
www.uis.unesco.org
GERD by field of science, 2010 or latest
available year: Europe
Source: UIS, Oct 2012 Note: *only aggregated breakdowns are available (NSE and SSH). -1=2009, -2=2008, -3=2007, -
8=2002, -11=1999.
www.uis.unesco.org
GERD by field of science, 2010 or latest
available year: Africa, Asia and the Pacific
Source: UIS, Oct 2012 Note: *only aggregated breakdowns are available (NSE and SSH). -1=2009, -2=2008, -3=2007, -
4=2006, -5=2005, -9=2001.
www.uis.unesco.org
GERD and Health R&D expenditure as a
percentage of GDP, 2010 or latest available year
Source: UIS, Oct 2012 Note: -1=2009, -2=2008, -3=2007, -4=2006.
Rep.of Korea
Switzerland-2
Iceland-2
Singapore-1
Australia-2
Slovenia
Portugal
EstoniaCzech Rep.
Hungary
Russia
SpainSouth Africa-2
Serbia-1
China-1Ukraine-1
Turkey
LithuaniaCroatia
India-3Poland
Belarus-1
Malaysia-4
Slovakia
Argentina-1
Malta
Costa Rica-1
Bulgaria
Moldova-1
Cyprus
RomaniaLatviaUganda-1
Mexico-1
Chile-2Uruguay-1
Armenia-1
Ecuador-2
Azerbaijan-1
EthiopiaMongolia-1
Macedonia-2
Nigeria-3
Thailand-3Mozambique-3
Kyrgyzstan-1Bolivia-1
Madagascar-1Sri Lanka-2
Tajikistan-1
Macao-1
El Salvador-1
Paraguay-2
Guatemala-1
Trinidad&Tobago-1
-
0.1
0.2
0.3
0.4
0.5
0.6
- 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0
He
alth
R&
D e
xpe
nd
itu
re a
s %
of
GD
P
GERD as % of GDP
www.uis.unesco.org
Measuring R&D in Developing Countries:
Annex to the Frascati Manual (2010 / 2011)
UIS TP5: http://www.uis.unesco.org/Library/Documents/tech%205-eng.pdf
FM Annex:
http://www.oecd.org/science/innovationinsciencetechnologyandindustry/49793555.pdf
www.uis.unesco.org
Chapter 5: Specific fields of R&D activity:
Clinical trials
Frascati Manual: clinical trial phases 1, 2 and 3
are considered as R&D; but under-reported.
Internationalization and outsourcing of R&D
Decentralization of laboratories, activities of
pharmaceutical companies
Need to be conducted on a wide population
Growth area for developing countries
(Can) involve a significant amount of R&D
www.uis.unesco.org
Clinical trials conti…
Measurement of clinical trials
Registers of clinical trials available, e.g. WHO but also
national level
Funding often from abroad
Distributed among a number of local parties/performers:
• a local branch of the foreign main sponsor
• universities and university hospitals
• individual researchers
• local medical clinics
• locally registered PNPs
• international PNPs
www.uis.unesco.org
Clinical trials conti…
Measurement issues and recommendations
Occupation category of local staff
• Medical doctors and other professionals with at least
ISCED 5A degrees who are involved in phases 1 to 3
clinical trials should be considered researchers;
• Nurses and other staff with qualifications below ISCED
5A should be categorised as technicians.
FTE calculation is important (often part-time)
Attribution of sector of performance must be done
with care to avoid double counting
www.uis.unesco.org
UNESCO Institute for Statistics (UIS)
Formerly UNESCO Office of Statistics; Division of
Statistics on S&T.
Established in 1999; September 2001 - the UIS
moved from Paris to Montreal.
UIS presence in the regions at UNESCO offices.
United Nations data repository for:
• Education
• Science, Technology and Innovation (STI)
• Culture
• Communication
www.uis.unesco.org
Lines of action of STI programme
1. STI survey operation and data guardianship
1.1 Research and Development (R&D) Survey
1.2 Innovation Survey
2. Training on STI statistics: workshops & other
training activities
3. Standard setting and methodological
developments
4. Analysis and publications
www.uis.unesco.org
UIS is the UN lead agency for S&T statistics
Official S&T data source for:
• World Bank: World Development Indicators
• UN Statistical Division: UN Statistical Year Book
• UNDP: Human Development Report
Data publicly available at: http://stats.uis.unesco.org.
UIS Publications (can be downloaded from the UIS website): S&T Bulletins; Fact sheets, e-Atlas on R&D statistics
UNESCO Reports:
• UNESCO Science Report
• UNESCO World Report - Towards Knowledge Societies
• International Report on S&T and Gender
• History of Science Statistics at UNESCO