Michael Kahn Research & Innovation Associates, Cape Town,

South Africa

Measuring the Social Sciences Standing Committee on the Social Sciences

European Science FoundationBath, 21-23 October 2009

This presentation

• The task

• Issues

• Quantifying Social Science: the EU-27

• Improving the data

Contribute to WSSR 2009/10: “Measure for measure: quantifying the social sciences”

Go beyond the data of the WSSR 1999 - OECD 29 countries; EU-15

WSSR 2009/10: OECD 30; EU-27 + other large performers

Financials; equity; personnel inc. gender; graduate flows & outputs & scientific publications

Main sources: OECD, Eurostat, UNESCO Institute for Statistics. RICYT (Latin America); national orgs; commercial databases

The task

Covers 29 OECD member states

Sought to quantify scale of inputs; graduates; Frascati Manual R&D definition and collection guidelines

SS R&D financials for 21 countries; personnel data for 19 – excludes large systems: FR, US, UK, KR, and smaller - CZ, GR, IT, LX, NZ, SL.

Commentary on the practice of SS; notes ‘Data … often not very accessible to researchers”; identifies blurring of SS/H boundary as problem

“Social Sciences in OECD” (Oba, WSSR 1999)

WSSR 1999: Social Sciences in the OECD

Frascati 6th Ed 2002: ‘creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of knowledge to devise new applications’

Recognizes increasing role of Services sector

Basic, applied research, experimental development

Related STAs excluded

Clinical trials; software development … IN

Much Social Science activity OUT

Issues: What counts as R&D

Sectors: BUS, GOV, HE, NPO - boundary issues

In-house BERD; GOVERD, HERD, NPOERD GERD

Expenditure = capex + labour + other current

Sources of Funds

GERD: GDP

Expenditure by region; Regional ERD: Gross geographic product

Expenditure by accounting category; type; region; Field of Science; Socio-economic Objective

Issues: Financials

ESF OECD definition agree; UNESCO education =outside; national bodies ‘do it my way’

Headcount (HC)

Full-time equivalent (FTE)

Technicians; Other staff labour cost

Qualifications; Gender, Age, Nationality

Doctoral students; ; Research Assistants IN

Research Masters students OUT

Personnel

FTE by gender per Field of Science (FoS)

Research collaboration

Expenditure by priority area

Mobility data

Other items

BERD difficult to compute purposive survey

SS often excluded from BERD: “designed out”

But SS important in Services; >60% GDP

R&D in Services 40% BERD in AU; 25% UK

And R&D tax incentives may exclude SS

HERD and GOVERD by census;

NPO purposive – boundaries porous

FTE “must” be < 100%; estimation; diary studies

Doctoral, postdocs, research assistants – FTE?

Problems

The Story: Researchers in SS

25: Czech Republic, Hungary, Poland, Romania, Russian Federation, the Slovak Republic, Slovenia, Turkey, Mexico, Chinese Taipei, Japan, Singapore, Austria, Belgium, Canada, Denmark, Germany, Ireland, Italy, Luxembourg, Netherlands, Norway, Portugal, Spain, and Sweden

17 EU; 20 OECD

Of top five R&D performing nations, only DE and JP have official data

OECD, 2006 (MSTI 2009/1)  1999 2000 2001 2002 2003 2004 2005 2006

Australia .. 39507 .. 42780 .. 47417 .. 50934Austria .. .. .. 6977 .. 8281 8944 9261Belgium 11673 11778 12034 12066 12389 13549 13853 14417Canada 33020 33300 34200 34910 38900 41380 43420 ..Czech Republic 3380 3768 4249 4283 4318 4274 7575 8352Denmark 5722 5866 6105 7379 7669 7846 8242 8763Finland 10555 10999 11008 12391 13033 13037 12879 12849France 56717 61583 62427 63555 64403 65498 66290 67935Germany 66695 67087 67962 71292 68243 65764 65363 66903Greece 10471 .. 8544 .. 9072 .. 11356 12110Hungary 4768 5852 5938 5999 5957 5902 5911 6073Iceland 480 .. 515 .. 562 .. 585 663Ireland 2286 2148 2473 2797 3474 4151 4400 4672Italy 25209 25696 27146 28301 27774 28226 37073 37636Japan 178418 179116 200272 170512 172396 177421 180494 184319Korea 21723 23674 23083 24953 26419 25522 27416 28386Luxembourg .. 22 30 .. 30 143 157 159Mexico 10648 .. .. .. 17135 16043 16691 ..Netherlands 12491 15480 15750 10448 10211 10545 10661 10931New Zealand 4996 .. 8655 .. 9955 .. 11731 ..Norway 5521 .. 5670 .. 6251 6800 7512 7870Poland 35284 34246 35827 37275 38455 39716 40449 37653Portugal 8242 8592 8942 9502 10062 10509 10956 12026Slovak Republic 4254 5009 4891 4629 5273 6509 6458 7370Spain 33840 42064 46964 45727 49196 51616 54028 55443Sweden 14623 .. 15851 .. 17146 17794 15125 14740Switzerland .. 9425 .. 11240 .. 12335 .. 12710Turkey 14621 16902 16798 17544 24226 24742 25434 26713United Kingdom .. .. .. .. .. .. 67719 69499United States 186049 .. .. .. .. .. .. ..

Little change since 1999

RESEARCHERS   BUS HIGHER ED GOV NPO    TOT SET SSH TOT SET SSH TOT SET SSH TOT SET SSH

Bulgaria HC 1251    3894    6472    303     FT 1157    2607    6076    128   Czech Republic HC 12120 11753 547 17411 12074 4707 8361 6703 1658 100 44 56  FT 10354 10107 247 7576 5688 1888 6113 4778 1335 127 34 93Estonia HC 1402    3618    622           FT 883    1905    474         Hungary HC 6108 5950 158 19086 9948 9138 6213 4131 2082       FT 5008 4875 133 5911 3304 2607 4959 3536 1423     Latvia HC 606    4368    773           FT 468    2224    589         Lithuania HC 916    9124    1878           FT 716    5116    1805         Poland HC 11403 11259 133 72261 46111 25795 14094 12750 1344 117 27 90  FT 9412 9297 115 40449 26525 13924 12175 10956 1219  51 76Romania HC 10644    11492 9879 1613 7267 4744 2523 205 182 23  FT 10319    5386 4772 614 7082 4644 2438 171 148 23Slovak Republic HC 2414 2260 154 12249 8105 4144 2845 2162 683 18 17 1  FT 1946 1816 130 6458 4751 1707 2503 1926 577 14 13 1Slovenia HC 1858 1812 46 3564 2514 1050 1846 1448 398 31 26 5  FT 1620 1576 44 1695 1305 390 1591 1198 393 31 26 5Austria HC 20587    20888 14531 6357 2315 1122 1193 337 135 202  FT       8280 6130 2150 1030 470 560 134 75 62Belgium HC 20850          2511 2063 448 260 255 5  FT 17991    13853 9918 3935 2273 1881 392 250 247 3Cyprus HC 317    807    222    78     FT 130    375    107         Denmark HC 12281    15682 10403 5279 2834 2142 692 410 400 10  FT 9651    8242 5593 2649 2104 1666 438 208 203 5Finland HC 26122    18495    5622    534     FT 21967    12879    3772         France HC                          FT 106387    66290  16500 25889  3800      Germany HC 175040    180514 124836 55318 44898 38315 6583       FT 157836    70844 50434 20410 39911 34365 5546     Greece HC 4375    18998    2868    99     FT 3797    8544    1980    50   Ireland HC 6937    9800 6360 3440 457 393 64       FT 5971    4390 3150 1240 419 362 57     Italy HC 29360    69844 44786 25058 18818 16299 2519 5045 3291 1753  FT 26550    46920 34123 12797 14454 12489 1965 2923 2065 858Luxembourg HC 1807    205 121 84 431 353 78       FT 1532    176 94 64 383 315 58     Malta HC 262    676                 FT 189    225      18       Netherlands HC 28313          7807    614     FT 22414    15750 11178 4113 6799    554 110 253Portugal HC 6186 3967 242 21384 13568 7816 5602 4974 628 4597 3571 1026  FT 4014 2515 129 10956 7668 3289 3338 2759 578 2819 2325 494Spain HC 43627    108823 66084 42379 28212 25988 2224 361 311 50  FT 35033    54028 32398 21629 20446 18598 1848 213 178 35Sweden HC 42476    34942 17483 8358 4771 2768 2003  307   FT 36697    15851 10488 3639 3018         United Kingdom HC             10188 9028 1160       FT 93717    67719  28660 9311 8387 924     TOTAL FT   585759  798 484649  142200 178601  23551 7622  1908

The need for estimates

EU 17 have SS FTE for HE; ESF 19

Large performers missing: FR, UK, also FI.

Newcomers more compliant?

GRADUATESYear

ISCED 5-6 ISCED 5-6 ISCED 5-6 ISCED 5-6 PhD PhD F PhD  PhD/  All fields SSBL %SSBL %F SSBL   SSBL F SSBL millionBulgaria 2000 46718 22493 48 68         2006 45383 21700 48 65 583 99 57 49Czech Republic 2000 38376 12852 34 59         2006 69312 19914 29 64 2023 290 120 173Estonia 2000 6441 3323 52 69         2006 11541 4226 37 74 143 18 7 149Hungary 2000 59883 23640 40 55         2006 69756 30529 43 70 1012 165 86 89Latvia 2000 15260 6320 41 67         2006 26414 14792 56 72 106 24 13 42Lithuania 2000 25241 7431 29 67         2006 43343 17739 41 74 326 77 52 100Poland 2000 344339 127371 37 66         2006 504051 214939 43 69 5917 745 377 144Romania 2000 67940 28215 42 59         2006 174821 84205 48 63 3180 619 294 122Slovakia 2000 22699 6301 28 57         2006 40190 11026 27 64 1218 202 105 171Slovenia 2000 11991 4782 40 64         2006 17145 8504 50 68 395 76 41 178Austria 2000 24981 6892 28 50         2006 34825 10031 29 58 2158 684 335 306Belgium 2000 68225 20768 30 54         2006 81567 23060 28 58 1718 261 99 148Cyprus 2000 2813 930 42 *659         2006 3858 1687 44 61 29 7   Denmark 2000 39017 9432 24 40         2006 47539 14463 30 52 910 125 57 158Finland 2000 35635 8228 23 68         2006 40044 9451 24 71 1409 210 113 373France 2000 508189 190844 38 63         2006 643604 267695 42 63 9818 1931 931 138Germany 2000 302095 62263 21 43         2006 358706 98619 22 50 24946 4451 1628 316Greece 2001 38963               2006 64387 16753 28 67 1248 94 31 118Ireland 2000 42009 13039 31 58         2006 59184 20566 35 59 979 115 65 171Italy 2000 201290 74235 37 55         2006 432068 144718 33 53 10188 1877 970 111Luxembourg 2000 680 335 49           2006               Malta 2000 2003 816 41 39         2006 2676 1182 44 52 1    Netherlands 2000 76927 27439 36 48         2006 117392 44892 38 52 2993 566 247 167Portugal 2000 48533 19022 39 74         2006 71828 23102 32 60 1094 196 112 360Spain 2000 260225 91195 35 62         2006 285957 80830 28 64 7159 1342 623 184Sweden 2000 42390 8830 21 58         2006 60762 15044 25 63 2660 262 106 426United Kingdom 2000 504081 154957 31 55         2006 640848 195519 31 56 16466 2978 1530 254TOTALS   3947201 1395186     98679 17414 7999  

ARTICLES Web of Science SCOPUS  SCI-E SSCI A&HCI SOCSCI ARTS

Bulgaria 1586 33 5 83 6Estonia 696 86 8 91 14Hungary 3686 172 43 309 70Latvia 229 16 0 12 0Lithuania 810 64 54 177 37Poland 10615 258 75 426 44Romania 2062 69 50 97 29

Slovak Republic 1049 108 71 159 59Slovenia 1833 137 39 343 20Austria 7267 525 84 614 57Belgium 10484 1158 254 1263 130Canada 35763 5861 1074 5719 479Cyprus 289 68 13 114 4

Czech Republic 5116 263 86 302 25Denmark 7975 833 78 783 59Finland 7076 894 87 963 69France 42563 2200 1018 2872 396Germany 59628 4678 924 4651 438Greece 7320 457 84 738 65Ireland 5045 754 146 592 48Italy 33355 1758 362 2214 181Luxembourg 176 21 1 33 1Malta 60 10 4 9 1Netherlands 18772 3573 316 3559 194Portugal 4938 289 33 463 26Spain 27338 2298 518 2519 193Sweden 14381 1860 131 1616 116

United Kingdom 51844 12749 2426 13732 1450"TOTAL" 361956 41192 7984 44453 4211

What is underlying purpose of data collection?

FTE R is critical; costly; estimates contested

Student data more robust

Propensity to publish varies by discipline

FTE SS ≈0.25 total, but articles ≈ 0.12 total

Publications counts biased by English language & location of publishing houses c.f. UK SS FTE vs UK share of SSCI; similar for SCOPUS

Collate & compare ISI, SCOPUS (inc ERIH), Ulrich, Scielo

Book publications and other artefacts: how to assess and track?

Comments on the data

Relationship with Science Policy. What data is required? What will be done with the data? Can Eurostat, OECD, UIS assist? Is FTE by Field of Science possible/necessary? If YES …..

Implement a Project: “Social Science in the European Research Area”

Data requirement specification (DRS); define project scope

Examine Eurostat, OECD, UIS data; if data good 30/50 FTE

If available data falls short of expectation invoke direct collection through National Statistical Agencies/ designated parties 60/100 FTE

Later phase: online database with query functions; major updates at 5 year intervals

Improving the next data set