Bibliometric research evaluation.The case of Sub-department Environmental TechnologyWouter GerritsmaInformation spcialist, Wageningen UR Library

Contents

Midterm review 2005 Citation analysis Explained Journal selection What’s in a name?

The incentive for this presentation

Wimek midterm evaluation 2005

Relative impact

Research area (ISI-ESI) # Papers RI

Agricultural Sciences 2 1.06

Biology & Biochemistry 84 0.52

Chemistry 12 0.76

Engineering 3 1.46

Environment/Ecology 184 1.01

Geosciences 1 0.15

Materials Science 1 0.17

Microbiology 33 1.27

Physics 1 0

Social Sciences, General 7 1.8

Analysis over last 10 years

Period Pubs Cits Cits/ Pub RI

Papers in top 10%

Papers in

top 1%

1995-1999 154 2441 15.85 1.01 13 0

2000-2004 172 803 4.67 0.83 11 0

All 326 3244 9.95 0.92 24 0

In conclusion

ETE very productive group Average citation impact

But what does it mean?

Citation data from Web of Science Research Fields from

Essential Science Indicators Baseline data from Essential Science

Indicators

How do we compare numbers?

Scientist Z. Math has a publication from 1996 with 17 citations

Scientist M. Biology has a publication from 2003 with 24 citations

Baseline mathematics

0

10

20

30

40

50

0 2 4 6 8 10 12

Years after publication

Cu

mu

lati

ve

no

. c

ita

tio

ns Baseline

top 10%

top 1%

Baseline Molecular Biology

0

100

200

300

400

0 2 4 6 8 10 12

Years after publication

Cu

mu

lati

ve

no

. c

ita

tio

ns Baseline

top 10%

top 1%

Example

Zee, F.P.v.d., G. Lettinga, and J.A. Field (2001) Azo dye decolourisation by anaerobic granular sludge. Chemosphere 44:1169-1176. Time cited: 65 times

Chemosphere (look up in journals menu ESI) Environment/Ecology, 7.95 citations per article

Baseline data (from ESI) Article from 2001 in Environment/ecology: Average:

11.62 citations, 10%: 27 citations, 1%: 82 citations RI= 65 / 11.62 = 5.6

Journal selection

Where to publish

It is better to publish one paper in a quality journal than multiple papers in lesser journals. …………. Try to publish in journals that have high impact factors; chances are your paper will have high impact, too, if accepted.

Bourne PE (2005) Ten Simple Rules for Getting Published .

PLoS Comput Biol 1(5): e57 doi:10.1371/journal.pcbi.0010057 or at SciVee

Journal selection

Quantitative tools Journal citations reports Journal information from Essential Science

Indicators

ScimagoJR

Journal Citation Reports (JCR)

Reports 3 measures Impact factor Immediacy Index Cited half life

0 2 4 6 8 10

Years after publication

Cita

tions

/year

Cited half-life

50% citations 50% citations

31

Immediacy index Window

Impact Factor Window

From ESI Limitation of IF, 2 year frame ESI Average citations per article over a 10

year period

Impact factor

Performance measure for journals“… it is also used for assessment of the quality of

individual papers, scientists and departments. For the latter a scientific basis is lacking, as we will demonstrate in this contribution” (Opthof, 1997)

Opthof, T. (1997). Sense and nonsense about the impact factor. Cardiovascular Research 33(1): 1-7. http://dx.doi.org/10.1016/S0008-6363(96)00215-5

50 % of articles generate 90% of all cites

Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. BMJ 314(7079): 497-502. http://bmj.bmjjournals.com/cgi/content/full/314/7079/497

What’s in a name

Department of Environmental Technology, Wageningen University,

P.O. Box 8129, 6700 EV Wageningen, The Netherlands

Dep. of Environmental Technology, Wageningen Univ. and Research Centre,

Bomenweg 2, HD 6703 Wageningen, The Netherlands

Department of Agricultural, Environmental and System Technology, Sub-department of Environmental Technology, Wageningen University,

P.O. Box 8129, 6700 EV Wageningen, The Netherlands

Department of Agrotechnology and Food Sciences, Wageningen University Agrotechnion, Mansholtlaan 10, Wageningen 6708 PA, Netherlands

Department of Environmental Technology, Wageningen University,

6700 EV Wageningen, Netherlands

Sub-department of Environmental Technology, Wageningen University, P.O. Box 8129, 6700 EV Wageningen, Netherlands

Are these researchers the same?

J. van Lier or J.B. van Lier P. Lens or P.N.L. Lens H. Temmink or B.G. Temmink

Female PhD students !?

Library course

Citation analysis: 18 March 2008, 9.00 am-12.30 pm, room PC421

http://wowter.net/2007/12/12/citation-analysis-for-research-evaluation/

Publish, be cited or perish!

Thank you !More info: http://wowter.net

This presentation: http://www.slideshare.net/wowter/ete-presentation