Embed Size (px)
Citation preview
Open AccessCitation Index Services
Tim Brody
Intelligence, Agents, Multimedia Group
University of Southampton
20th February 2006 20-21 February 2006, Berlin, Humboldt University
2
Content
• A slightly irreverent look at evaluation and metrics in science … based on Open Access
20th February 2006 20-21 February 2006, Berlin, Humboldt University
3
Publish or Perish
= 10 =
20th February 2006 20-21 February 2006, Berlin, Humboldt University
4
Publish in a high impact journal or Perish
? Nature = 32.182
ACM Comput Surv = 10.037
IEEE T Inform Theory = 2.029
=2.029 * 10 = 20 ?
Publish or Perish
20th February 2006 20-21 February 2006, Berlin, Humboldt University
5
Impact Factor = Author Impact?
• “Use of journal impact factors conceals the difference in article citation rates (articles in the most cited half of articles in a journal are cited 10 times as often as the least cited half)” P.O. Seglen BMJ 1997;314:497
20th February 2006 20-21 February 2006, Berlin, Humboldt University
6
Author Impact Factors …
?
20th February 2006 20-21 February 2006, Berlin, Humboldt University
7
Names are tricky …
What’s a eukaryote?
20th February 2006 20-21 February 2006, Berlin, Humboldt University
8
But what about my IR record?
eprints.ecs.soton.ac.uk =
20th February 2006 20-21 February 2006, Berlin, Humboldt University
9
… if I could couple my publication record with a citation index?
20th February 2006 20-21 February 2006, Berlin, Humboldt University
10
But I don’t have many citations …
Citebase does track downloads of my papers(in ECS EPrints, UK arXiv.org)
20th February 2006 20-21 February 2006, Berlin, Humboldt University
11
The trouble with metrics
…
Should Lammel, S get +124 downloads?
(* 628 authors)
20th February 2006 20-21 February 2006, Berlin, Humboldt University
12
Perhaps the answer lies in many metrics …
20th February 2006 20-21 February 2006, Berlin, Humboldt University
13
Tim Brody’s Impact Indicators
• Main-author: 3 papers• Contributed to: 10 papers• Presented at: Humboldt University• Published in …
– JASIST (= 2.086 IF)– ECDL Proceedings
• Been cited … 3 times (/ author position?)• Been downloaded … 1100 times• ‘Ranked 154 of 213 researchers in field …’
20th February 2006 20-21 February 2006, Berlin, Humboldt University
14
Practicalities for … Open Access Citation Index Services
• Journal Publications are (for the foreseeable future) the gold standard– Can’t escape the need for journal metadata– Peer-reviewed/non-Peer-reviewed metrics
• Author self-archived e-prints facilitate:– Open Access Citation Services– Usage impact experiments (Web Impact Factor?)
– (n.b. Increased Citation Impact)
20th February 2006 20-21 February 2006, Berlin, Humboldt University
15
IR Implementation Needs
• e-print journal manifestation linking– [combined usage/citation impact]
• e-print refs (and/or full-text?) export– [copyrighted e.g. book = citation + refs]
• e-print usage export (weblogs)
• authoritative publication lists
• … reference linking
20th February 2006 20-21 February 2006, Berlin, Humboldt University
16
Where to Reference Link
• Reference linking at the source– Distributed citation index (IRs+Journals)
• Scalable/sustainable model for a free ‘virtual’ citation index?
– IR reference linking tools/services• allow authors to correct citation links
– Existing structured XML from publishers– Rich OAI export (OpenURL, DIDL, METS etc.)
20th February 2006 20-21 February 2006, Berlin, Humboldt University
17
Parsing/Linking elsewhere …
• Centralised/Commercial:
– ISI WoK will do the job?• Layered:
– Reference Linking ‘middleware’ e.g. through national OA citebases
• Centralised/Subject:
– NASA ADS, Citeseer, …– Sustainability? Duplication of effort?
20th February 2006 20-21 February 2006, Berlin, Humboldt University
18
The Goals
• What technical solution will best achieve …– Promote research incentives– Experimentation and competition– Transparency
20th February 2006 20-21 February 2006, Berlin, Humboldt University
19
Thanks for listening!
• Tim Brody <[email protected]>
• ISI Web of Science, JCR (2004)
• http://eprints.ecs.soton.ac.uk/
• http://www.citebase.org/
P.S. eukaryote is a single-celled or multicellular organism whose cells contain a distinct membrane-bound nucleus.
