Bibliometrics and Publishing

Bibliometrics and PublishingPeter Sjögårde & Staffan Karlsson, Bibliometric analystsKTH Royal Institute of Technology, ECE School of Education and Communication in Engineering Sciences (ECE), Unit for Publication Infrastructure

Last edited 2013-06-27

What is bibliometrics and why bother about it?

Is someone reading and building on your results?Statistics on publications and citationsMeasuring Impact on research societyUsed for evaluation of research• Publication level• Individual level• Organizational level

Use of bibliometrics Research assessment at KTH

University rankings

Funding allocation(part of future peer assessment?) Research funders

Recruitment of researchers

Bibliometric indicators

Field normalized citation rateH-indexJournal Impact Factor

Photo - http://www.flickr.com/photos/tysonneil/179407461/

Field normalized citation rate

For a publication:

Same research field same yearsame document type

Average = 1

Field normalized citation rate

Used at different levels• Rankings (university level)• Funding allocation (university level)• Assessment (research groups)

2004 2005 2006 2007 2008 2009 20100.000.200.400.600.801.001.201.401.601.802.00

RAE2012 - Time series of average field normalized citation rate for KTH (full counts, 3 year sliding averages,

KI)

Year

Field

nor

mali

sed

citat

ion ra

te

H-index

H-indexUsed at individual level

• Recruitment• Research fundingDefinition:

”A scientist has index h if h of his/her Np papers have at least h citations each, and the other (Np − h) papers have no more than h citations each.”

H-index

Bibliometrics at KTH

• Research Assessment Exercise (research groups, UoA)• Yearly indicator report (KTH Schools)• Funding allocation

Funding allocation

Field normalized citation rateRelative to size of school budget (size of school)Currently, re-allocation of 20 MSEK of KTH research funds

Research Assessment Exercise

Researcher basedWide range of indicators• Publishing

– Number of publications– Coverage in Web of Science– Field normalized citation rate of the journals, in average.

• Impact– Citations – Field normalized citation rate– Share of 10% most cited publications in the research field.

• Collaboration – Share of internationally co-authored publications

Yearly indicator report

• Number of peer reviewed articles • Number of peer reviewed conference papers• Field normalized citation rate• Top 10% publications• Number and Share of level 2 publications in the

Norwegian system• Number of publications co-published with industry• Share of publications internationally co-published

Databases used for bibliometrics

Web of Science is the most important database for bibliometric analysesScopus is the second most important, (and more or less the only alternative)

Google Scholar

Good search toolCover all types of publications (including patents)

Not used for ”serious” bibliometrics• Poorly defined contents• Normalizations not possiblePrimitive user interfaceThird-party user interface: Publish or perish (http://www.harzing.com/pop.htm)

Google Scholar

Choice of journal

Relevance to subject

AudienceOutreach

Peer review process

LanguageImpact

Format

Open Access

In Web of Science?

In Scopus?

Google/Google Scholar

Journal Prestige

Journal Impact

Much discussed and critizedeg http://www.sciencemag.org/content/340/6134/787.full and http://am.ascb.org/dora/

JIF is a poor proxy for the number of citations to expect. Overrated as an indicator of where to publish to maximize citations

Could be useful as a proxy for the ”brand value” of a paper - for indivduals and universities

Science 17 May 2013

Journal Impact Factor (JIF)How is it calculated?

JIF = Citations 2012 / Citable Items 2010-2011

Thomson Reuters description http://thomsonreuters.com/products_services/science/free/essays/impact_factor/

Citations from 2012

Issues from 2010-2011

To access Journal Citation Reports

Through the KTH-library site select>Search Tools > Databases > Web of Knowledge > Add Resources > Journal Citation Reportshttps://www.kth.se/kthb

Journal Impact Factor (JIF)a measure of the speed at which content in a particular journal is

picked up and referred to

Eigenfactor Score = the percentage of the total weighted citations that journal i receives. It is adjusted for differences in citation patterns among disciplines. Article Influence Score = a measure of the per-article citation influence of the journal

Alternatives to the WoS JIFEigenfactor.org • eigenfactor.org or through Web of Knowledge• Based on WoS (ca 8 300 journals)• Field normalized (using a PageRank algorithm)• Citations from high impact journals are valued higher• Are not influenced by journal self-citation. SCImago journal rank • scimagojr.com/journalrank.php or through Scopus• Based on Scopus data (ca 20 000 journals)• Field normalized (using a PageRank algorithm)SNIP (source normalized impact)• through Scopus• Based on Scopus (probably also WoS in the future)• “Source normalized” more fair evaluation of applied fields

To access Scopus

Through the KTH-library site>Search Tools > Databases > Scopus > Analyticshttps://www.kth.se/kthb

Improving your visibility using uniqe author identifiersOpen Researcher and Contributor ID

http://orcid.org/

ORCID can import publication data from

Scopus Author IDResearcherID (Web of Science)CrossRef

Personal ORCID siteeg http://orcid.org/0000-0002-5739-5213

DiVA – KTH publication database

Budget citation indicator and school indicators KTH RAE 2012Dynamic listings for • CV• Profile pages• web pages

DiVA

The researchers at KTH should register all new publications not registered by Web of Science or Scopus

When register:• Check for duplicates• KTH-ID (u1l3g15d)• Organization• WoS-ID

DiVA

• Check for duplicates

DiVA

• KTH-ID (u1l3g15d)

DiVA

• Organization

DiVA

• Web of Science ID

DiVA

Strategic research areas

Open Access

Green – Parallel publishing Gold – Publishing in Open Access journals

Open Access

Mandated by • VR • Riksbankens jubileumsfond• Formas• Knut och Alice Wallenbergs stiftelse• Seventh Framework Programme (FP7)• European Research Council (ERC)

More impact/citations with Open Access?

Some studies show that OA articles get more downloads and more citations - Other show no advantage - debate is still going on• More possible citers• Easier access• Easier indexing for web crawlers• Better visibility outside the research communityNo contradiction between OA and high impact factor journals• If choosing to publish in OA journals the same recommendations apply

– Check outreach and impact– Check the peer review process– Relevance– …

Citations and collaboration

1 2 3 4 5 6 7 8 9 100.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

1.60

1.80

2.00

0

2

4

6

8

10

12

14

16

Correlation between citation rates and number of au-thors in RAE2012

Field normalized citation rate (WoS)Average number of ci-tations (WoS)

Number of authors

Fiel

d no

rmal

ized

cita

tion

rate

Cita

tions

Citations and collaboration

0 20 40 60 80 100 1200

20

40

60

80

100

120

140

Correlation between citation rate and number of authors in RAE2012

Authors

Field

nor

alize

d cit

atio

n ra

te

Publications with less than 100 authors included

Social media

Why?• Find publications• Share publications• Make research visual• CollaborateCorrelation between social media impact and bibliometrics?Differences between research fields

Altmetrics

KTH’s policy for scientific publishing

Publish in international high-impact journalsMake articles freely available by publishing in Open Access journals or do parallel publishingWrite popular science to increase KTH visibility and impact on societyRegister publications in the KTH publication database DiVA

Aim: To make KTH's scientific publishing more visible for the international scientific community and the general public

http://www.kth.se/en/kthb/publicering/vagledning/policydokument-1.182530

Affiliation

KTH Royal Institute of Technology

Summary of KTH’s Publishing guide

Check the outreach of your publishing channel.

Check the impact of your journal.

Publish in English.

Plan your research and publishing for cooperation.

Use a unique and consistent author name.

Write your organizational affiliation in a way that is easy to identify by an international audience.

Register your publication in the KTH publication database DiVA.

Publish your article Open Access if possible.

Contact the Department of Publication Infrastructure at the ECE School for support and more

information.

Ulf Kronman, 2011, Guide to Scientific Publication Management for Researchers at the KTH Royal Institute of Technology, URL: http://kth.diva-portal.org/smash/record.jsf?pid=diva2:450945

Further information

www.kth.se/kthb > Publishing

Comments/questions to:Peter Sjögårde, Bibliometric Analyst

Staffan Karlsson, Bibliometric Analyst

pi@ece.kth.se

KTH Royal Institute of Technology

School of Education and Communication in Engineering Sciences (ECE)

Unit for Publication Infrastructure