Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,

Filippo Menczer

Crowdsourcing Scholarly Data and Universality of Impact Metrics

scholarometer.indiana.edu

authortags

citation data

authortags

citation data

impact measuresbib records

networkwidget

API

X. Sun & al: Ambiguous Author Query Detection using Crowdsourced Digital Library Annotations. Information Processing &

Management 49:454-464, 2013

Reliability heuristics

J. Kaur & al: Scholarometer: A Social Framework for Analyzing Impact across Disciplines. PLoS ONE 7(9):e43235, 2012

Linked Open Data & API

a.

0 20 40 60 80 100global rank by h

loca

l ran

k

0

20

40

60

80

100

●●●●●●●●●●●

●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●

●●●●●●●●●●

●●●●

●●

●●

●●

●●●

●●

●●●●

●●●●●●●●

●●

●●

●

●●●

●●

●●●●●●●●

●●●●

●●

●●

●●●

●●●

●●

●●

●●●●●●●

●●●●●●●●●●●●●●●●

●●●

●●●●●●●●●●●●●●●●●●●●●●●●●

●●●●●

●●●●●●●●●●●●●●●

●●

●●●●

●●●●●●●

●●●●●

●●

●●

●

●●

●●●

●●●●●●●●

●●●●●●

●●

●●●

●●●●

●●

●●

●●●●●●●

●●●●

●●●●

●●●●●

●●●●

●●●●

●●●●

●

0 20 40 60 80 100global rank by hs

0

20

40

60

80

100

●●●●

●●●●● ●●

●●●●●●●●●

●●●●●●●●●●

●●●●●●●●●●●

●●●●●●●●●●

●●●●

●●

●●●●

●●●

●●

●●

●●

●●●●

●●

●●

●●

●●

●

●●●

●●

●●●●

●●●●

●●

●●

●●

●●

●●●

●●●

●●

●●

●●

●●

●●●

●●●●●●●●●●●●●●●●

●●●

●●●●●●●●●●●●●●●●●●

●●●●●●●

●●●●●

●●●●●●●●●●●●●●●

●●

●●●●

●●●

●●●●

●●●●●

●●

●●

●

●●●●●

●●●

●●

●●●

●●

●●

●●

●●

●●

●

●●●●

●●

●●

●●●●●●●

●●●●

●●

●●

●●●●●

●●●●

●●●●

●●●●

●

●

●

●●●●●●●

biologymathematicseconomicspsychologysociologylibrary sciencesbiochemistry

a.

0 20 40 60 80 100global rank by h

loca

l ran

k

0

20

40

60

80

100

●●●●●●●●●●●

●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●

●●●●●●●●●●

●●●●

●●

●●

●●

●●●

●●

●●●●

●●●●●●●●

●●

●●

●

●●●

●●

●●●●●●●●

●●●●

●●

●●

●●●

●●●

●●

●●

●●●●●●●

●●●●●●●●●●●●●●●●

●●●

●●●●●●●●●●●●●●●●●●●●●●●●●

●●●●●

●●●●●●●●●●●●●●●

●●

●●●●

●●●●●●●

●●●●●

●●

●●

●

●●

●●●

●●●●●●●●

●●●●●●

●●

●●●

●●●●

●●

●●

●●●●●●●

●●●●

●●●●

●●●●●

●●●●

●●●●

●●●●

●

0 20 40 60 80 100global rank by hs

0

20

40

60

80

100

●●●●

●●●●● ●●

●●●●●●●●●

●●●●●●●●●●

●●●●●●●●●●●

●●●●●●●●●●

●●●●

●●

●●●●

●●●

●●

●●

●●

●●●●

●●

●●

●●

●●

●

●●●

●●

●●●●

●●●●

●●

●●

●●

●●

●●●

●●●

●●

●●

●●

●●

●●●

●●●●●●●●●●●●●●●●

●●●

●●●●●●●●●●●●●●●●●●

●●●●●●●

●●●●●

●●●●●●●●●●●●●●●

●●

●●●●

●●●

●●●●

●●●●●

●●

●●

●

●●●●●

●●●

●●

●●●

●●

●●

●●

●●

●●

●

●●●●

●●

●●

●●●●●●●

●●●●

●●

●●

●●●●●

●●●●

●●●●

●●●●

●

●

●

●●●●●●●

biologymathematicseconomicspsychologysociologylibrary sciencesbiochemistry

Universality

Universality

b.

% a

utho

rs

2

3

4

5

6

7

biolo

gy

ec

onom

ics

ps

ycholo

gy

bioch

emistr

y

so

ciolog

y

math

emati

cs

library

scien

ces

●

●

●●

●

●

●

● hsh

Fluctuations: hypergeometric

distribution

b.

% a

utho

rs

2

3

4

5

6

7

biolo

gy

ec

onom

ics

ps

ycholo

gy

bioch

emistr

y

so

ciolog

y

math

emati

cs

library

scien

ces

●

●

●●

●

●

●

● hsh

c.

u(z=5%)0.5 0.7 0.9

cavgh

ctotal1 2hmi10ghf

(c c0)avghi, norm

hs

Which metrics are universal?

c.

u(z=5%)0.5 0.7 0.9

cavgh

ctotal1 2hmi10ghf

(c c0)avghi, norm

hsh / <h>

Batista

New Crown Indicator a.k.a. FNCS

Radicchi & al.

Egghe

Google

Schreiber

Redner

Which metrics are universal?

Universality Index

e.

d.

z

u(z)

3 10 20 30 40 50 60 70 80 90 99

0.4

0.5

0.6

0.7

0.8

0.9

1.0

metrichshi, norm(c c0)avghmhfgctotal1 2

i10hcavg

u0.940.940.880.880.860.850.850.840.830.74

e.

d.

z

u(z)

3 10 20 30 40 50 60 70 80 90 99

0.4

0.5

0.6

0.7

0.8

0.9

1.0

metrichshi, norm(c c0)avghmhfgctotal1 2

i10hcavg

u0.940.940.880.880.860.850.850.840.830.74

Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh, Filippo Menczer

Thanks: Geoffrey Fox, Filippo Radicchi, Santo Fortunato, Alex Vespignani, Johan Bollen, Rajasee Rege, Heather Roinestad, Alessandro Flammini,

Networks & agents Network, NSF Award IIS-0811994

Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh, Filippo Menczer

Thanks: Geoffrey Fox, Filippo Radicchi, Santo Fortunato, Alex Vespignani, Johan Bollen, Rajasee Rege, Heather Roinestad, Alessandro Flammini,

Networks & agents Network, NSF Award IIS-0811994

scholarometer.indiana.edu