31
Web Science and Technologies University of Koblenz–Landau, Germany Why Beyoncé Is More Popular Than Me Fairness, Diversity and Other Measures Jérôme Kunegis Albert-Ludwigs-Universität Freiburg July 27, 2012

Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Embed Size (px)

Citation preview

Page 1: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Web Science and Technologies

University of Koblenz–Landau, Germany

Why Beyoncé Is More Popular Than MeFairness, Diversity and Other Measures

Jérôme Kunegis

Albert-Ludwigs-Universität Freiburg

July 27, 2012

Page 2: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 2

Fairness

Page 3: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 3

Page 4: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 4

(1) The Pareto Principle

“20% of people own 80% of land.”

(In 1910s Italy)

(Pareto, 1919)

Page 5: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 5

UNFAIR

Page 6: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 6

8.9% of bands make up 91.1% of plays on Last.fm.

14.6% of user groups account for 75.4% of group memberships on Flickr.

17.4% of movies receive 82.6% of ratings on MovieLens.

17.7% of profiles receive 82.3% of ratings on Czech dating site Libimseti.cz.

19.7% of all cats receive 80.3% of all friendships on Catster.com.

20.3% of all users receive 79.7% of “friend” and “foe” links on Slashdot.

21.3% of users receive 78.7% of wall posts on Facebook.

22.9% of users make up 77.1% of all “@” mentions on Twitter.

23.1% of projects make up 76.9% of project memberships on Github.

27.3% of users receive 72.7% of replies on Digg.

27.6% of all hamsters receive 72.4% of all friendships on Hamsterster.com.

35.7% of all Twitter users receive 64.3% of all follows.

Page 7: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 7

Degree distribution

C(n) » n¡°

Page 8: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 8

TODO

Page 9: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 9

Which distribution is fairer?

Flickr friendships OR Digg replies

Page 10: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 10

Lorenz Curve – Gini Coefficient

Page 11: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 11

Flickr Digg

Page 12: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 12

Perfect Power Laws

Page 13: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 13

High entropy

Low entropy

(2) Entropy

Page 14: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 14

@kunegis

@noshir

@beyonce

@barabasi

@ststaab

Page 15: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 15

Entropy

Page 16: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 16

max He = ln jVj

Page 17: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 17

Normalized Entropy

Page 18: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 18

Gini vs Entropy

½ = ¡0.71p < 0.001

Page 19: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 19

(3) Random Walks

Pret(L) large Pret(L) small

Diversity No diversity

Page 20: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 20

Pret(L) = §(i, j, . . . k) (d(i) d(j) . . . d(k)){1

= tr(NL)= §k ¸k

L

where ¸k are eigenvalues of N = D{1/2 A D{1/2.

Here: Use L = 4 and k · R

Weighted Spectral Distribution

Page 21: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 21

Eigenvalues of N

Page 22: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 22

(4) Controllability

(Liu, Slotine & Barabási 2011)

Diversity No diversity

Page 23: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 23

#Knobs needed = jVj { max jMj 

Find a maximal directed 2-matching

Page 24: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 24

Generality

Interpretation

Runtime

Coverage

Power Law

Power-law

Many (!)

Slow

d(u) ≥ dmin

Gini

All networks

Economy

Fast

All

Norm. Entropy

All networks

Physical

Fast

All

ComparisonRandom walks

All networks

Simulation

Medium

All

Controllability

All networks

Control theory

Fast

All

Page 25: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 25

Network Evolution

Page 26: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 26

“The Rich Get Richer”

(Barabási & Albert 1999)

Page 27: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 27

“Random Walks Arrive Less Often”

Page 28: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 28

“Networks Get Easier to Control”

Page 29: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 29

Experiments20 networks from konect.uni-koblenz.de

9 authorship, 3 communication, 3 social, 3 interaction, 1 rating, 1 physical

Measure Diversity decreasing

No diversity trend

Diversity increasing

Diameter 12 8 0

Gini coefficient 13 3 5

Fractional rank 10 6 4

Weighted spectral distribution 12 7 1

Controllability 15 5 0

Page 30: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 30

Thank YouJérôme Kunegis @kunegis

Work in collaboration with Julia Preusse, Sergej Sizov, Damien Fay & Felix Schwagereit

WeST – Institute for Web Science and TechnologiesUniversity of Koblenz–Landau, Germany

konect.uni-koblenz.de

Page 31: Why Beyoncé Is More Popular Than Me – Fairness, Diversity and Other Measures

Jérôme KunegisAlbert-Ludwigs-Universität Freiburg

Why Beyoncé Is More Popular Than Me 31

ReferencesJ. Kunegis, S. Sizov, F. Schwagereit, D. Fay. Diversity Dynamics in Online Networks. Proc. Conf. on Hypertext and Social Media, 2012.

J. Kunegis, J. Preusse. Fairness on the Web: Alternatives to the Power Law. Proc. Web Science Conf., 2012.

Y.-Y. Liu, J.-J. Slotine, A.-L. Barabási. Controllability of Complex Networks. Nature, 473:167–173, May 2011.

J. Leskovec, J. Kleinberg, C. Faloutsos. Graph Evolution: Densification and Shrinking Diameters. ACM Trans. Knowledge Discovery from Data, 1(1):1–40, 2007.

A.-L. Barabási, R. Albert. Emergence of Scaling in Random Networks. Science, 286(5439):509–512, 1999.

V. Pareto. Manuale di economia politica con una introduzione alla scienza sociale (Manual of political economy). Milano : Societa Editrice Libraria, 1919.