Ranking WebGlobal strategies for Kazakh Universities

Isidro F. Aguillo, HcDrThe Cybermetrics Lab - CSIC

al-Farabi Kazakh National UniversityAlmaty (Kazakhstan), November 21-22th 2011

2

The Cybermetrics Lab

Researchers belonging to the National Research Council (CSIC)

The largest Spanish research public organization

Recognised by our peers

15 years experience in quantitative analysis and evaluation of scholar communication and academic institutions

Papers in referred scientific journals, contributions to international conferences, reports to governmental bodies

About us

3

Ranking Web or Webometrics

Published since 2004

Two times (January & July) per year

Based on Web indicators

Composite indicator combining web presence of the universities (including academic papers) and impact (link

visibility) of the contents

About the Ranking

http://www.webometrics.info/

4

5

a RANKING of Universities

A table league providing performance ranks

Not an alphabetic ordered list

Not groups of universities in large clusters

Not a template with customisable variables

Not a collection of difficult to understand graphs

Not a series of colourful smileys

Webometrics is …

6

ONE Ranking

A unique list according to an informed model built by experts and scientifically tested

Not several completely different rankings derived from exactly the same data

Not an open system to be customised by young students or scholars without experience or expertise in Higher

Education

Webometrics is …

7

Leiden RankingS

8

a GLOBAL Ranking

Aiming to include all the Higher Education Institutions

Not only the developed countries’ universities

Not only research-intensive universities

Webometrics is …

9

Geographical coverage

3466394

16835

6045

6177108

349140

3945

5102413

19403(Top 1000)

July 2011

10

An ALL-MISSIONS Ranking

Representing all the university missions: Teaching, Research, Technology and Knowledge Transfer,

Community Engagement, Internationalization

Not only the research outputs

Not only the students/faculty ratios

Not only the awards and other excellence driven indicators

Not only hard-sciences based criteria

Webometrics is …

11

Missions reflected on the Web

Activity Impact

Citations Patents MISSIONSUNIVERSITIES RESEARCH TEACHING

COMMUNITYENGAGMENT

TECHNOLOGICALTRANSFER

INTERNATIONAL-IZATION

WORLD-CLASS + + + + + + + + + + + +NATION BUILDING + + + + + + + + + + + +LOCAL + + + + + + + + + <-

---L

inks

----

>

<--------------------------------Surveys-------------------------------->

12

built by SCHOLARS

According to a model, with weighting driven by Informetrics criteria and using the correct mathematical

tools

Not considering political or commercial interests

Not ignoring flaws, biases and mistakes

Not given priority to stability over quality enhancements

Not an anonymous website

Webometrics is …

13

Model

ACTIVITY IMPACT

ARWU (Shanghai) 40% 60%

RANKING

QS (former THES) 30% 70%

TIMES HE (2010) 35% 65%

HEEACT (Taiwan) 20% 80%

WR (Webometrics) 50% 50%

Ratio 1:1

14

Normalization

15

SCORE

RANK

WR

QS

CWTS

ARWUHEEACT

log-norm

z-score

16

USEFUL

Provides meaningful information about the global and national systems and identifying bad practices that

explain the major discrepancies

Not hiding or excluding outliers or institutions difficult to analyse

Not explaining strange results accepted without critical review

Webometrics is …

Academic Digital Divide

17

18

1901 Jacobus Henricus van 't Hoff (Chemistry)1901 Emil Adolf von Behring (Physiology or Medicine)1902 Hermann Emil Fischer (Chemistry)1902 Theodor Mommsen (Literature)1905 Adolf von Baeyer (Chemistry)1905 Robert Koch (Physiology or Medicine)1907 Albert Abraham Michelson (Physics)1907 Eduard Buchner (Chemistry)1908 Paul Ehrlich (Physiology or Medicine)1909 Karl Ferdinand Braun (Physics)1910 Otto Wallach (Chemistry)1910 Albrecht Kossel (Physiology or Medicine)1910 Paul Heyse (Literature)1911 Wilhelm Wien (Physics)1914 Max von Laue (Physics)1915 Richard Willstätter (Chemistry)1918 Fritz Haber (Chemistry)1918 Max Planck (Physics)1920 Walther Nernst (Chemistry)1921 Albert Einstein (Physics)

1925 Gustav Ludwig Hertz (Physics)1925 James Franck (Physics)1925 Richard Adolf Zsigmondy (Chemistry)1928 Adolf Otto Reinhold Windaus (Chemistry)1929 Hans von Euler-Chelpin (Chemistry)1931 Otto Heinrich Warburg (Physiology or Medicine)1932 Werner Heisenberg (Physics)1933 Erwin Schrödinger (Physics)1935 Hans Spemann (Physiology or Medicine)1936 Peter Debye (Chemistry)1939 Adolf Butenandt (Chemistry)1944 Otto Hahn (Chemistry)1950 Kurt Alder (Chemistry)1950 Otto Diels (Chemistry)1953 Fritz Albert Lipmann (Physiology or Medicine)1953 Hans Adolf Krebs (Physiology or Medicine)1954 Max Born (Physics)1956 Walther Bothe (Physics)1991 Bert Sakmann (Physiology or Medicine)2007 Gerhard Ertl (Chemistry)

Nobel Laureates of University of Berlin (1945), splitted in two: Humboldt Universität y Freie Universität, ignored by the Shanghai Ranking (ARWU)

RANKINGS WEBInstitution 2011

Freie Universität Berlin - - 92

Humboldt Universität zu Berlin - - 103

2003 …..… 2011ARWU

Other Rankings

19

Current situation

Ranking Web includes 94 universities (64%) with their own web domain (according to the Ministry of Education there

are 148, of which 74 are cited in English version of Wikipedia)

Two have duplicate central domains

None of them are ranked in the Top 4000

There is no Open Access repositories internationally registered

Kazakh Universities

20

Comparison with research outputs

Low correlation

Link Visibility

Low visibility

Presence in Scholar

No Open Access policies

Popularity

Local impact

24

Kazakh Universities are underperformingin the Ranking Web

Major reason is the lack of quality (research-related) international (English) contents in the Web

Other problems are related to web domain bad practices, lack of support of Open Access initiatives, and centralised short-

term web policies

Web is already the most important scholarly communication tool, so …

Why are you ignoring Webometrics results?

Summarizing …

25

Web presence should reflect the performance, prestige and the impact of the universities

The key variables are content-related, involving everybody in the web publication, not only computer department and

the library but every department, research group, individual scholar, researcher or post-graduate student

ContentsA lot of contents

ContentsQuality contents, specially research results

ContentsInternational contents, in local languages and in English too

Recommendations …

26

CONTACT INFO

Isidro F. Aguillo, HcPhDThe Cybermetrics Lab (CSIC)

Madrid. SPAIN

isidro.aguillo@cchs.csic.es

Questions?

Thank you!