Upload
nader-ale-ebrahim
View
213
Download
0
Embed Size (px)
Citation preview
8/17/2019 New Systems for Measuring Research Impact
1/67
New systems formeasuring research
impact
@aleebrahim
www.researcherid.com/rid/C-2414-2009
http://scholar.google.com/citations
Nader Ale Ebrahim, PhDVisiting Research Fellow
Research Support Unit
Centre for Research Services
Research Management & Innovation Complex
University of Malaya, Kuala Lumpur, Malaysia
11th May 2016
http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://aleebrahim.com/https://twitter.com/aleebrahim
8/17/2019 New Systems for Measuring Research Impact
2/67
3rd SERIES OF INTRODUCTORY WORKSHOP ON:
Strategies to Enhance Research
Visibility, Impact & Citations
Nader Ale Ebrahim, PhD=====================================
Research Support Unit
Centre for Research Services
Research Management & Innovation Complex
University of Malaya, Kuala Lumpur, Malaysiawww.researcherid.com/rid/C-2414-2009
http://scholar.google.com/citations
All of my presentations are available online at:
https://figshare.com/authors/Nader_Ale_Ebrahim/100797
Link to this presentation: https://dx.doi.org/10.6084/m9.figshare.3364240.v1
Read more:
1. Ale Ebrahim, N., Salehi, H., Embi, M. A., Habibi Tanha, F., Gholizadeh, H., Motahar, S. M., & Ordi, A. (2013). Effective
Strategies for Increasing Citation Frequency. International Education Studies, 6(11), 93-99. doi: 10.5539/ies.v6n11p93
2. Ale Ebrahim, Nader. "Optimize Your Article for Search Engine." University of Malaya Research Bulletin 2.1 (2014): 38-39.
http://www.researcherid.com/rid/C-2414-2009http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttps://figshare.com/authors/Nader_Ale_Ebrahim/100797https://dx.doi.org/10.6084/m9.figshare.3364240.v1http://ssrn.com/abstract=2344585http://ssrn.com/abstract=2344585http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2588209http://ssrn.com/abstract=2344585http://ssrn.com/abstract=2344585https://dx.doi.org/10.6084/m9.figshare.3364240.v1https://dx.doi.org/10.6084/m9.figshare.3364240.v1https://figshare.com/authors/Nader_Ale_Ebrahim/100797https://figshare.com/authors/Nader_Ale_Ebrahim/100797http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009
8/17/2019 New Systems for Measuring Research Impact
3/67
Abstract
Abstract: The reach of a publication can no longer be judged exclusively
by the number of times it is cited. Because, we are now in the digital and
sharing information age, academic conversations are as likely to be found
on various academic social networks. So, we need new tools to measure
the research impact. Altmetrics are new metrics proposed as alternatives
to Impact Factor for journals and personal citation indexes like h-index. Altmetrics attempts to use the online activity to measure impact, buzz,
word of mouth for scientific information and it includes new ways to
measure usage at the citation level. In this workshop, I will explain about
the application of "alternative metrics" tools such as: Altmetric.com,
Impactstory.org, Plumanalytics.com, and PLoS metrics.
Keywords: Altmetric, H-index, Improve citations, Research tools,
Bibliometrics, Research Visibility
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
4/67
Research Tools Mind Map
©2016-2017 Nader Ale Ebrahim
http://www.mindmeister.com/39583892/research-tools-by-nader-ale-ebrahimhttp://www.mindmeister.com/39583892/research-tools-by-nader-ale-ebrahim
8/17/2019 New Systems for Measuring Research Impact
5/67
Research Tools Mind Map -> h-index ->
Other Meters
©2016-2017 Nader Ale Ebrahim
https://www.mindmeister.com/39583892/research-tools-by-nader-ale-ebrahim
8/17/2019 New Systems for Measuring Research Impact
6/67
©2016-2017 Nader Ale Ebrahim
http://www.american.edu/library/news/altmetrics-borchard.cfm
8/17/2019 New Systems for Measuring Research Impact
7/67
Altmetrics
Webometrics
Cybermetrics
Bibliometrics
Scientometrics
Informetrics
Science of
Science
Bibliographies –
largely
references
Alternativemetrics – views,
downloads, web
citations, etc
Web presence,
visibility and
impact – links,pages,
documents
Whole Internet,
cyberspace
Informetrics, scientometrics, bibliometrics,
webometrics, cybermetrics and altmetrics
Source: Onyancha, Omwoyo Bosire. "Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub-Saharan Africa
1." Inkanyiso: Journal of Humanities and Social Sciences 6.1 (2014): 49-65.
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
8/67
What it’s like being a researcher
I like doingresearch!
Are you doing anything
interdisciplinary?
What were your
recent publications?
Where did you
publish them?
Is the data
open too?
How did you
pay the APC?
Where is your
Research heading?
Are they Open
Access?
Was it wellreceived?
Did it have any
impact?
How many grants have
you applied for so far?
How many grant applications
were successful?
How are you going to sustain
your grant income profile?
Where is your grant
money?
What did you do with the
grant income you received?
How did you cost your
overheads?
Does it have aninternational
dimension?
Did it have any
Impact?
How many students
are you teaching?How many students
are you supervising?
Did it make a
spinoff?
Does it have
any IMPACT?
What’s your next
project?
WILL IT HAVE ANYIMPACT?
Source: Owen Roberson, Research Information Analyst (2015) Research Information and Analytics at Cambridge: Insight over measurement,Research Information Office, Academic Division
©2016-2017 Nader Ale Ebrahim
http://files.figshare.com/2282721/UCISA___Owen_Roberson.ppthttp://files.figshare.com/2282721/UCISA___Owen_Roberson.ppt
8/17/2019 New Systems for Measuring Research Impact
9/67
©2016-2017 Nader Ale Ebrahim
Source: http://altmetrics.org/manifesto/
http://altmetrics.org/manifesto/http://altmetrics.org/manifesto/http://altmetrics.org/manifesto/http://altmetrics.org/manifesto/
8/17/2019 New Systems for Measuring Research Impact
10/67
Problems withcitation-based indicators
Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku
Problem 1: Time
Problem 2: Journals
Problem 3: Impact
©2016-2017 Nader Ale Ebrahim
http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities
8/17/2019 New Systems for Measuring Research Impact
11/67
Science
IMPACT ON:
Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim
http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities
8/17/2019 New Systems for Measuring Research Impact
12/67
Science
Society
Environment
Culture
Economy
Education
IMPACT ON:
Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim
http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities
8/17/2019 New Systems for Measuring Research Impact
13/67
Created byresearchers Created bythe public
Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim
Altmetrics
http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities
8/17/2019 New Systems for Measuring Research Impact
14/67
Created byresearchers
Indicating
futurescientific
impact?
Altmetrics
Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim
http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities
8/17/2019 New Systems for Measuring Research Impact
15/67
Indicating other
types of impact,
such as societal
impact?
Created bythe public
Altmetrics
Source: Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku©2016-2017 Nader Ale Ebrahim
http://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activities
8/17/2019 New Systems for Measuring Research Impact
16/67
How is the Altmetric score calculated?
The score is a weighted count
The score is derived from
an automated algorithm, and
represents a weighted count of
the amount of attention we've
picked up for a research output.Why is it weighted? To reflect the
relative reach of each type of
source. It's easy to imagine that
the average newspaper story is
more likely to bring attention to
the research output than theaverage tweet. This is reflected
in the default weightings:
©2016-2017 Nader Ale Ebrahim
News 8
Blogs 5
Twitter 1
Facebook 0.25
Sina Weibo 1
Wikipedia 3
Policy Documents (per source) 3
Q&A 0.25
F1000/Publons/Pubpeer 1
YouTube 0.25
Reddit/Pinterest 0.25
LinkedIn 0.5
Source: https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-
https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-https://help.altmetric.com/support/solutions/articles/6000060969-how-is-the-altmetric-score-calculated-
8/17/2019 New Systems for Measuring Research Impact
17/67
“Alternative Metrics" Tools
• Altmetric.com
• Impactstory.org
• Plumanalytics.com• PLoS Article-Level Metrics
• Usage Count (webofknowledge.com)
• Bookmetrix (http://www.bookmetrix.com)
• Article Metrics in Scopus
©2016-2017 Nader Ale Ebrahim
http://www.bookmetrix.com/http://www.bookmetrix.com/
8/17/2019 New Systems for Measuring Research Impact
18/67
Altmetrics
• Altmetrics are new metrics proposed as alternatives to
Impact Factor for journals and personal citation indexes
like h-index. The term "article level metrics" was first put
forward in 2010, but altmetrics (derived from "alternative
metrics") become prevalent as it better suggested arange of new metrics. Altmetrics can be applied not only
to articles but also to people, journals, books, data sets,
web pages, etc. Many aspects of the impact of a work
(such as article views, downloads, mentions in socialmedia and new services) can be measured, as well as
traditional citation counts.
©2016-2017 Nader Ale Ebrahim
Source: http://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/
http://dx.doi.org/10.1038/495437ahttp://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/http://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/http://www.swansea.ac.uk/iss/researchsupport/metrics/altmetrics/http://dx.doi.org/10.1038/495437a
8/17/2019 New Systems for Measuring Research Impact
19/67
©2016-2017 Nader Ale Ebrahim
https://impactstory.org/aleebrahimhttps://impactstory.org/NaderAleEbrahim69325/product/hnby4zk64z09srwq0t0ne5uu
8/17/2019 New Systems for Measuring Research Impact
20/67
©2016-2017 Nader Ale Ebrahim
https://impactstory.org/NaderAleEbrahim69325/product/hnby4zk64z09srwq0t0ne5uuhttps://impactstory.org/NaderAleEbrahim69325/product/hnby4zk64z09srwq0t0ne5uu
8/17/2019 New Systems for Measuring Research Impact
21/67
©2016-2017 Nader Ale Ebrahim
https://impactstory.org/u/0000-0001-7091-4439
8/17/2019 New Systems for Measuring Research Impact
22/67
©2016-2017 Nader Ale Ebrahim
https://plu.mx/u/?orcid=0000-0002-2668-4821
8/17/2019 New Systems for Measuring Research Impact
23/67
©2016-2017 Nader Ale Ebrahim
https://plu.mx/plum/https://plu.mx/plum/https://plu.mx/u/nebrahim
8/17/2019 New Systems for Measuring Research Impact
24/67
PlumX Metrics
©2016-2017 Nader Ale Ebrahim
http://localhost/var/www/apps/conversion/tmp/scratch_2/Link/PlumX-Suite-Flyer.pdf
8/17/2019 New Systems for Measuring Research Impact
25/67
Public Library of Science (PLOS)
Article-Level Metrics (ALMs)
©2016-2017 Nader Ale EbrahimSource: http://www.lagotto.io/plos/
http://www.lagotto.io/plos/http://www.lagotto.io/plos/http://www.lagotto.io/plos/http://www.lagotto.io/plos/
8/17/2019 New Systems for Measuring Research Impact
26/67
Usage Count
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
27/67
Elsevier journals
Top downloaded OA articles
©2016-2017 Nader Ale Ebrahim
http://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htmhttp://about.elsevier.com/openaccess/2015/undefined.htm
8/17/2019 New Systems for Measuring Research Impact
28/67
Bookmetrix - Springer
©2016-2017 Nader Ale Ebrahim
http://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.bookmetrix.com/detail/chapter/a340aec8-a7c3-4405-a8d1-e5cde4b87d3b#downloadshttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrixhttp://www.springer.com/gp/authors-editors/book-authors-editors/bookmetrix
8/17/2019 New Systems for Measuring Research Impact
29/67
Article Metrics in Scopus Effective strategies for increasing citation frequency
(2013) International Education Studies, 6(11), pp. 93-99
©2016-2017 Nader Ale Ebrahim
http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678
8/17/2019 New Systems for Measuring Research Impact
30/67
Article Metrics in Scopus A comparison between two main academic literature collections: Web of science and SCOPUS databases
(2013) Asian Social Science, 9(5), pp. 18-26
©2016-2017 Nader Ale Ebrahim
http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-84876995338&origin=recordpagehttp://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678http://help.elsevier.com/app/answers/detail/a_id/5416/p/8150/incidents.c$portal_account_name/12678
8/17/2019 New Systems for Measuring Research Impact
31/67
Introduction to
altmetrics and Altmetric
@aleebrahim
altmetric.com
Nader Ale Ebrahim, PhDVisiting Research Fellow
Research Support Unit
Centre for Research Services
Research Management & Innovation Complex
University of Malaya, Kuala Lumpur, Malaysia
https://creativecommons.org/licenses/by/3.0/https://twitter.com/aleebrahim
8/17/2019 New Systems for Measuring Research Impact
32/67
Altmetric Ambassador of the Month:Nader Ale Ebrahim
Our Ambassador of the Month for
September is Nader Ale Ebrahim, a visiting
research fellow at the University of Malaya.
He has run over 100 workshops for
researchers in Malaysia, and is consideredan authority on research promotion
practices and metrics tools. Learn more
about what Nader has done so far as an
Altmetric Ambassador on our blog.
©2016-2017 Nader Ale Ebrahim
http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://aleebrahim.com/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://aleebrahim.com/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/http://www.altmetric.com/blog/altmetric-ambassador-of-the-month-september/
8/17/2019 New Systems for Measuring Research Impact
33/67
In this session, we’ll cover…
Introduction to altmetrics
Altmetric tools
Altmetrics use cases
Examples of using altmetrics data
Questions?
1
2
3
4
5
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
34/67
Part 1:Introduction to Altmetrics
8/17/2019 New Systems for Measuring Research Impact
35/67
Journal Impact Factor
Citation countsH-index
Number of publications
o Attention to research outputs in non-traditional sources, e.g. policydocuments, news, blogs and social media
o Indicators of research impact
o Help understand how research is being received and used
o Complementary to traditional citation-based analysis
What are altmetrics?
Mentions in news reports
References in policy
Mentions in social mediaWikipedia citations
Reference manager
readers… etc.
ACADEMIC
ATTENTION
BROADER
ATTENTION
Alternative metrics
“altmetrics”
+Traditional metrics
Traditional
bibliometrics
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
36/67
o Provide a more coherent understanding of research attentiono Understand the broader reach and early impact of research
o Track attention to a broad range of research outputs, including
articles, posters, data sets and working papers, etc.
o Help researchers get credit for impact activities
Why altmetrics?
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
37/67
Advantages of metrics for single research
outputs
Real-time, immediate feedback on attention to
scholarly content
Useful for early career researchers whose work maynot have accrued citations
Showcase attention to a research output beyond
academia
Not biased by an over-arching metric
1
2
3
4
8/17/2019 New Systems for Measuring Research Impact
38/67
Each day, we track
~44,000 new
mentions of research
across sources incl.
social media, news,
and policy docs. That’s 1 mention
every 2 seconds!
Each week,
~50k
unique itemsare shared.
Mentions range incomplexity, from
quick shares to
comprehensive
reviews.
Altmetric data, March 2015
18m
mentions of
~3.7m scholarly
outputs
Altmetric in numbers: mentions and shares
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
39/67
What sources does Altmetric track?
News outlets
• Over 1,300 sites
• Manually curated list
• Text mining
• Global coverage
Social mediaand blogs
• Twitter, Facebook,
Google+, Sina Weibo
• Public posts only
• Manually curated list
Reference
managers
• Mendeley, CiteULike
• Reader counts
• Don’t count towards the
Altmetric score
Other sources
• Wikipedia• YouTube
• F1000
• Q&A
Post-publication
peer review
• Publons
• PubPeer
Policy documents
• NICE Evidence
• Intergovernmental Panel
on Climate Change
• Many more…
8/17/2019 New Systems for Measuring Research Impact
40/67
How does Altmetric aggregate online attention?
Search for links
to papers.
Follow a list ofsources.
Collate
attention.
Display data in
“Altmetric details
pages”.
E.g. blogs, news, policydocuments, social media.
Automatically link
searching and text
mining.
Disambiguation of
mentioned items across
different versions.
Collecting attention data
Reporting attention data
Altmetric Details Page.
All research outputs with
mentions have an Altmetric
Details Page in our
database.©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
41/67
Part 2:
Altmetric Tools
8/17/2019 New Systems for Measuring Research Impact
42/67
The Altmetric Bookmarklet
The free Bookmarklet lets you instantly
retrieve altmetrics data for any article.
To install, go to: http://altmetric.it
©2016-2017 Nader Ale Ebrahim
http://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.php
8/17/2019 New Systems for Measuring Research Impact
43/67
A Comprehensive Comparison of Educational Growth within Four
Different Developing Countries between 1990 and 2012
©2016-2017 Nader Ale Ebrahim
http://dx.doi.org/10.7769/gesec.v6i3.486http://dx.doi.org/10.7769/gesec.v6i3.486http://dx.doi.org/10.7769/gesec.v6i3.486http://dx.doi.org/10.7769/gesec.v6i3.486
8/17/2019 New Systems for Measuring Research Impact
44/67
The Altmetric Bookmarklet
©2016-2017 Nader Ale Ebrahim
http://www.altmetric.com/bookmarklet.phphttp://www.frontiersin.org/Human_Neuroscience/10.3389/fnhum.2013.00291/fullhttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.phphttp://www.altmetric.com/bookmarklet.php
8/17/2019 New Systems for Measuring Research Impact
45/67
Major trends in knowledge management research:
a bibliometric study
©2016-2017 Nader Ale Ebrahim
http://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://link.springer.com/article/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-x
8/17/2019 New Systems for Measuring Research Impact
46/67
1
23
1
23
Altmetric Details Pages
Estimate attention with the “Altmetric score”. Monitor mentions in the mainstream news.
See all the conversations and mentions.
©2016-2017 Nader Ale Ebrahim
http://www.altmetric.com/details.php?citation_id=2897131http://www.altmetric.com/details.php?citation_id=2897131http://www.altmetric.com/details.php?citation_id=2897131
8/17/2019 New Systems for Measuring Research Impact
47/67
What is the Altmetric donut?
The Altmetric donut visualizes which are sources discussing an item.
In the Altmetric Explorer, hover the cursor over the donut visualization to
see the appropriate legend for an item.
Each source is colour coded:
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
48/67
Volume Sources Authors
The score for an article rises as
more people mention it.
Each source category
contributes a different base
amount to the final score.
How often the author of each
mention talks about scholarly
articles influences the
contribution of the mention.
What is the Altmetric score of attention?
The Altmetric score provides an indicator of the attention surrounding aresearch output.
It represents a weighted approximation of all the attention we’ve picked up for a
research output and is calculated according to three facets:
Read more about the score here: altmetric.com/blog/scoreanddonut/
©2016-2017 Nader Ale Ebrahim
http://www.altmetric.com/blog/scoreanddonut/http://www.altmetric.com/blog/scoreanddonut/
8/17/2019 New Systems for Measuring Research Impact
49/67
What can the data tell you?
What type of attention is this research receiving?
Where has this article received the mosttraction?
Which countries are engaging most with thecontent?
Has this article influenced policy, spurred newresearch, or engaged a new audience?
Are reactions to this article positive or negative?
✓
✓
✓
✓
✓
8/17/2019 New Systems for Measuring Research Impact
50/67
Remember that the numbers don’t tell
you…
Quality of the paper
Quality of the researchers
Whole story
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
51/67
Part 3:
Altmetrics Use Cases
8/17/2019 New Systems for Measuring Research Impact
52/67
Uncover conversations about your research
Set up email alerts for
your output in theSummary tab ©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
53/67
Cochrane Library paper investigated use of probiotics to
treat eczema: There is not enough evidence to recommendusing probiotics for the treatment of eczema.
The paper has a relatively low score of attention but
received mentions across policy documents and
Wikipedia:
• Royal College of Paediatrics and Child Health -
Allergy Care Pathways for Children: core
competency for health professionals treating
children with eczema
Discovering policy references
©2016-2017 Nader Ale Ebrahim
http://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdfhttp://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdfhttp://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdfhttp://www.rcpch.ac.uk/system/files/protected/page/2011_RCPCH-CarePathway-Eczema_v3_(19.23).pdf
8/17/2019 New Systems for Measuring Research Impact
54/67
The University of Pittsburgh has embeddedPlumX widgets in their D-Scholarship
institutional repository. You can see metrics
across their institution at Plu.mX/Pitt. They have
also built profiles for researchers across a variety
of disciplines. Some sample profiles:Peter Brusilovsky
Rebecca Crowley
Michael Pinsky
©2016-2017 Nader Ale Ebrahim
http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829https://demo.plu.mx/pitthttps://demo.plu.mx/u/pbrusilovsky/https://demo.plu.mx/u/rcrowley/https://demo.plu.mx/u/mpinsky/https://demo.plu.mx/u/mpinsky/https://demo.plu.mx/u/mpinsky/https://demo.plu.mx/u/rcrowley/https://demo.plu.mx/u/pbrusilovsky/https://demo.plu.mx/u/pbrusilovsky/https://demo.plu.mx/pitthttps://demo.plu.mx/pitthttp://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829http://d-scholarship.pitt.edu/17829/
8/17/2019 New Systems for Measuring Research Impact
55/67
©2016-2017 Nader Ale Ebrahim
http://www.altmetric.com/details.php?citation_id=1429810http://www.genetics.org/content/194/4/1029
8/17/2019 New Systems for Measuring Research Impact
56/67
©2016-2017 Nader Ale Ebrahim
"Th G ld A ? Wh t th 100 M t Cit d
http://www.genetics.org/content/194/4/1029
8/17/2019 New Systems for Measuring Research Impact
57/67
"The Golden Age? What the 100 Most Cited
Articles in Terrorism Studies Tell Us"
©2016-2017 Nader Ale Ebrahim
http://www.tandfonline.com/doi/abs/10.1080/09546553.2015.1064397
8/17/2019 New Systems for Measuring Research Impact
58/67
Teaching Elementary Students Who Speak Black English Vernacular to
Write in Standard English: Effects of Dialect Transformation Practice
©2016-2017 Nader Ale Ebrahim
A d i S h E i S d
http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://www.sciencedirect.com/science/article/pii/S0361476X99910020http://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=main
8/17/2019 New Systems for Measuring Research Impact
59/67
Academic Search Engine Spam and
Google Scholar’s Resilience Against it
©2016-2017 Nader Ale Ebrahim
http://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=mainhttp://quod.lib.umich.edu/j/jep/3336451.0013.305?view=text;rgn=main
8/17/2019 New Systems for Measuring Research Impact
60/67
Discover popular new content to read
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
61/67
Use in grant applications and funder
reporting
I save a tremendous amount
of time for my lab.
©2016-2017 Nader Ale Ebrahim
Fi d t ti l ll b t
8/17/2019 New Systems for Measuring Research Impact
62/67
Find potential collaborators
©2016-2017 Nader Ale Ebrahim
Embed badges on your website or CV
http://www.altmetric.com/badges.phphttp://www.altmetric.com/badges.php
8/17/2019 New Systems for Measuring Research Impact
63/67
Embed badges on your website or CV
©2016-2017 Nader Ale Ebrahim
How are institutions using Altmetric?
http://www.altmetric.com/badges.phphttp://www.altmetric.com/badges.php
8/17/2019 New Systems for Measuring Research Impact
64/67
• Support researchers in all of the above
• Enhance department liaison activities
• Encourage staff to deposit in your research information
system
How are institutions using Altmetric?
Librarians
Marketing
Comms.
Researchers• Track attention to your research immediately• Uncover (unknown) conversations about your research
• Use in grant applications & funder reporting
• Identify research to promote
• Evaluate success of promotion activities
• Identify key researchers
Research
Administrators
• Integrate data into your existing performance reports
• Identify key impacts across institution (i.e. policy docs)
• Benchmarking (thoughtfully!)
©2016-2017 Nader Ale Ebrahim
8/17/2019 New Systems for Measuring Research Impact
65/67
My recent publications
©2016-2017 Nader Ale Ebrahim
RESEARCH SUPPORT UNIT (RSU)CENTRE FOR RESEARCH SERVICES
http://www.revistagesec.org.br/secretariado/article/view/486http://link.springer.com/article/10.1007/s11192-016-1938-xhttp://link.springer.com/article/10.1007/s11192-016-1938-xhttp://www.revistagesec.org.br/secretariado/article/view/486http://dx.doi.org/10.1123/japa.2015-0188http://link.springer.com/article/10.1007/s11192-015-1730-3
8/17/2019 New Systems for Measuring Research Impact
66/67
Questions?
E-mail: [email protected]
Twitter: @aleebrahim
www.researcherid.com/rid/C-2414-2009
http://scholar.google.com/citations
Nader Ale Ebrahim, PhD
=====================================Research Support Unit
Centre for Research Services
Research Management & Innovation Complex
University of Malaya, Kuala Lumpur, Malaysia
www.researcherid.com/rid/C-2414-2009
http://scholar.google.com/citations
RESEARCH MANAGEMENT & INNOVATION COMPLEX (IPPP)
UNIVERSITY OF MALAYA
©2016-2017 Nader Ale Ebrahim
http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://www.researcherid.com/rid/C-2414-2009http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttp://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://www.researcherid.com/rid/C-2414-2009http://scholar.google.com/citations?user=XiIuF7YAAAAJ&hl=en&oi=srahttps://twitter.com/aleebrahim
8/17/2019 New Systems for Measuring Research Impact
67/67
References
1. Akhavan, P., Ale Ebrahim, N., Fetrati, M. A., & Pezeshkan, A. (2016). Major trends in knowledge management research: a bibliometric study. Scientometrics 1-16.doi:10.1007/s11192-016-1938-x
2. Shakiba, M., Ale Ebrahim, N., Danaee, M., Bakhtiyari, K., & Sundararajan, E. (2016). A Comprehensive Comparison of Educational Growth within Four Different
Developing Countries between 1990 and 2012. Revista de Gestão e Secretariado, 6 (3), 152-174. doi:10.7769/gesec.v6i3.486
3. Müller, A. M., Ansari, P., Ale Ebrahim, N., & Khoo, S. (2015). Physical Activity and Aging Research: A Bibliometric Analysis. Journal Of Aging And Physical Activity In
Press. doi:10.1123/japa.2015-0188
4. Maghami, M., Navabi Asl, S., Rezadad, M. i., Ale Ebrahim, N., & Gomes, C. (2015). Qualitative and Quantitative Analysis of Solar hydrogen Generation Literature
From 2001 to 2014. Scientometrics 105 (2), 759-771. : http://dx.doi.org/10.1007/s11192-015-1730-3
5. Ale Ebrahim, N. (2016). Microblogging for Enhancing the Research Accessibility . Retrieved from Research Support Unit, Centre for Research Services, Institute of
Research Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3202093.v1
6. Ale Ebrahim, N. (2016). Establish your expertise with a science blog . Retrieved from Research Support Unit, Centre for Research Services, Institute of Research
Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3185218.v1
7. Ale Ebrahim, N. (2016). Selecting a brand name for your research interest . Retrieved from Research Support Unit, Centre for Research Services, Institute of ResearchManagement and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3153979.v1
8. Ale Ebrahim, N. (2016). Optimize articles for search engine to improve research visibility . Retrieved from Research Support Unit, Centre for Research Services,
Institute of Research Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.3122038.v1
9. Ale Ebrahim, N. (2016). Maximizing Articles Citation Frequency . Retrieved from Research Support Unit, Centre for Research Services, Institute of Research
Management and Monitoring (IPPP)”, University of Malaya: https://dx.doi.org/10.6084/m9.figshare.1572226.v2
10. Konkiel, S. (2014). 30-Day Impact Challenge: the ultimate guide to raising the profile of your research : Impactstory. http://blog.impactstory.org/wp-
content/uploads/2015/01/impact_challenge_ebook_links.pdf
11. Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M., & López-Cózar, E. D. (2016). The counting house, measuring those who count: Presence of Bibliometrics,
Scientometrics, Informetrics, Webometrics and Altmetrics in Google Scholar Citations, ResearcherID, ResearchGate, Mendeley, & Twitter. EC3 Reseach Group:
Evaluación de la Ciencia y de la Comunicación Científica Universidad de Granada and Universidad Politécnica de Valencia (Spain), In Progress,.
doi:10.13140/RG.2.1.4814.4402
12. Onyancha, Omwoyo Bosire. "Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub-Saharan Africa 1." Inkanyiso: Journal of
Humanities and Social Sciences 6.1 (2014): 49-65.
13. Owen Roberson, Research Information Analyst (2015) Research Information and Analytics at Cambridge: Insight over measurement, Research Information Office,
Academic Division
14. Kim Holmberg (2015) Altmetrics: Measuring the impact of scientific activities, Research Unit for the Sociology of Education, University of Turku
http://dx.doi.org/10.1007/s11192-016-1938-xhttp://www.revistagesec.org.br/secretariado/article/view/486http://dx.doi.org/10.1123/japa.2015-0188http://dx.doi.org/10.1007/s11192-015-1730-3https://dx.doi.org/10.6084/m9.figshare.3202093.v1https://dx.doi.org/10.6084/m9.figshare.3185218.v1https://dx.doi.org/10.6084/m9.figshare.3153979.v1https://dx.doi.org/10.6084/m9.figshare.3122038.v1https://dx.doi.org/10.6084/m9.figshare.1572226.v2http://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://files.figshare.com/2282721/UCISA___Owen_Roberson.ppthttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://www.slideshare.net/kholmber/altmetrics-measuring-the-impact-of-scientific-activitieshttp://files.figshare.com/2282721/UCISA___Owen_Roberson.ppthttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttp://blog.impactstory.org/wp-content/uploads/2015/01/impact_challenge_ebook_links.pdfhttps://dx.doi.org/10.6084/m9.figshare.1572226.v2https://dx.doi.org/10.6084/m9.figshare.1572226.v2https://dx.doi.org/10.6084/m9.figshare.3122038.v1https://dx.doi.org/10.6084/m9.figshare.3122038.v1https://dx.doi.org/10.6084/m9.figshare.3153979.v1https://dx.doi.org/10.6084/m9.figshare.3153979.v1https://dx.doi.org/10.6084/m9.figshare.3185218.v1https://dx.doi.org/10.6084/m9.figshare.3185218.v1https://dx.doi.org/10.6084/m9.figshare.3202093.v1https://dx.doi.org/10.6084/m9.figshare.3202093.v1http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1007/s11192-015-1730-3http://dx.doi.org/10.1123/japa.2015-0188http://dx.doi.org/10.1123/japa.2015-0188http://dx.doi.org/10.1123/japa.2015-0188http://www.revistagesec.org.br/secretariado/article/view/486http://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-xhttp://dx.doi.org/10.1007/s11192-016-1938-x