Plum analytics - acs -- 2013-09-09

1

?

Andrea Michalek, Co-founderandrea@plumanalytics.com

@amichalek@plumanalytics

Plum Analytics: An altmetrics tool for determining impact in the chemical

sciences

Management TeamAndrea Michalek – Co-Founder and CEO• Helped launch dozens of early stage

companies• Director of Technology for Summon® --

$15M scholarly search used in 450 libraries worldwide

Mike Buschman – Co-Founder and Chief Product Officer• Program Manager for Microsoft Academic

Search and Book Search—both launched in 2006

• Director of Product Management for Summon® 2

3

Current State of Scholarly Measure

Well-known Problems with Citation Analysis• Self-citations• Citations added because of pressure by editors• Negative citations• Only about 30% of influences are cited*• “Informal” influence isn’t measured through citations• Secondary sources• Review articles “take” citations away from reviewed

articles• Matthew effect – the rich get richer

* MacRoberts and MacRoberts, 2010

4

5

Citations are only a small fraction of how a paper is reused

5

0.3%

100%

22.3%

Article-Level Metrics collected October 10, 2012 for 62,536 PLOS Papers

The world has changed

6

Scholarly Data Exhaust

7

Different categories of impact•Citations•Usage•Captures•Mentions•Social Media

8

Altmetrics

Tracks 20+ Types of Artifacts• Articles• Blog posts• Book chapters• Books• Cases• Clinical Trials• Conference Papers• Data Sets• Figures• Grants• Interviews 9

• Letters• Media• Patents• Posters• Presentations• Reports• Source Code• Theses /

Dissertations• Videos• Web Pages

Associate Artifacts

10

Artifacts can be associated with a researcher and/or a group

Each section can be expanded to fill in details.

Largest List of Metrics Sources• Amazon• Bit.ly• CrossRef• Delicious• Dryad• dSpace• ePrints• Facebook• Figshare

11

• Github• Google+• Microsoft

Academic Search• PLOS• PubMed• Reddit• Research Blogging• Scopus

• SlideShare• SourceForge• Stack Overflow• Topsy (Twitter)• USPTO• Vimeo• Wikipedia• Worldcat• YouTube

PlumX Platform: Built for Big Data• Built for Scale – goal tracking all the world’s researchers,

all of their outputs, and metrics for each.• Technology that solves inherent problems around:• Author disambiguation• Identity Resolution• Calculating combined metrics • Harvesting metrics at scale

• Experience architecting scalable platforms• E.g., Summon – provides sub-second response time to

searching over 1B documents (including full text of both articles and books) 12

Different categories of impact• Usage• Downloads, views, book holdings, ILL, document

delivery• Captures• Favorites, bookmarks, saves, readers, groups, watchers

• Mentions• Blog post, news story, Wikipedia article, comments,

review• Social Media• Tweets, Google +1s, likes, shares, ratings

• Citations• Web of Science, Scopus, Google Scholar, Microsoft

Academic Search, patents

13

14

Artifact view

Build User Profiles from Existing Systems• Set of tools that can utilize existing systems.

• Examples• Google Scholar: BibTeX• ORCID• VIVO• Institutional repositories: bePress, dSpace, ePrints• Etc.

• Our goal: We integrate with what our customers have implemented limit re-entry of data

15

16

PlumX Author Profiles

Tabular ViewSortable, table-view of full output.

Exportable to spreadsheets or integrated into other applications.

17

PlumX Tracks Groups• University• Institute• Museum• Department• Lab• Company• Publisher• Journal• Volume• Issue• Collection 18

19

Metrics Preview in Search Results

21

“Same” Article, Different Places

22

Metrics for Every Copy

23

• 59 Bitly clicks through PLOS• 21 Bitly clicks through DOI link• 92 Delicious bookmarks to PLOS• 2 Delicious bookmarks to PubMed

Researcher Who Blogs

24

•Why is this discovery significant?•What are the most important conclusions?•What does our study NOT say?

2nd Level Metrics

25

Does the # of citations tell the whole story?

• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1

Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.

26

Comparison Visualization

27

28

Author / Group Visualization

Group, Author and Artifact Widgets

29

30

Thank You!

Try PlumX Todayhttp://try.plu.mx@plumanalytics

@amichalek

30Andrea Michalek

andrea@plumanalytics.com215.280.1805