Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield

Academic Publishing is Evolving…

Article Level MetricsLooking Backwards / Looking

Forwards

Pete Binfield Co-Founder and Publisher PeerJ

The PLOS ALM Workshop 10/10/2013

@ThePeerJhttps://peerj.com

@[email protected]


Q2 13

Q1 13

Q4 12

Q3 12

Q2 12

Q1 12

Q4 11

Q3 11

Q2 11

Q1 11

Q4 10

Q3 10

Q2 10

Q1 10

Q4 09

Q3 09

Q2 09

Q1 09

Q4 08

Q3 08

Q2 08

Q1 08

Q4 07

Q3 07

Q2 07

Q1 07

Q4 06

0

1000

2000

3000

4000

5000

6000

7000

8000

Year Pubs Notes2007

1,200 Larger than ~ 95% of all journals

2008

2,800 Largest OA journal in world

2009

4,400 3rd largest journal in world

2010

6,750 Largest journal in world

2011

13,800 ~1.4% of PubMed output in that year

2012

23,500 ~2.4% of PubMed output in that year

2013

~31,000

>3% of the literature

PLOS ONE Quarterly Published Output

http://figshare.com/articles/Scale_of_OA_Publishing/650794

Stacked area graph of the contribution ofmajor ‘APC’ OA publishers (articles per year)

http://figshare.com/articles/Scale_of_OA_Publishing/650794

Academic Publishing is Evolving…Screenshot from ~ Nov 2009 but Way Back Machine has examples from April 2008

PLOS Didn’t Invent Article Level Metrics


Launched in May 2007 http://journalofvision.org/7/7/i/http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2

Academic Publishing is Evolving…June 2007

Academic Publishing is Evolving…~ May 2009 (NISO presentation)http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2


So How Did We Get Here:



Bill Hooker, Sep 30th 2008. In Comments on http://thewobblingmind.wordpress.com/2008/08/31/feasibility-of-plos-ones-peer-review-model/

http://thewobblingmind.wordpress.com/2008/08/31/feasibility-of-plos-ones-peer-review-model/



Academic Publishing is Evolving… Internal to PLOS Mid-2008(thanks to J Lin for providing)


Internal to PLOS Mid-2008(thanks to J Lin for providing)


• A test ALM Email was sent to Authors, in ~ August 2008• at which point PLOS ONE had published ~3,100 articles

• The mailing was merged to all corresponding authors whose articles exceeded certain thresholds for having ALMs to report on

• We provided info which was scraped / obtained from• Google Scholar• Google Analytics• PLOS Commenting functionality• CiteULike• Google News

• Response was 100% positive – giving us reassurance about messaging

Testing the Concept

August 2008



Presentation at Raleigh, November 2008

Academic Publishing is Evolving…http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/Mar 31st 2009. It wasn’t called ALMs in this ‘official’ post…

http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/

http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/


http://www.myplick.com/user/PLoS

http://blogs.plos.org/everyone/2009/03/31/newly-launched-features-on-our-online-platform/1st use of the phrase by us?

http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/ Possible first public use of the phrase ‘article level metrics’ by PLOS



http://blogs.plos.org/everyone/2009/03/31/newly-launched-features-on-our-online-platform/



http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/

http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/



http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2?from_search=27

May 2009 to NISO





Academic Publishing is Evolving…http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/and http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/ by Rich CaveSept 16th 2009. Note: it was now called ALMs…

http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/

http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/

http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/

http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/


Any Effects?



Michael Habib, Elsevier, Oct 2009



“This paper is featured in a commentary in the Journal of XXX and has been evaluated as “must read” by XXX for the Faculty of 1000 Biology.”

“Top downloaded paper in XXX in 2011”

“PLoS ONE metrics show that this article had 6,358 online views and 1,318 downloads within 3 months of publication. These compare with annual average life-time views of papers ranging from 400 to 2,800 in all PLoS journals, and 600 in PLoS ONE. In early December 2011, its usage was 10,400 versus an average of 900/paper for the journal. It is the 3rd most highly cited paper amongst the XXX papers in the journal.“

Quotes from 3 Resumes (in the Last Few Days)

Note: No one ever mentions tweets, likes, bookmarks etc…


http://www.nature.com/naturejobs/science/articles/10.1038/nj7463-491a




http://scholarlykitchen.sspnet.org/2013/09/03/what-does-a-scientist-want/#comment-109084


Looking Forwards


Have they fulfilled their original aims?



Is Anyone Using them Fully?


To What Extent AreWe Talking To Ourselves?


Is this the best usage display we can do?

c.f. Frontiers in 2008…


Why has no publisher equaled / surpassed this?


Access to the Data?


Internal to PLOS Mid-2008(thanks to J Lin for providing)

Science Online Jan 2010

What Is STILL Missing?


Thank You

Pete BinfieldCo-Founder and Publisher

@[email protected] @ThePeerJ

Documents

Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield