94
Research Assessment to Support Research Impact Cameron Neylon - 1 October 2012 - Lisboa 3 conferência luso-brasiliera acesso aberto a

Research assessment to support research impact

Embed Size (px)

DESCRIPTION

Research assessment to support research impact. - Cameron Neylon (Public Library of Science)

Citation preview

Page 1: Research assessment to support research impact

Research Assessment to Support Research Impact

Cameron Neylon - 1 October 2012 - Lisboa3 conferência luso-brasiliera acesso abertoa

Page 2: Research assessment to support research impact

You are free to:

Copy, share, adapt, or re-mix;

Photograph, film, or broadcast;

Blog, live-blog, or post video of;

This presentation. Provided that:

You attribute the work to its author and respect the rights and licenses associated with its components.

Page 3: Research assessment to support research impact

http://www.flickr.com/photos/amanderson/2421035280 CC-BY

There is a gaping (ethical, moral) hole in our assessment systems

Page 4: Research assessment to support research impact

Something missing...http://www.flickr.com/photos/limaoscarjuliet/3305886294 CC-BY

But if we throw it all out...?

Page 5: Research assessment to support research impact

key points

http://www.flickr.com/photos/y_i/2360600227 CC-BY

Page 7: Research assessment to support research impact

http://www.flickr.com/photos/drachmann/327122302 CC-BY-SA

I don’t have answers...

...only questions

Page 8: Research assessment to support research impact

What do you value?

Page 9: Research assessment to support research impact

What is your mission?

Page 10: Research assessment to support research impact

Values Mission

Page 11: Research assessment to support research impact

Mission Assessment

Page 12: Research assessment to support research impact

Mission Assessment

Page 13: Research assessment to support research impact

Mission Assessment

Page 15: Research assessment to support research impact

Can we measure better?

http://www.flickr.com/photos/sterlic/4299631538 CC-BY

Page 16: Research assessment to support research impact

An assertion.

Page 17: Research assessment to support research impact

We want to see scholarship used.

Page 18: Research assessment to support research impact

In the right places...

http://www.flickr.com/photos/velkr0/3472576304 CC-BY

In the right places...

Page 19: Research assessment to support research impact

http://www.flickr.com/photos/argonne/3465398655 CC-BY

In the right places...

Page 20: Research assessment to support research impact

In the right places...

http://www.flickr.com/photos/ol1/6048544977 CC-BY-SA

Page 21: Research assessment to support research impact

...at the right time.

http://www.flickr.com/photos/robbie73/3387189144 CC-BY-SA

Page 22: Research assessment to support research impact

We want scholarship to be re-used and re-usable

Page 23: Research assessment to support research impact
Page 24: Research assessment to support research impact

Impact = Re-use

Page 25: Research assessment to support research impact

Application = Re-use

Page 26: Research assessment to support research impact

Commercialised = Re-use

Page 27: Research assessment to support research impact

Education = Re-use

Page 28: Research assessment to support research impact

Engagement = Re-use

Page 29: Research assessment to support research impact

...but also...

Page 30: Research assessment to support research impact

Citation = Re-use

Page 32: Research assessment to support research impact

http://www.flickr.com/photos/andrec/2893549851 CC-BY

I can’t tell you which ones matter to you...

Page 33: Research assessment to support research impact

...but we do have new ways to

measure these...

Page 34: Research assessment to support research impact

Articles with impact...

http://www.flickr.com/photos/babasteve/3140688308 CC-BY

Page 35: Research assessment to support research impact

...but (relatively) few citations (yet)

Page 36: Research assessment to support research impact

0 20 40 60 800

2000

4000

6000

8000

10000

12000

14000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.

Months

Total Views

ALM data visualisations courtesy of Martin Fenner

Page 37: Research assessment to support research impact

0 20 40 60 800

2000

4000

6000

8000

10000

12000

14000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.

Months

Total Views

Building the Field of Health Policy and Systems Research: Framing the Questions, PLOS Medicine

Guidance for Evidence-Informed Policies about Health Systems: Rationale for and Challenges of Guidance Development

Page 38: Research assessment to support research impact

0 20 40 60 800

2000

4000

6000

8000

10000

12000

14000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.

Months

Total Views

Page 39: Research assessment to support research impact

0 20 40 60 800

5000

10000

15000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "HIV" in title.

Months

Total Views

“HIV” in title

Page 40: Research assessment to support research impact

0 20 40 60 800

5000

10000

15000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "HIV" in title.

Months

Total Views

Page 41: Research assessment to support research impact

0 20 40 60 800

2000

4000

6000

8000

10000

12000

14000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.

Months

Total Views

Page 42: Research assessment to support research impact

0 20 40 60 800

10000

20000

30000

40000

50000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.

Months

Total Views

Page 43: Research assessment to support research impact

0 20 40 60 800

10000

20000

30000

40000

50000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "Health" in title.

Months

Total Views

Toward a Global View of Alcohol, Tobacco, Cannabis, and Cocaine Use: Findings from the WHO World Mental Health Surveys

Patient Adherence to Tuberculosis Treatment: A Systematic Review of Qualitative Research

Page 44: Research assessment to support research impact

http://total-impact.org/collection/yhb7tr

Lots of data...

Page 45: Research assessment to support research impact

...but here’s a story

Page 46: Research assessment to support research impact

altmetric.com

Page 47: Research assessment to support research impact
Page 48: Research assessment to support research impact

What’s the missing audience for these

South African papers?

Page 49: Research assessment to support research impact
Page 50: Research assessment to support research impact

...here’s one...

Page 51: Research assessment to support research impact

Not very high views

Page 52: Research assessment to support research impact

0 20 40 60 800

5000

10000

15000

PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "HIV" in title.

Months

Total Views

Not an obvious outlier...

Page 53: Research assessment to support research impact

...but highly relevant interactions

Page 54: Research assessment to support research impact
Page 55: Research assessment to support research impact

...driven by this person...

Page 56: Research assessment to support research impact

...who I can talk to.

Page 57: Research assessment to support research impact
Page 58: Research assessment to support research impact
Page 59: Research assessment to support research impact

See http://bit.ly/NJOyUn for the whole conversation

Page 60: Research assessment to support research impact

This. Is Impact.

Page 61: Research assessment to support research impact

It’s not about where you publish...

Page 62: Research assessment to support research impact

...but who you reach

Page 64: Research assessment to support research impact

Think at network scale...

Page 65: Research assessment to support research impact

You’re used to thinking about reaching scholars...

Page 66: Research assessment to support research impact
Page 67: Research assessment to support research impact

...but at the scale of the network...

Page 68: Research assessment to support research impact
Page 69: Research assessment to support research impact

...there are many ways to make connections...

Page 70: Research assessment to support research impact
Page 71: Research assessment to support research impact

...and not all of them with your traditional audience..

Page 72: Research assessment to support research impact

You don’t even know who most of them are..

Page 73: Research assessment to support research impact

...so how do you maximise reach?

Page 74: Research assessment to support research impact

http://flickr.com/photos/virtualsugar/316200555/ CC-BY

Page 75: Research assessment to support research impact

key points

http://www.flickr.com/photos/y_i/2360600227 CC-BY

key points

Page 76: Research assessment to support research impact

http://www.flickr.com/photos/andrec/2893549851 CC-BY

Page 77: Research assessment to support research impact

Values Mission

Page 79: Research assessment to support research impact

http://www.flickr.com/photos/sterlic/4299631538 CC-BY

Page 80: Research assessment to support research impact

Mission Assessment

Page 81: Research assessment to support research impact

Assessment Impact

Page 83: Research assessment to support research impact

Think like the network.

Page 84: Research assessment to support research impact
Page 85: Research assessment to support research impact

We can’t build a system on yesterday’s truths.

Page 86: Research assessment to support research impact

We could maintain a system on today’s....

Page 87: Research assessment to support research impact

...for a while

http://www.flickr.com/photos/22746515@N02/4375854224 CC-BY

Page 88: Research assessment to support research impact

You build for the future on tomorrow’s realities...

http://www.flickr.com/photos/yakobusan/2436481628 CC-BY

Page 89: Research assessment to support research impact

Innovators don’t follow markets...

http://www.flickr.com/photos/petrick/2291498814 CC-BY

Page 90: Research assessment to support research impact

...they build them.

http://www.flickr.com/photos/98528214@N00/312210315/ CC-BY-SA

Page 91: Research assessment to support research impact

Networks are the future.

http://www.flickr.com/photos/pagedooley/3143417443 CC-BY

Page 92: Research assessment to support research impact

Not rankings...

http://www.flickr.com/photos/73112697@N03/6597508893 CC-BY

Page 93: Research assessment to support research impact

http://www.flickr.com/photos/mgifford/3558463424 CC-BY-SA

Page 94: Research assessment to support research impact

@cameronneylonhttp://cameronneylon.net