Upload
william-gunn
View
108
Download
2
Tags:
Embed Size (px)
DESCRIPTION
Mendeley Talk on Reproducibility
Citation preview
Elizabeth Iorns, Ph.D.
CEO, Science Exchange
CREATING A
REPRODUCIBILITY
CULTURE
To survive professionally, scientists feel the need to publish as many papers as
possible, and to get them into high-profile journals. And sometimes they cut
corners or even commit misconduct to get there.
“
Too many sloppy mistakes are creeping into scientific papers. Lab heads must
look more rigorously at the data — and at themselves.
“
This is one of medicine's dirty secrets: Most results, including those that
appear in top-flight peer-reviewed journals, can't be reproduced.
“
Separate the wheat from the chaff
Robust Research
Less Robust Research
We didn’t see that a target is
more likely to be validated if it
was reported in ten publications
or in two publications NATURE REVIEWS DRUG DISCOVERY 10, 712 (SEPTEMBER 2011)
Either the results were reproducible
and showed transferability in other
models, or even a 1:1 reproduction of
published experimental procedures
revealed inconsistencies between
published and in-house data NATURE REVIEWS DRUG DISCOVERY 10, 712 (SEPTEMBER 2011)
HOW IT WORKS
1. Researchers submit studies for independent validation
2. Scientific Advisory Board reviews studies
3. Experiments are matched to qualified scientific service
providers in a blind manner
4. Scientific Advisory Board assesses the reproducibility of
the result
RESEARCHERS Core
Facilities
ADVISORY
BOARD
INCENTIVES Public
Support
RESEARCHERS Core
Facilities
ADVISORY
BOARD
INCENTIVES Public
Support
Scientific Advisory Board
George Robertson
Dalhouise University
Elizabeth Iorns
Science Exchange
John Ioannidis
Stanford University
Bernard Munos
InnoThink
Brian Nosek
University of Virginia
Heather Piwowar
Duke University
Sitta Sittampalam
NIH NCATS
Victoria Stodden
Columbia University
Bruce Booth
Atlas Ventures
Lee Ellis
MD Anderson
RESEARCHERS Core
Facilities
ADVISORY
BOARD
INCENTIVES Public
Support
RESEARCHERS Core
Facilities
ADVISORY
BOARD
INCENTIVES Public
Support
INCENTIVES
Guaranteed publication in PLOS
ONE Reproducibility Collection
Acknowledgement of reproduction
in journals and online repositories
Certificate of Reproducibility to help
with commercialization of research
RESEARCHERS Core
Facilities
ADVISORY
BOARD
INCENTIVES Public
Support
CREATING A REPRODUCIBILITY CULTURE