22
Evidence based data analysis Jeff Leek @simplystats

Evidence based data analysis

  • Upload
    jtleek

  • View
    280

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Evidence based data analysis

Evidence based data analysis

Jeff Leek

@simplystats

Page 2: Evidence based data analysis

What Roger said but with more pictures.

Jeff Leek

@simplystats

Page 3: Evidence based data analysis
Page 4: Evidence based data analysis

The tools for reproducibility already exist.*

Page 5: Evidence based data analysis
Page 6: Evidence based data analysis
Page 7: Evidence based data analysis
Page 8: Evidence based data analysis

I think that it is ironic that a paper that claims to prove the reliability of the literature had completely messed up the two main figures that represent the core of all its data and its main results.

Page 9: Evidence based data analysis

An analysis can be fully reproducible and still be wrong.

Page 10: Evidence based data analysis

http://bioinformatics.mdanderson.org/Supplements/ReproRsch-All/

Page 11: Evidence based data analysis

Training not tools

Page 12: Evidence based data analysis

Fisher et al. (2014) http://dx.doi.org/10.7717/peerj.589

Page 13: Evidence based data analysis

Fisher et al. (2014) http://dx.doi.org/10.7717/peerj.589

Page 14: Evidence based data analysis

Prevention not treatment

Page 15: Evidence based data analysis

Leek and Peng (2015) doi: 10.1073/pnas.1421412111

Page 16: Evidence based data analysis
Page 17: Evidence based data analysis

Scaling training

Page 18: Evidence based data analysis
Page 19: Evidence based data analysis

1,750,000+Enrolled

Page 20: Evidence based data analysis

Even simple things are hard at scale

Page 21: Evidence based data analysis

Leek and Peng (2015) DOI: 10.1126/science.aaa6146

Page 22: Evidence based data analysis