Reproducing statistical results

Victoria Stodden

Research output: Contribution to journalArticlepeer-review


The reproducibility of statistical findings has become a concern not only for statisticians, but for all researchers engaged in empirical discovery. Section 2 of this article identifies key reasons statistical findings may not replicate, including power and sampling issues; misapplication of statistical tests; the instability of findings under reasonable perturbations of data or models; lack of access to methods, data, or equipment; and cultural barriers such as researcher incentives and rewards. Section 3 discusses five proposed remedies for these replication failures: improved prepublication and postpublication validation of findings; the complete disclosure of research steps; assessment of the stability of statistical findings; providing access to digital research objects, in particular data and software; and ensuring these objects are legally reusable.

Original languageEnglish (US)
Pages (from-to)1-19
Number of pages19
JournalAnnual Review of Statistics and Its Application
StatePublished - Apr 10 2015


  • Code sharing
  • Data sharing
  • Open code
  • Open data
  • Open licensing
  • Open science
  • Replication
  • Reproducible research
  • Statistical reproducibility

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty


Dive into the research topics of 'Reproducing statistical results'. Together they form a unique fingerprint.

Cite this