title: Nonparametric estimation of the rediscovery rate.
abstract: Validation studies have been used to increase the reliability of the statistical conclusions for scientific discoveries; such studies improve the reproducibility of the findings and reduce the possibility of false positives. Here, one of the important roles of statistics is to quantify reproducibility rigorously. Two concepts were recently defined for this purpose: (i) rediscovery rate (RDR), which is the expected proportion of statistically significant findings in a study that can be replicated in the validation study and (ii) false discovery rate in the validation study (vFDR). In this paper, we aim to develop a nonparametric approach to estimate the RDR and vFDR and show an explicit link between the RDR and the FDR. Among other things, the link explains why reproducing statistically significant results even with low FDR level may be difficult. Two metabolomics datasets are considered to illustrate the application of the RDR and vFDR concepts in high-throughput data analysis. Copyright © 2016 John Wiley & Sons, Ltd.
authors.affiliation: Department of Statistics, Ewha Womans University, Seoul, Korea.
authors.forename: Donghwan
authors.initials: D
authors.lastname: Lee
authors.affiliation: Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden.|Program in Medical and Population Genetics, Broad Institute of MIT and Harvard, Cambridge, MA, U.S.A.|Analytical and Translational Genetics Unit, Department of Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, MA, U.S.A.
authors.forename: Andrea
authors.initials: A
authors.lastname: Ganna
authors.affiliation: Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden.
authors.forename: Yudi
authors.initials: Y
authors.lastname: Pawitan
authors.affiliation: Department of Statistics, Inha University, Incheon, Korea.
authors.forename: Woojoo
authors.initials: W
authors.lastname: Lee
mesh_terms: D000465:Algorithms; D006801:Humans; D015203:Reproducibility of Results; D018709:Statistics, Nonparametric
keywords: false discovery rate; multiple testing; rediscovery rate; validation study