title: Response to Comment on "Estimating the reproducibility of psychological science".
abstract: Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.
authors.affiliation: Russell Sage College, Troy, NY, USA. nosek@virginia.edu.
authors.forename: Christopher J
authors.initials: CJ
authors.lastname: Anderson
authors.affiliation: University of Würzburg, Würzburg, Germany.
authors.forename: Štěpán
authors.initials: Š
authors.lastname: Bahník
authors.affiliation: University of Waterloo, Waterloo, Ontario, Canada.
authors.forename: Michael
authors.initials: M
authors.lastname: Barnett-Cowan
authors.affiliation: Virginia Commonwealth University, Richmond, VA, USA.
authors.forename: Frank A
authors.initials: FA
authors.lastname: Bosco
authors.affiliation: University of Michigan, Ann Arbor, MI 48104, USA. Mathematica Policy Research, Washington, DC, USA.
authors.forename: Jesse
authors.initials: J
authors.lastname: Chandler
authors.affiliation: Ashland University, Ashland, OH, USA.
authors.forename: Christopher R
authors.initials: CR
authors.lastname: Chartier
authors.affiliation: Michigan State University, East Lansing, MI, USA.
authors.forename: Felix
authors.initials: F
authors.lastname: Cheung
authors.affiliation: Southern Oregon University, Ashland, OR, USA.
authors.forename: Cody D
authors.initials: CD
authors.lastname: Christopherson
authors.affiliation: University of Göttingen, Institute for Psychology, Göttingen, Germany.
authors.forename: Andreas
authors.initials: A
authors.lastname: Cordes
authors.affiliation: University of Southern California, Los Angeles, CA, USA.
authors.forename: Edward J
authors.initials: EJ
authors.lastname: Cremata
authors.affiliation: Australian National University, Canberra, Australia.
authors.forename: Nicolas
authors.initials: N
authors.lastname: Della Penna
authors.affiliation: Technische Universität Braunschweig, Braunschweig, Germany.
authors.forename: Vivien
authors.initials: V
authors.lastname: Estel
authors.affiliation: Parmenides Stiftung, Munich, Germany.
authors.forename: Anna
authors.initials: A
authors.lastname: Fedor
authors.affiliation: Queen's University, Kingston, Ontario, Canada.
authors.forename: Stanka A
authors.initials: SA
authors.lastname: Fitneva
authors.affiliation: Stanford University, Stanford, CA, USA.
authors.forename: Michael C
authors.initials: MC
authors.lastname: Frank
authors.affiliation: Keele University, Keele, Staffordshire, UK.
authors.forename: James A
authors.initials: JA
authors.lastname: Grange
authors.affiliation: Boston College, Chestnut Hill, MA, USA.
authors.forename: Joshua K
authors.initials: JK
authors.lastname: Hartshorne
authors.affiliation: Radboud University Nijmegen, Nijmegen, Netherlands.
authors.forename: Fred
authors.initials: F
authors.lastname: Hasselman
authors.affiliation: University of Koblenz-Landau, Landau, Germany.
authors.forename: Felix
authors.initials: F
authors.lastname: Henninger
authors.affiliation: Erasmus Medical Center, Rotterdam, Netherlands.
authors.forename: Marije
authors.initials: M
authors.lastname: van der Hulst
authors.affiliation: University of Amsterdam, Amsterdam, Netherlands.
authors.forename: Kai J
authors.initials: KJ
authors.lastname: Jonas
authors.affiliation: Harvard University, Cambridge, MA, USA.
authors.forename: Calvin K
authors.initials: CK
authors.lastname: Lai
authors.affiliation: Occidental College, Los Angeles, CA, USA.
authors.forename: Carmel A
authors.initials: CA
authors.lastname: Levitan
authors.affiliation: Willamette University, Salem, OR, USA.
authors.forename: Jeremy K
authors.initials: JK
authors.lastname: Miller
authors.affiliation: Arcadia University, Glenside, PA, USA.
authors.forename: Katherine S
authors.initials: KS
authors.lastname: Moore
authors.affiliation: University of Potsdam, Potsdam, Germany.
authors.forename: Johannes M
authors.initials: JM
authors.lastname: Meixner
authors.affiliation: University of Bristol, Bristol, UK.
authors.forename: Marcus R
authors.initials: MR
authors.lastname: Munafò
authors.affiliation: Vrije Universiteit Amsterdam, Amsterdam, Netherlands.
authors.forename: Koen I
authors.initials: KI
authors.lastname: Neijenhuijs
authors.affiliation: Karolinska Institutet, Stockholm University, Stockholm, Sweden.
authors.forename: Gustav
authors.initials: G
authors.lastname: Nilsonne
authors.affiliation: Center for Open Science, Charlottesville, VA, USA. University of Virginia, Charlottesville, VA, USA. nosek@virginia.edu.
authors.forename: Brian A
authors.initials: BA
authors.lastname: Nosek
authors.affiliation: Harvard Medical School, Boston, MA, USA.
authors.forename: Franziska
authors.initials: F
authors.lastname: Plessow
authors.affiliation: Loyola University, Baltimore, MD, USA.
authors.forename: Jason M
authors.initials: JM
authors.lastname: Prenoveau
authors.affiliation: University of California, Riverside, CA, USA.
authors.forename: Ashley A
authors.initials: AA
authors.lastname: Ricker
authors.affiliation: Wesleyan University, Middletown, CT, USA.
authors.forename: Kathleen
authors.initials: K
authors.lastname: Schmidt
authors.affiliation: Center for Open Science, Charlottesville, VA, USA. University of Virginia, Charlottesville, VA, USA.
authors.forename: Jeffrey R
authors.initials: JR
authors.lastname: Spies
authors.affiliation: University of Konstanz, Konstanz, Germany.
authors.forename: Stefan
authors.initials: S
authors.lastname: Stieger
authors.affiliation: Yale University, New Haven, CT, USA.
authors.forename: Nina
authors.initials: N
authors.lastname: Strohminger
authors.affiliation: Coventry University, Coventry, UK.
authors.forename: Gavin B
authors.initials: GB
authors.lastname: Sullivan
authors.affiliation: Tilburg University, Tilburg, Netherlands.
authors.forename: Robbie C M
authors.initials: RC
authors.lastname: van Aert
authors.affiliation: Tilburg University, Tilburg, Netherlands. Utrecht University, Utrecht, Netherlands.
authors.forename: Marcel A L M
authors.initials: MA
authors.lastname: van Assen
authors.affiliation: University of Leuven, Leuven, Belgium.
authors.forename: Wolf
authors.initials: W
authors.lastname: Vanpaemel
authors.affiliation: University of Padova, Padova, Italy.
authors.forename: Michelangelo
authors.initials: M
authors.lastname: Vianello
authors.affiliation: University of Vienna, Vienna, Austria.
authors.forename: Martin
authors.initials: M
authors.lastname: Voracek
authors.affiliation: Adams State University, Alamosa, CO, USA.
authors.forename: Kellylynn
authors.initials: K
authors.lastname: Zuni
mesh_terms: D035841:Behavioral Research; D011584:Psychology; D011643:Publishing; D012106:Research