title: Data from a pre-publication independent replication initiative examining ten moral judgement effects.
abstract: We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Warren
authors.initials: W
authors.lastname: Tierney
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Martin
authors.initials: M
authors.lastname: Schweinsberg
authors.affiliation: IMD, Lausanne, Lausanne 1001, Switzerland.
authors.forename: Jennifer
authors.initials: J
authors.lastname: Jordan
authors.affiliation: University of Washington Bothell, Bothell 98011, USA.
authors.forename: Deanna M
authors.initials: DM
authors.lastname: Kennedy
authors.affiliation: IE Business School, IE University, Madrid 28006, Spain.
authors.forename: Israr
authors.initials: I
authors.lastname: Qureshi
authors.affiliation: HEC Paris, Jouy-en-Josas 78351, France.
authors.forename: S Amy
authors.initials: SA
authors.lastname: Sommer
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Nico
authors.initials: N
authors.lastname: Thornley
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Nikhil
authors.initials: N
authors.lastname: Madan
authors.affiliation: University of Padova, Padova 35131, Italy.
authors.forename: Michelangelo
authors.initials: M
authors.lastname: Vianello
authors.affiliation: University of Washington, Seattle 98195, USA.
authors.forename: Eli
authors.initials: E
authors.lastname: Awtrey
authors.affiliation: University of Manitoba, Winnipeg R3T 5V4, Canada.
authors.forename: Luke Lei
authors.initials: LL
authors.lastname: Zhu
authors.affiliation: University of Chicago, Chicago 60637, USA.
authors.forename: Daniel
authors.initials: D
authors.lastname: Diermeier
authors.affiliation: University of Michigan, Ann Arbor 48109, USA.
authors.forename: Justin E
authors.initials: JE
authors.lastname: Heinze
authors.affiliation: Harvard University, Cambridge 2138, USA.
authors.forename: Malavika
authors.initials: M
authors.lastname: Srinivasan
authors.affiliation: University of Utah, Salt Lake City 84112, USA.
authors.forename: David
authors.initials: D
authors.lastname: Tannenbaum
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Eliza
authors.initials: E
authors.lastname: Bivolaru
authors.affiliation: Yale University, New Haven 6511, USA.
authors.forename: Jason
authors.initials: J
authors.lastname: Dana
authors.affiliation: University of Missouri, Columbia 65211, USA.
authors.forename: Clintin P
authors.initials: CP
authors.lastname: Davis-Stober
authors.affiliation: Rotterdam School of Management, Erasmus University, Rotterdam 3000 DR, The Netherlands.
authors.forename: Christilene
authors.initials: C
authors.lastname: du Plessis
authors.affiliation: University of Amsterdam, Amsterdam 1001 NK, The Netherlands.
authors.forename: Quentin F
authors.initials: QF
authors.lastname: Gronau
authors.affiliation: UCP-Católica Lisbon School of Business &Economics, Lisbon 1649-023, Portugal.
authors.forename: Andrew C
authors.initials: AC
authors.lastname: Hafenbrack
authors.affiliation: Hang Seng Management College, Hong Kong, Hong Kong.
authors.forename: Eko Yi
authors.initials: EY
authors.lastname: Liao
authors.affiliation: University of Amsterdam, Amsterdam 1001 NK, The Netherlands.
authors.forename: Alexander
authors.initials: A
authors.lastname: Ly
authors.affiliation: University of Amsterdam, Amsterdam 1001 NK, The Netherlands.
authors.forename: Maarten
authors.initials: M
authors.lastname: Marsman
authors.affiliation: Roosevelt University, Chicago 60605, USA.
authors.forename: Toshio
authors.initials: T
authors.lastname: Murase
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Michael
authors.initials: M
authors.lastname: Schaerer
authors.affiliation: University of Illinois at Urbana-Champaign, Champaign 61820, USA.
authors.forename: Christina M
authors.initials: CM
authors.lastname: Tworek
authors.affiliation: University of Amsterdam, Amsterdam 1001 NK, The Netherlands.
authors.forename: Eric-Jan
authors.initials: EJ
authors.lastname: Wagenmakers
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Lynn
authors.initials: L
authors.lastname: Wong
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Tabitha
authors.initials: T
authors.lastname: Anderson
authors.affiliation: University of California, Irvine 92697, USA.
authors.forename: Christopher W
authors.initials: CW
authors.lastname: Bauman
authors.affiliation: University of South Florida, Tampa 33620, USA.
authors.forename: Wendy L
authors.initials: WL
authors.lastname: Bedwell
authors.affiliation: Yale University, New Haven 6511, USA.
authors.forename: Victoria
authors.initials: V
authors.lastname: Brescoll
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Andrew
authors.initials: A
authors.lastname: Canavan
authors.affiliation: Institute for Social Research, University of Michigan, Ann Arbor 48104, USA.
authors.forename: Jesse J
authors.initials: JJ
authors.lastname: Chandler
authors.affiliation: University of Massachusetts Amherst, Amherst 1003, USA.
authors.forename: Erik
authors.initials: E
authors.lastname: Cheries
authors.affiliation: University of Washington, Seattle 98195, USA.
authors.forename: Sapna
authors.initials: S
authors.lastname: Cheryan
authors.affiliation: Washington University in St Louis, St Louis 63130, USA.|University of Hong Kong, Hong Kong, Hong Kong.
authors.forename: Felix
authors.initials: F
authors.lastname: Cheung
authors.affiliation: Department of Psychology, New York University, New York 10003, USA.
authors.forename: Andrei
authors.initials: A
authors.lastname: Cimpian
authors.affiliation: American University, Washington 20016, USA.
authors.forename: Mark A
authors.initials: MA
authors.lastname: Clark
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Diana
authors.initials: D
authors.lastname: Cordon
authors.affiliation: Harvard University, Cambridge 2138, USA.
authors.forename: Fiery
authors.initials: F
authors.lastname: Cushman
authors.affiliation: University of California, Irvine 92697, USA.
authors.forename: Peter H
authors.initials: PH
authors.lastname: Ditto
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Alice
authors.initials: A
authors.lastname: Amell
authors.affiliation: University of South Florida, Tampa 33620, USA.
authors.forename: Sarah E
authors.initials: SE
authors.lastname: Frick
authors.affiliation: Northwestern University, Evanston 60208, USA.
authors.forename: Monica
authors.initials: M
authors.lastname: Gamez-Djokic
authors.affiliation: University of California, Irvine 92697, USA.
authors.forename: Rebecca Hofstein
authors.initials: RH
authors.lastname: Grady
authors.affiliation: University of Southern California, Los Angeles 90089, USA.
authors.forename: Jesse
authors.initials: J
authors.lastname: Graham
authors.affiliation: Monash University, Melbourne 3145, Australia.
authors.forename: Jun
authors.initials: J
authors.lastname: Gu
authors.affiliation: Social Cognition Center Cologne, University of Cologne, Koeln 50931, Germany.
authors.forename: Adam
authors.initials: A
authors.lastname: Hahn
authors.affiliation: University of Illinois at Chicago, Chicago 60607, USA.
authors.forename: Brittany E
authors.initials: BE
authors.lastname: Hanson
authors.affiliation: Social Cognition Center Cologne, University of Cologne, Koeln 50931, Germany.
authors.forename: Nicole J
authors.initials: NJ
authors.lastname: Hartwich
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Kristie
authors.initials: K
authors.lastname: Hein
authors.affiliation: University of Toronto, Toronto ON M5S, Canada.
authors.forename: Yoel
authors.initials: Y
authors.lastname: Inbar
authors.affiliation: University of Washington, Seattle 98195, USA.
authors.forename: Lily
authors.initials: L
authors.lastname: Jiang
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Tehlyr
authors.initials: T
authors.lastname: Kellogg
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Nicole
authors.initials: N
authors.lastname: Legate
authors.affiliation: Social Cognition Center Cologne, University of Cologne, Koeln 50931, Germany.
authors.forename: Timo P
authors.initials: TP
authors.lastname: Luoma
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Heidi
authors.initials: H
authors.lastname: Maibeucher
authors.affiliation: University of Pennsylvania, Philadelphia 19104, USA.
authors.forename: Peter
authors.initials: P
authors.lastname: Meindl
authors.affiliation: University of California, Irvine 92697, USA.
authors.forename: Jennifer
authors.initials: J
authors.lastname: Miles
authors.affiliation: American University, Washington 20016, USA.
authors.forename: Alexandra
authors.initials: A
authors.lastname: Mislin
authors.affiliation: Northwestern University, Evanston 60208, USA.
authors.forename: Daniel C
authors.initials: DC
authors.lastname: Molden
authors.affiliation: University of Illinois at Chicago, Chicago 60607, USA.
authors.forename: Matt
authors.initials: M
authors.lastname: Motyl
authors.affiliation: Yale University, New Haven 6511, USA.
authors.forename: George
authors.initials: G
authors.lastname: Newman
authors.affiliation: Université Paris Ouest Nanterre La Défense, Nanterre 92000, France.
authors.forename: Hoai Huong
authors.initials: HH
authors.lastname: Ngo
authors.affiliation: University of Hong Kong, Hong Kong, Hong Kong.
authors.forename: Harvey
authors.initials: H
authors.lastname: Packham
authors.affiliation: University of South Florida, Tampa 33620, USA.
authors.forename: P Scott
authors.initials: PS
authors.lastname: Ramsay
authors.affiliation: Department of Psychology, New York University, New York 10003, USA.
authors.forename: Jennifer L
authors.initials: JL
authors.lastname: Ray
authors.affiliation: University of St Thomas, St Paul 55105, USA.
authors.forename: Aaron M
authors.initials: AM
authors.lastname: Sackett
authors.affiliation: HEC Paris, Jouy-en-Josas 78351, France.
authors.forename: Anne-Laure
authors.initials: AL
authors.lastname: Sellier
authors.affiliation: University of Michigan, Ann Arbor 48109, USA.
authors.forename: Tatiana
authors.initials: T
authors.lastname: Sokolova
authors.affiliation: Centre for Psychiatry and Neuroscience, Walter Reed Army Institute of Research (WRAIR), Silver Spring 20910, USA.
authors.forename: Walter
authors.initials: W
authors.lastname: Sowden
authors.affiliation: University of Illinois at Urbana-Champaign, Champaign 61820, USA.
authors.forename: Daniel
authors.initials: D
authors.lastname: Storage
authors.affiliation: Beijing Normal University, Beijing 100875, China.
authors.forename: Xiaomin
authors.initials: X
authors.lastname: Sun
authors.affiliation: Department of Psychology, New York University, New York 10003, USA.
authors.forename: Jay J
authors.initials: JJ
authors.lastname: Van Bavel
authors.affiliation: University of Illinois at Chicago, Chicago 60607, USA.
authors.forename: Anthony N
authors.initials: AN
authors.lastname: Washburn
authors.affiliation: Beijing Normal University, Beijing 100875, China.
authors.forename: Cong
authors.initials: C
authors.lastname: Wei
authors.affiliation: Stockholm School of Economics, Stockholm 11383, Sweden.
authors.forename: Erik
authors.initials: E
authors.lastname: Wetter
authors.affiliation: Illinois Institute of Technology, Chicago 60616, USA.
authors.forename: Carlos T
authors.initials: CT
authors.lastname: Wilson
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Sophie-Charlotte
authors.initials: SC
authors.lastname: Darroux
authors.affiliation: INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore.
authors.forename: Eric Luis
authors.initials: EL
authors.lastname: Uhlmann
mesh_terms: D006801:Humans; D009014:Morals; D015203:Reproducibility of Results