title: Improving the Conduct and Reporting of Statistical Analysis in Psychology.
abstract: We respond to the commentaries Waldman and Lilienfeld (Psychometrika, 2015) and Wigboldus and Dotch (Psychometrika, 2015) provided in response to Sijtsma's (Sijtsma in Psychometrika, 2015) discussion article on questionable research practices. Specifically, we discuss the fear of an increased dichotomy between substantive and statistical aspects of research that may arise when the latter aspects are laid entirely in the hands of a statistician, remedies for false positives and replication failure, and the status of data exploration, and we provide a re-definition of the concept of questionable research practices.
authors.affiliation: Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, PO Box 90153, 5000 LE, Tilburg, The Netherlands. k.sijtsma@tilburguniversity.edu.
authors.forename: Klaas
authors.initials: K
authors.lastname: Sijtsma
authors.affiliation: Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, PO Box 90153, 5000 LE, Tilburg, The Netherlands.
authors.forename: Coosje L S
authors.initials: CL
authors.lastname: Veldkamp
authors.affiliation: Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, PO Box 90153, 5000 LE, Tilburg, The Netherlands.
authors.forename: Jelte M
authors.initials: JM
authors.lastname: Wicherts
mesh_terms: D006801:Humans; D011594:Psychometrics; D012107:Research Design
keywords: data exploration; questionable research practices; remedies for false positives; replication failure
references.citation: Psychometrika. 2016 Mar;81(1):1-15
references.pmid: 25820980
references.citation: Perspect Psychol Sci. 2012 Nov;7(6):543-54
references.pmid: 26168111
references.citation: Sci Eng Ethics. 2006 Jan;12(1):53-74
references.pmid: 16501647
references.citation: Behav Res Methods. 2011 Sep;43(3):666-78
references.pmid: 21494917
references.citation: Psychol Sci. 1994 May;5(3):127-34
references.pmid: 11652978
references.citation: Psychol Sci. 2014 Jan;25(1):7-29
references.pmid: 24220629
references.citation: Nature. 2005 Jun 9;435(7043):737-8
references.pmid: 15944677
references.citation: PLoS Med. 2005 Aug;2(8):e124
references.pmid: 16060722
references.citation: Psychol Sci. 2011 Nov;22(11):1359-66
references.pmid: 22006061
references.citation: Psychometrika. 2016 Mar;81(1):16-26
references.pmid: 25820981
references.citation: Psychol Sci. 2012 May 1;23(5):524-32
references.pmid: 22508865
references.citation: Psychometrika. 2006 Sep;71(3):425-440
references.pmid: 19946599
references.citation: Psychometrika. 2016 Mar;81(1):27-32
references.pmid: 25820979
references.citation: Perspect Psychol Sci. 2012 Nov;7(6):531-6
references.pmid: 26168109
references.citation: Psychol Methods. 2014 Sep;19(3):409-27
references.pmid: 24773354
references.citation: PLoS One. 2014 Dec 10;9(12 ):e114876
references.pmid: 25493918
references.citation: Nature. 2013 Feb 14;494(7436):149
references.pmid: 23407504