Combining independent p values: extensions of the Stouffer and binomial methods.
The Stouffer z method, and other popular methods for combining p values from independent significance tests, suffer from three problems: vulnerability to criticisms of the individual studies being pooled, difficulty in handling the "file drawer problem," and vague conclusions. These problems can be reduced or eliminated by supplementing a test of combined probability with a variety of new analyses described here. Along with other advantages, these analyses provide a way to address the file drawer problem without making limiting assumptions about the nature of studies not included in the pooled analysis. These analyses can supplement a traditional meta-analysis, yielding conclusions not provided by widely used meta-analytic procedures.
Darlington
R B
RB
Department of Psychology, Cornell University, Ithaca, New York 14853, USA. rbd1@cornell.edu
Hayes
A F
AF
D016010:Binomial Distribution; D006801:Humans; D015201:Meta-Analysis as Topic; D011336:Probability; D011594:Psychometrics