Comparison of closed testing procedures for pairwise testing of means.
A Monte Carlo simulation was conducted to compare 9 pairwise multiple comparison procedures. Procedures were evaluated on the basis of any-pair power and all-pairs power. No procedure was found to be uniformly most powerful. A modification due to A. J. Hayter (1986) of Fisher's least significant difference was found to provide the best combination of ease of use and moderately high any-pair power in most cases. Pilot or exploratory studies can expect good power results with this relatively simple procedure. The greatest all-pairs power was usually provided by 1 of 2 partition-based versions of E. Peritz's (1970) procedure. Confirmatory studies will require such complex methods but may also need larger sample sizes than have been customary in psychological research.
Ramsey
Philip H
PH
Department of Psychology, Queens College of the City University of New York, Flushing, New York 11367-1597, USA. philip_ramsey@qc.edu
D006801:Humans; D008960:Models, Psychological; D010865:Pilot Projects; D011584:Psychology / Q000379:methods