Evaluating overall significance levels in multifactor ANOVA.
Multifactor ANOVA procedures are commonly used by practitioners. A hierarchical process for testing the interaction effect(s) first, followed by tests for the main effects, is usually employed. Generally, no consideration is given to the overall type I error rate for these dependent (or conditional) tests. In this article, we formulate a method to evaluate the true overall significance levels for two-factor fixed-effect ANOVA models. Methods for evaluating conditional p-values are discussed. We present the overall significance levels for several specific two-factor designs. We discuss upper bounds on the overall significance level and extensions of the computational methods to higher-order designs as well as applications to random-effect models and mixed models.
Mayo
M S
MS
Department of Preventive Medicine and the Kansas Cancer Institute, The University of Kansas Medical Center, Kansas City, 66160-7313, USA.
Conerly
M D
MD
D000704:Analysis of Variance; D001823:Body Composition; D002648:Child; D006801:Humans; D015233:Models, Statistical; D009765:Obesity / Q000503:physiopathology