title: The significance of differences between means. A simulation study.
abstract: 1. Three tests of statistical significance: the confidence interval (C), Student's t, and Satterthwaite's corrected t were compared using a computer generated sampling experiment. 2. The C-test was shown to be extremely inefficient at detecting differences between pairs of means. The t-test performed as expected and Satterthwaite's correct t was slightly conservative. 3. When the population variances are different Satterthwaite's corrected t performed extremely well, the t-test was slightly liberal, while the C-test remained extremely insensitive. 4. It is concluded that the C-test should not be used (i.e. against Scheer, 1986, Comp. Biochem. Physiol. 83A, 405-408). 5. It is noted that when many t-tests are performed on one data set, alternative methods are appropriate.
mesh_terms: D001699:Biometry; D008962:Models, Theoretical