Large-sample confidence intervals for validity and reliability coefficients.
Large-sample confidence intervals (CI) for reliability, validity, and unattenuated validity are presented. The CI for unattenuated validity is based on the Bonferroni inequality, which relies on one CI for test-retest reliability and one for validity. Covered are four reliability-validity situations: (a) both estimates were from random samples; (b) reliability was from a random sample but validity was from a selected sample; (c) validity was from a random sample but reliability was from a selected sample; and (d) both estimates were from selected samples. All CIs were evaluated by using a simulation. CIs on reliability, validity, or unattenuated validity are accurate as long as selection ratio is at least 20% and selected sample size is 100 or larger. When selection ratio is less than 20%, estimators tend to underestimate their parameters.
Mendoza
J L
JL
Department of Psychology, University of Oklahoma, Norman 73019, USA. jmendoza@ou.edu
Stafford
K L
KL
Stauffer
J M
JM
D016001:Confidence Intervals; D006801:Humans; D009010:Monte Carlo Method; D011594:Psychometrics; D015203:Reproducibility of Results; D018401:Sample Size; D012494:Sampling Studies