title: Large-sample confidence intervals for validity and reliability coefficients.
abstract: Large-sample confidence intervals (CI) for reliability, validity, and unattenuated validity are presented. The CI for unattenuated validity is based on the Bonferroni inequality, which relies on one CI for test-retest reliability and one for validity. Covered are four reliability-validity situations: (a) both estimates were from random samples; (b) reliability was from a random sample but validity was from a selected sample; (c) validity was from a random sample but reliability was from a selected sample; and (d) both estimates were from selected samples. All CIs were evaluated by using a simulation. CIs on reliability, validity, or unattenuated validity are accurate as long as selection ratio is at least 20% and selected sample size is 100 or larger. When selection ratio is less than 20%, estimators tend to underestimate their parameters.
authors.affiliation: Department of Psychology, University of Oklahoma, Norman 73019, USA. jmendoza@ou.edu
authors.forename: J L
authors.initials: JL
authors.lastname: Mendoza
authors.forename: K L
authors.initials: KL
authors.lastname: Stafford
authors.forename: J M
authors.initials: JM
authors.lastname: Stauffer
mesh_terms: D016001:Confidence Intervals; D006801:Humans; D009010:Monte Carlo Method; D011594:Psychometrics; D015203:Reproducibility of Results; D018401:Sample Size; D012494:Sampling Studies