title: Evaluating the performance of different procedures for constructing confidence intervals for coefficient alpha: a simulation study.
abstract: Reliability is one of the most important aspects of testing in educational and psychological measurement. The construction of confidence intervals for reliability coefficients has important implications for evaluating the accuracy of the sample estimate of reliability and for comparing different tests, scoring rubrics, or training procedures for raters or observers. The present simulation study evaluated and compared various parametric and non-parametric methods for constructing confidence intervals of coefficient alpha. Six factors were manipulated: number of items, number of subjects, population coefficient alpha, deviation from essentially parallel condition, item response distribution and type. The coverage and width of different confidence intervals were compared across simulation conditions.
authors.affiliation: Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, Canada. yc@ualberta.ca
authors.forename: Ying
authors.initials: Y
authors.lastname: Cui
authors.forename: Johnson
authors.initials: J
authors.lastname: Li
mesh_terms: D003198:Computer Simulation / Q000706:statistics & numerical data*; D016001:Confidence Intervals; D006801:Humans; D015233:Models, Statistical; D011581:Psychological Tests / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D012107:Research Design / Q000706:statistics & numerical data; D018401:Sample Size; D012984:Software / Q000706:statistics & numerical data; D016008:Statistical Distributions