title: Rater Reliability: A Maximum Likelihood Confirmatory Factor-Analytic Approach.
abstract: A procedure for evaluating a variety of rater reliability models is presented. A multivariate linear model is utilized to describe and assess a set of ratings. The parameters of such a model are reexpressed in terms of a factor-analytic model. Maximum likelihood methods are employed to estimate and test the parameters in this factor-analytic model. The approach is related to the use of the intraclass correlation coefficient to estimate reliability. Two examples are presented, and the results contrasted to those found with an intraclass correlation approach. Extensions of the procedure to multiple sets of judges, multiple measures, and multiple groups is introduced.
authors.forename: K E
authors.initials: KE
authors.lastname: O'Grady
authors.forename: D R
authors.initials: DR
authors.lastname: Medoff