Reliability of the craniomandibular index.
OBJECTIVE
To examine various dimensions of reliability of the Craniomandibular Index, a commonly used instrument for quantifying the severity of signs and symptoms of temporomandibular disorders.


METHODS
Classical psychometric theory and generalizability theory were used to assess the reliability of data obtained from a calibration study of examiners participating in a multi-site clinical trial and from a random community sample.


RESULTS
The reliability of aggregate scores formed by summing individual binary scored items was high, with intraclass correlations ranging from 0.81 to 0.88. When it was required that examiners recognize and agree upon a specific pattern of signs and symptoms exhibited by a patient, however, reliability dropped dramatically (multivariate kappas ranged from 0.26 to 0.32). A group of practicing examiners also showed limited ability to agree with the pattern of signs and symptoms identified by a "gold standard" examiner (multivariate kappas ranging from 0.25 to 0.32). Generalizability analysis failed to identify the specific sources of measurement error that played a major role in limiting reliability but demonstrated that generalizability of aggregate scores was very high.


CONCLUSIONS
Methods of classical psychometric theory and generalizability theory support the conclusion that the reliability of aggregate scores is acceptably high. Individual items assessing certain aspects of jaw mobility and joint sounds are measured with poor reliability. Reliability declines when it is defined as the ability of examiners to agree among themselves upon a specific constellation of signs and symptoms or their ability to identify correctly a "correct" constellation identified by an expert examiner.
Hatch
John P
JP
Departments of Psychiatry and Orthodontics, University of Texas Health Science Center at San Antonio, Mail Code 7910, 7703 Floyd Curl Drive, San Antonio, TX 78229-3900, USA. hatch@uthscsa.edu
Rugh
John D
JD
Sakai
Shiro
S
Prihoda
Thomas J
TJ
D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D000704:Analysis of Variance; D005260:Female; D006801:Humans; D016013:Likelihood Functions; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D011594:Psychometrics; D015203:Reproducibility of Results; D012720:Severity of Illness Index; D013705:Temporomandibular Joint Disorders / Q000175:diagnosis*