Interrater reliability among three judges on 130 defense mechanism test variables: a multivariate approach.
The aim of this study was to examine the interrater reliability in the coding of the Defense Mechanism Test for 130 variables on both a variable and a subject level. Parallel with a traditional variable analysis, a multivariate strategy for measurement of interrater reliability, built upon principal component analysis, is presented. The results showed high agreement between judges with an overall interrater reliability coefficient of .98 but indicates the need for elucidation in the coding instructions for nine single variables. It also showed that multivariate modeling methods for handling personality test data are highly resistant to occasional differences on single variables but sensitive to major differences.
Henningsson
M
M
Department of Applied Psychology, Umeå University, Sweden. mikael.henningsson@apsy.umu.se
Sundbom
E
E
D000328:Adult; D001883:Borderline Personality Disorder / Q000175:diagnosis / Q000523:psychology; D003674:Defense Mechanisms; D005260:Female; D006801:Humans; D008297:Male; D015999:Multivariate Analysis; D015588:Observer Variation; D010555:Personality Inventory / Q000706:statistics & numerical data*; D011594:Psychometrics; D015203:Reproducibility of Results; D012559:Schizophrenia / Q000175:diagnosis; D012565:Schizophrenic Psychology