title: Interobserver agreement, intraobserver reliability, and the Rorschach Comprehensive System.
abstract: Interrater agreement and reliability for the Rorschach have recently come under increasing scrutiny. This is the second report examining methods of Comprehensive System reliability using principles derived from observational methodology and applied behavioral analysis. This study examined a previous nonpatient sample of 20 protocols (N = 412 responses) and also examined a new clinical sample of 20 protocols (N = 374 responses) diagnosed with Research Diagnostic Criteria. Reliability was analyzed at multiple levels of Comprehensive System data, including response-level individual codes and coding decisions and ratios, percentages, and derivations from the Structural Summary. With a number of exceptions, most Comprehensive System codes, coding decisions, and summary scores yield acceptable, and in many instances excellent, levels of reliability. Limitations arising from the nature of Rorschach data and Comprehensive System coding criteria are discussed.
authors.forename: M W
authors.initials: MW
authors.lastname: Acklin
authors.forename: C J
authors.initials: CJ
authors.lastname: McDowell
authors.forename: M S
authors.initials: MS
authors.lastname: Verschell
authors.forename: D
authors.initials: D
authors.lastname: Chan
mesh_terms: D000328:Adult; D016022:Case-Control Studies; D003627:Data Interpretation, Statistical; D005260:Female; D006801:Humans; D008297:Male; D001523:Mental Disorders / Q000175:diagnosis*; D015588:Observer Variation; D011594:Psychometrics; D015203:Reproducibility of Results; D012392:Rorschach Test / Q000592:standards*; D012680:Sensitivity and Specificity