title: How reliable are Psychopathy Checklist-Revised scores in Canadian criminal trials? A case law review.
abstract: The Psychopathy Checklist-Revised (PCL-R; Hare, 2003) is a professional rating scale that enjoys widespread use in forensic and correctional settings, primarily as a tool to inform risk assessments in a variety of types of cases (e.g., parole determinations, sexually violent predator [SVP] civil commitment). Although widely described as "reliable and valid" in research reports, several recent field studies have suggested that PCL-R scores provided by examiners in forensic cases are significantly less reliable than the interrater reliability values reported in research studies. Most of these field studies, however, have had small samples and only examined SVP civil commitment cases. This study builds on existing research by examining the reliability of PCL-R scores provided by forensic examiners in a much more extensive sample of Canadian criminal cases. Using the LexisNexis database, we identified 102 cases in which at least 2 scores were reported (of 257 total PCL-R scores). The single-rater intraclass correlation coefficient (ICC(A1)) was .59, indicating that a large percentage of the variance in individual scores was attributable to some form of error. ICC values were somewhat higher for sexual offending cases (.66) than they were for nonsexual offending cases (.46), indicating that poor interrater reliability was not restricted specifically to the assessment of sexual offenders. These and earlier findings concerning field reliability in legal cases suggest that the standard error of measurement for PCL-R scores that are provided to the courts is likely to be much larger than the value of 2.90 reported in the instrument's manual.
authors.affiliation: Department of Psychology.
authors.forename: John F
authors.initials: JF
authors.lastname: Edens
authors.affiliation: Department of Psychology, University of Alabama.
authors.forename: Jennifer
authors.initials: J
authors.lastname: Cox
authors.affiliation: Department of Psychology.
authors.forename: Shannon Toney
authors.initials: ST
authors.lastname: Smith
authors.affiliation: Department of Psychology, Drexel University.
authors.forename: David
authors.initials: D
authors.lastname: DeMatteo
authors.affiliation: Department of Clinical Neuroscience, Karolinska Institutet.
authors.forename: Karolina
authors.initials: K
authors.lastname: Sörman
mesh_terms: D000328:Adult; D000987:Antisocial Personality Disorder / Q000175:diagnosis* / Q000523:psychology*; D002170:Canada; D057189:Checklist / Q000706:statistics & numerical data*; D003134:Commitment of Persons with Psychiatric Disorders; D003617:Dangerous Behavior; D005555:Forensic Psychiatry; D006801:Humans; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D010552:Personality Assessment / Q000706:statistics & numerical data*; D011329:Prisoners / Q000523:psychology*; D011594:Psychometrics / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D018570:Risk Assessment / Q000706:statistics & numerical data; D012742:Sex Offenses; D014754:Violence / Q000523:psychology