title: Quantifying the accuracy of forensic examiners in the absence of a "gold standard".
abstract: This study asked whether latent class modeling methods and multiple ratings of the same cases might permit quantification of the accuracy of forensic assessments. Five evaluators examined 156 redacted court reports concerning criminal defendants who had undergone hospitalization for evaluation or restoration of their adjudicative competence. Evaluators rated each defendant's Dusky-defined competence to stand trial on a five-point scale as well as each defendant's understanding of, appreciation of, and reasoning about criminal proceedings. Having multiple ratings per defendant made it possible to estimate accuracy parameters using maximum likelihood and Bayesian approaches, despite the absence of any "gold standard" for the defendants' true competence status. Evaluators appeared to be very accurate, though this finding should be viewed with caution.
authors.affiliation: Glenn M. Weaver Institute of Law and Psychiatry, University of Cincinnati College of Law, Clifton Avenue & Calhoun Street, PO Box 210040, Cincinnati, OH 45221-0040, USA. douglas.mossman@uc.edu
authors.forename: Douglas
authors.initials: D
authors.lastname: Mossman
authors.forename: Michael D
authors.initials: MD
authors.lastname: Bowen
authors.forename: David J
authors.initials: DJ
authors.lastname: Vanness
authors.forename: David
authors.initials: D
authors.lastname: Bienenfeld
authors.forename: Terry
authors.initials: T
authors.lastname: Correll
authors.forename: Jerald
authors.initials: J
authors.lastname: Kay
authors.forename: William M
authors.initials: WM
authors.lastname: Klykylo
authors.forename: Douglas S
authors.initials: DS
authors.lastname: Lehrer
mesh_terms: D000328:Adult; D001499:Bayes Theorem; D003951:Diagnostic Errors / Q000517:prevention & control*; D005260:Female; D005555:Forensic Psychiatry / Q000592:standards*; D006801:Humans; D008297:Male; D016743:Mental Competency / Q000523:psychology*; D008875:Middle Aged; D012372:ROC Curve; D014481:United States