title: Variability of judgments of capacity: experience of capacity evaluators in a study of research consent capacity.
abstract: BACKGROUND
  Assessment of decision-making capacity is a common and important function of psychiatric consultants. However, the sources of variability in evaluators' judgments have not been well characterized.
  
  
  OBJECTIVE
  To examine the degree and potential sources of variability in the categorical capacity judgments of experienced psychiatrists.
  
  
  METHODS
  The setting was a study comparing the decision-making capacities of 188 persons with Alzheimer's disease to appoint a research proxy and to consent to two hypothetical randomized controlled trials for dementia (a new drug RCT and a neurosurgical RCT). We compared five experienced consultation psychiatrists' capacity judgments for 555 videotaped capacity interviews. Both quantitative and qualitative data were used.
  
  
  RESULTS
  Pair wise kappa statistics ranged from slight agreement (0.17) to substantial agreement (0.64) with group kappa statistics ranging from fair to moderate agreement (0.40 to 0.45) for the psychiatrists' judgments regarding the three capacities. The sources of variability included varying "strictness" among judges, moderate test-retest reliability within judges, the relative novelty of assessing decision-making capacity for research participation decisions, as well as the limitations of the methods used to obtain capacity judgments in the study.
  
  
  CONCLUSIONS
  There is considerable variability in capacity judgments of experienced consultation psychiatrists regarding the capacities to appoint a research proxy and to consent to research. The potential sources of variability identified in this study may provide starting points for more effective training in capacity assessment.
authors.affiliation: Center for Bioethics and Social Sciences in Medicine and Dept. of Psychiatry, University of Michigan, 300 North Ingalls Street, Ann Arbor, MI 48109, USA. scottkim@med.umich.edu
authors.forename: Scott Y H
authors.initials: SY
authors.lastname: Kim
authors.forename: Paul S
authors.initials: PS
authors.lastname: Appelbaum
authors.forename: H Myra
authors.initials: HM
authors.lastname: Kim
authors.forename: Ian F
authors.initials: IF
authors.lastname: Wall
authors.forename: James A
authors.initials: JA
authors.lastname: Bourgeois
authors.forename: Bernard
authors.initials: B
authors.lastname: Frankel
authors.forename: Kevin C
authors.initials: KC
authors.lastname: Hails
authors.forename: James R
authors.initials: JR
authors.lastname: Rundell
authors.forename: Kathleen M
authors.initials: KM
authors.lastname: Seibel
authors.forename: Jason H
authors.initials: JH
authors.lastname: Karlawish
mesh_terms: D000544:Alzheimer Disease / Q000523:psychology; D006801:Humans; D007258:Informed Consent / Q000592:standards; D007406:Interview, Psychological; D007600:Judgment; D016743:Mental Competency / Q000592:standards; D015588:Observer Variation; D018579:Patient Selection; D019727:Proxy; D011570:Psychiatry / Q000193:education / Q000592:standards*