title: Comparison of appropriateness ratings for cataract surgery between convened and mail-only multidisciplinary panels.
abstract: BACKGROUND
  In this article, the authors determine the reproducibility of appropriateness ratings for cataract surgery between a multidisciplinary physician panel that convened and a multidisciplinary physician panel that completed ratings by mail.
  
  
  METHODS
  Eighteen panelists, who constituted 2 distinct multidisciplinary panels, rated 2894 clinical scenarios as an appropriate, inappropriate, or uncertain indication to perform cataract surgery. Each panel's summary score for each scenario was calculated. Weighted kappa values were determined to assess the level of agreement between the ratings of the 2 panels.
  
  
  RESULTS
  The panels had a substantial level of agreement overall, with a weighted kappa statistic of 0.64. There was agreement on about 68% of the scenarios, and serious disagreement, in which one panel rated an indication appropriate and the other rated it inappropriate, occurred in only 1% of the ratings.
  
  
  CONCLUSIONS
  There was substantial agreement about the ratings by the 2 panels. The panel that convened rated fewer scenarios uncertain and more appropriate, suggesting the impact of group dynamics and face-to-face discussion on resolution of uncertainty.
authors.affiliation: College of Medicine, University of Iowa, Iowa City, 52242-1081, USA. joanne-tobacman@uiowa.edu
authors.forename: J K
authors.initials: JK
authors.lastname: Tobacman
authors.forename: I U
authors.initials: IU
authors.lastname: Scott
authors.forename: S T
authors.initials: ST
authors.lastname: Cyphert
authors.forename: M B
authors.initials: MB
authors.lastname: Zimmerman
mesh_terms: D002387:Cataract Extraction; D016009:Chi-Square Distribution; D016001:Confidence Intervals; D003245:Consensus Statements as Topic; D003657:Decision Making; D003697:Delphi Technique; D006801:Humans; D015203:Reproducibility of Results