title: A pilot study in ophthalmology of inter-rater reliability in classifying diagnostic errors: an underinvestigated area of medical error.
abstract: BACKGROUND
  Misdiagnosis is the least studied form of medical error. Before effective strategies to reduce misdiagnosis can be developed, there needs to be a better understanding of the factors that lead to these errors.
  
  
  OBJECTIVE
  To evaluate the applicability and reliability of three classification systems for misdiagnosis.
  
  
  METHODS
  Retrospective independent analysis of five cases by clinical experts.
  
  
  METHODS
  Three ophthalmologists trained in ocular oncology who devote at least 75% of their practice to ocular oncology.
  
  
  METHODS
  Percentage agreement in determining cause of misdiagnosis.
  
  
  RESULTS
  Participants agreed a misdiagnosis occurred in all cases and the error was graded as serious 14 of 15 times (93%). Inter-rater agreement for root cause varied among the three classification systems from 47% to zero.
  
  
  CONCLUSIONS
  Although there was excellent agreement among clinical experts of what constitutes serious misdiagnosis under idealized conditions, there is not a reliable method for categorizing the primary or root cause for these errors. The origins of misdiagnosis are complex, often multifactorial, and more difficult to categorize than other types of medical error. Misdiagnosis is a professional and public healthcare challenge that will require novel strategies to enable it to be successfully studied.
authors.affiliation: Department of Ophalmology, Watson Clinic, Lakeland, FL 33805, USA. cmargo@watsonclinic.com
authors.forename: C E
authors.initials: CE
authors.lastname: Margo
mesh_terms: D003951:Diagnostic Errors / Q000145:classification*; D005134:Eye Neoplasms / Q000175:diagnosis*; D006801:Humans; D015588:Observer Variation; D009885:Ophthalmology / Q000592:standards*; D010865:Pilot Projects; D015203:Reproducibility of Results; D012189:Retrospective Studies; D014481:United States