title: Accuracy of computer diagnosis of melanoma: a quantitative meta-analysis.
abstract: BACKGROUND
  Recent developments in computer technology have raised expectations that fully automated diagnostic instruments will become available to diagnose cutaneous melanoma without the need of human expertise.
  
  
  OBJECTIVE
  To critically review the contemporary literature on computer diagnosis of melanoma, evaluate the accuracy of such computer diagnosis, analyze the influence of study characteristics, and compare the accuracy of computer diagnosis of melanoma with human diagnosis.
  
  
  METHODS
  Quantitative meta-analysis of published reports.
  
  
  METHODS
  Eligible studies were identified by a MEDLINE search covering the period from January 1991 to March 2002, by manual searches of the reference lists of retrieved articles, and by direct communication with experts.
  
  
  RESULTS
  Thirty studies with substantial differences in methodological quality were deemed eligible for meta-analysis. Five of these complied with the predetermined list of "good quality" requirements, but none met all methodological quality requirements. Ten of these studies compared the performance of computer diagnosis with human diagnosis. The diagnostic accuracy achieved with computer diagnosis was statistically not different from that of human diagnosis (log odds ratios, 3.36 vs 3.51; P =.80). The diagnostic performance of the computer diagnosis was better for studies that used dermoscopic images than for studies that used clinical images (log odds ratios, 4.2 vs 3.4; P =.08). Other study characteristics did not significantly influence the accuracy of the computer diagnosis.
  
  
  CONCLUSIONS
  The computer diagnosis of melanoma is accurate under experimental conditions, but the practical value of automated diagnostic instruments under real-world conditions is currently unknown. We suggest minimum requirements for methodological quality in future experimental studies or, ideally, randomized controlled trials.
authors.affiliation: Department of Dermatology, University of Vienna Medical School, Vienna, Austria.
authors.forename: Barbara
authors.initials: B
authors.lastname: Rosado
authors.forename: Scott
authors.initials: S
authors.lastname: Menzies
authors.forename: Alexandra
authors.initials: A
authors.lastname: Harbauer
authors.forename: Hubert
authors.initials: H
authors.lastname: Pehamberger
authors.forename: Klaus
authors.initials: K
authors.lastname: Wolff
authors.forename: Michael
authors.initials: M
authors.lastname: Binder
authors.forename: Harald
authors.initials: H
authors.lastname: Kittler
mesh_terms: D002986:Clinical Trials as Topic; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000592:standards*; D008545:Melanoma / Q000175:diagnosis*; D009508:Nevus, Pigmented / Q000175:diagnosis; D011237:Predictive Value of Tests; D011785:Quality Assurance, Health Care; D012680:Sensitivity and Specificity; D012878:Skin Neoplasms / Q000175:diagnosis*