title: Computer-aided detection performance in mammographic examination of masses: assessment.
abstract: OBJECTIVE
  To compare performance of two computer-aided detection (CAD) systems and an in-house scheme applied to five groups of sequentially acquired screening mammograms.
  
  
  METHODS
  Two hundred nineteen film-based mammographic examinations, classified into five groups, were included in this study. Group 1 included 58 examinations in which verified malignant masses were detected during screening; group 2, 39 in which all available latest examinations were performed prior to diagnosis of these malignant masses (subset of 39 women from group 1); group 3, 22 in which findings were interpreted as negative but were verified as cancer within 1 year from the negative interpretation (missed cancers); group 4, 50 in which findings were negative and patients were not recalled for additional procedures; and group 5, 50 in which patients were recalled for additional procedures and findings were negative for cancer. In all examinations, images were processed with two Food and Drug Administration-approved commercially available CAD systems and an in-house scheme. Performance levels in terms of true-positive detection rates and number of false-positive identifications per image and per examination were compared.
  
  
  RESULTS
  Mass detection rates in positive examinations (group 1) were 67%-72%. Detection rates among three systems were not significantly different (P > .05). In 50 negative screening examinations (group 4), false-positive rates ranged from 1.08 to 1.68 per four-view examination. Performance level differences among systems were significant for false-positive rates (P = .008). Performance of all systems was at levels lower than publicly suggested in some retrospective studies. False-positive CAD cueing rates were significantly higher for negative examinations in which patients were recalled (group 5) than they were for those in which patients were not recalled (group 4) (P < or = .002).
  
  
  CONCLUSIONS
  Performance of CAD systems for mass detection at mammography varies significantly, depending on examination and system used. Actual performance of all systems in clinical environment can be improved.
authors.affiliation: Department of Radiology and Magee-Womens Hospital, University of Pittsburgh, 300 Halket St, Suite 4200, Pittsburgh, PA 15213-3180, USA. gurd@upmc.edu.
authors.forename: David
authors.initials: D
authors.lastname: Gur
authors.forename: Jennifer S
authors.initials: JS
authors.lastname: Stalder
authors.forename: Lara A
authors.initials: LA
authors.lastname: Hardesty
authors.forename: Bin
authors.initials: B
authors.lastname: Zheng
authors.forename: Jules H
authors.initials: JH
authors.lastname: Sumkin
authors.forename: Denise M
authors.initials: DM
authors.lastname: Chough
authors.forename: Betty E
authors.initials: BE
authors.lastname: Shindel
authors.forename: Howard E
authors.initials: HE
authors.lastname: Rockette
mesh_terms: D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D001943:Breast Neoplasms / Q000000981:diagnostic imaging*; D003936:Diagnosis, Computer-Assisted; D005188:False Negative Reactions; D005189:False Positive Reactions; D005260:Female; D006801:Humans; D008327:Mammography / Q000379:methods*; D008875:Middle Aged