Blinded comparison of computer-aided detection with human second reading in screening mammography.
OBJECTIVE
The purpose of this study was to compare a human second reader with computer-aided detection (CAD) for the reduction of false-negative cases by a primary radiologist. We retrospectively reviewed our clinical practice.


METHODS
We found that 6,381 consecutive screening mammograms were interpreted by a primary reader. This radiologist then reinterpreted the studies using CAD ("CAD reader"). A second human reader who was blinded to the CAD results but knowledgeable of the primary reader's findings reviewed the studies, looking for abnormalities not seen by the first reader.


RESULTS
Two cancers were called back by the second human reader that were not called back by the CAD reader; however, the CAD system had marked the findings, but they were dismissed by the primary reader. Because of the small numbers, the difference between the CAD and second human reader was not statistically significant. The CAD and human second readers increased the recall rates 6.4% and 7.2% (p = 0.70), respectively, and the biopsy rates 10% and 14.7%. The positive predictive value was 0% (0/3) for the CAD reader and was 40% (2/5) for the human second reader. The relative increases in the cancer detection rate compared with the primary reader's detection rate were 0% for the CAD reader and 15.4% (2/13) for the human second reader (p = 0.50).


CONCLUSIONS
A human second reader or the use of a CAD system can increase the cancer detection rate, but we found no statistical difference between the two because of the small sample size. A possible benefit from a human second reader is that CAD systems can only point to possible abnormalities, whereas a human must determine the significance of the finding. Having two humans review a study may increase detection rates due to interpreter--hence, perceptual--variability and not just increased detection.
Georgian-Smith
Dianne
D
Department of Radiology, Breast Imaging, Brigham and Women's Hospital, 75 Francis St., Boston, MA 02115, USA. dgeorgiansmith@partners.org
Moore
Richard H
RH
Halpern
Elkan
E
Yeh
Eren D
ED
Rafferty
Elizabeth A
EA
D'Alessandro
Helen Anne
HA
Staffa
Mary
M
Hall
Deborah A
DA
McCarthy
Kathleen A
KA
Kopans
Daniel B
DB
D000293:Adolescent; D000328:Adult; D001185:Artificial Intelligence; D001943:Breast Neoplasms / Q000000981:diagnostic imaging* / Q000453:epidemiology*; D004311:Double-Blind Method; D005188:False Negative Reactions; D005260:Female; D006801:Humans; D008327:Mammography / Q000706:statistics & numerical data*; D008403:Mass Screening / Q000706:statistics & numerical data*; D008404:Massachusetts / Q000453:epidemiology; D008875:Middle Aged; D015588:Observer Variation; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity