Effect of a computer-aided diagnosis scheme on radiologists' performance in detection of lung nodules on radiographs.
OBJECTIVE
To evaluate the effect of a computer-aided diagnosis (CAD) scheme on radiologists' performance in the detection of lung nodules, and to examine a new method of receiver operating characteristic (ROC) analysis.


METHODS
One hundred twenty radiographs (60 normal and 60 abnormal with lung nodules of varying subtlety) were used. Sixteen radiologists (two thoracic, six general, and eight residents) participated in an observer study in which they read both conventional radiographs and digitized radiographs. The radiologists' performance was evaluated with ROC analysis with two different methods (independent testing and sequential testing) and a continuous rating scale.


RESULTS
Az (area under the best fit binormal ROC curve when it is plotted in the unit square) values obtained from ROC analysis with and without CAD output were 0.940 and 0.894, respectively, in the independent test and 0.948 and 0.906, respectively, in the sequential test. Findings with both methods indicated that the CAD scheme statistically significantly improved diagnostic accuracy, particularly for radiologists with less experience (P < .001). Reading time was not increased when CAD was used.


CONCLUSIONS
The CAD scheme can assist radiologists in the detection of lung nodules on chest radiographs.
Kobayashi
T
T
Kurt Rossmann Laboratories for Radiologic Image Research, Department of Radiology, University of Chicago, IL 60637, USA.
Xu
X W
XW
MacMahon
H
H
Metz
C E
CE
Doi
K
K
D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D003936:Diagnosis, Computer-Assisted / Q000295:instrumentation / Q000379:methods / Q000706:statistics & numerical data; D005260:Female; D006801:Humans; D008175:Lung Neoplasms / Q000000981:diagnostic imaging* / Q000556:secondary*; D008297:Male; D008875:Middle Aged; D015588:Observer Variation; D012372:ROC Curve; D013902:Radiography, Thoracic / Q000295:instrumentation / Q000379:methods / Q000706:statistics & numerical data; D014057:Tomography, X-Ray Computed / Q000295:instrumentation / Q000379:methods / Q000706:statistics & numerical data