Does computer-aided diagnosis for lung tumors change satisfaction of search in chest radiography?
OBJECTIVE
Computer-aided diagnosis (CAD) has been developed to ensure that the radiologist considers suspect focal opacities that may represent cancer in chest radiography. Although CAD was not developed to counteract the satisfaction of search (SOS) effect, it may be an effective intervention to do so. The objective of this study is to determine whether an idealized CAD can reduce SOS effects in chest radiography.


METHODS
Fifty-seven chest radiographs, half of which demonstrated diverse, native abnormalities were read twice by 16 observers, once with and once without the addition of a simulated pulmonary nodule. Simulated CAD prompts were provided during the interpretation, which unerringly pointed to the added simulated nodule. Area under the ROC curve for detecting the native abnormalities was estimated for each observer in each treatment condition. In addition to testing for the SOS effect in the presence of CAD prompts, results were compared to those of a previous SOS study.


RESULTS
Significantly more nodules were reported in the SOS with CAD experiment than in the original SOS experiment (49 versus 43, P < .01). An SOS effect was found even when CAD prompts were provided; ROC areas for detecting native abnormalities were reduced with added nodules [0.68 versus 0.65, P (one-tailed) < .05]. Comparison of the current experiment with CAD and the previous SOS experiments failed to show a significant difference of the magnitude of the SOS effect (P = .52). The threshold for reporting was more conservative with CAD prompts than in SOS studies (P = .052).


CONCLUSIONS
Our results indicate that the CAD prompts, even those that always point to their target lesion without false-positive error, fail to counteract SOS in chest radiography. The stricter decision thresholds with CAD prompts may indicate less visual search for native abnormalities.
Berbaum
Kevin S
KS
Department of Radiology, University of Iowa, Iowa City, IA 52242, USA. kevin-berbaum@uiowa.edu
Caldwell
Robert T
RT
Schartz
Kevin M
KM
Thompson
Brad H
BH
Franken
E A
EA
D003951:Diagnostic Errors / Q000517:prevention & control*; D005260:Female; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008175:Lung Neoplasms / Q000175:diagnosis*; D008297:Male; D015588:Observer Variation; D010818:Practice Patterns, Physicians' / Q000706:statistics & numerical data*; D011785:Quality Assurance, Health Care / Q000379:methods*; D012372:ROC Curve; D013902:Radiography, Thoracic / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity
Acad Radiol. 2000 Jun;7(6):427-37
10845402
AJR Am J Roentgenol. 2004 Feb;182(2):505-10
14736690
Comput Med Imaging Graph. 2007 Jun-Jul;31(4-5):248-57
17369020
Acad Radiol. 2007 Jan;14(1):28-37
17178363
J Digit Imaging. 2006 Dec;19(4):376-82
16763934
Radiology. 2006 Nov;241(2):564-71
17057074
Med Phys. 2006 Jul;33(7):2642-53
16898468
Acad Radiol. 2006 Aug;13(8):995-1003
16843852
Acad Radiol. 2006 Mar;13(3):296-304
16488841
Acad Radiol. 2005 Feb;12(2):191-201
15721596
Acad Radiol. 2005 Jan;12(1):74-84
15691728
Clin Radiol. 2005 Feb;60(2):196-206
15664574
Semin Ultrasound CT MR. 2004 Oct;25(5):432-7
15559126
Acad Radiol. 1996 Oct;3(10):815-26
8923900
Radiology. 1995 Mar;194(3):895-902
7862998
Invest Radiol. 1994 Apr;29(4):403-9
8034444
Invest Radiol. 1991 Jul;26(7):640-8
1885270
Invest Radiol. 1990 Feb;25(2):133-40
2312249
Acad Radiol. 2000 Nov;7(11):945-58
11089697
Acad Radiol. 2004 Aug;11(8):909-18
15354301
Thorac Surg Clin. 2004 Feb;14(1):43-52
15382307
Acad Radiol. 2000 Dec;7(12):1098-106
11131054