title: Computer-aided lung nodule detection in CT: results of large-scale observer test.
abstract: OBJECTIVE
  The objective is to study the incremental effects of using a computer-aided lung nodule detection (CAD) system on the performance of a large pool of observers.
  
  
  METHODS
  A set of eight thin-section computed tomographic data sets with limited longitudinal coverage, containing a total of 22 lung nodules, was analyzed by using the automated nodule detection system. When applied to all eight cases, the CAD system alone achieved a detection rate of 86.4%, with 2.64 false-positive results per case. This study included 202 observers at a national radiology meeting: 39 thoracic radiologists, 95 non-thoracic radiologists, and 68 non-radiologists. Each participant read from one to eight cases in random order, first without and then with CAD system output available. Observer performance in nodule detection was measured before and after CAD was made available. Differences in performance of groups of observers before and after CAD were tabulated by mean, median, and SD in detection rate and number of false-positive results and tested by using nonparametric methods.
  
  
  RESULTS
  In an analysis involving only the first randomly selected case read by all 202 participants, there were statistically significant increases in nodule detection rates and numbers of false-positive results for all types of observers. There was a significant difference in detection rates between radiologists and non-radiologists before CAD, but after CAD, there was no significant difference in detection rates between these observer types. In a second analysis involving 13 participants who read all eight cases, mean detection rates were 64.0% before CAD and 81.9% after CAD. Mean numbers of false-positive results were 0.144 per case before CAD and 0.173 after CAD.
  
  
  CONCLUSIONS
  In a large observer study, use of a CAD system for nodule detection resulted in an incremental increase in detection rate, but also led to an increase in number of false-positive results. Also, CAD appears to be an equalizer of detection rates between observers of different levels of experience.
authors.affiliation: Thoracic Imaging Section, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, Los Angeles, CA 90095, USA. mbrown@mednet.ucla.edu
authors.forename: Matthew S
authors.initials: MS
authors.lastname: Brown
authors.forename: Jonathan G
authors.initials: JG
authors.lastname: Goldin
authors.forename: Sarah
authors.initials: S
authors.lastname: Rogers
authors.forename: Hyun J
authors.initials: HJ
authors.lastname: Kim
authors.forename: Robert D
authors.initials: RD
authors.lastname: Suh
authors.forename: Michael F
authors.initials: MF
authors.lastname: McNitt-Gray
authors.forename: Sumit K
authors.initials: SK
authors.lastname: Shah
authors.forename: Dao
authors.initials: D
authors.lastname: Truong
authors.forename: Kathleen
authors.initials: K
authors.lastname: Brown
authors.forename: James W
authors.initials: JW
authors.lastname: Sayre
authors.forename: David W
authors.initials: DW
authors.lastname: Gjertson
authors.forename: Poonam
authors.initials: P
authors.lastname: Batra
authors.forename: Denise R
authors.initials: DR
authors.lastname: Aberle
mesh_terms: D002983:Clinical Competence; D006801:Humans; D008175:Lung Neoplasms / Q000000981:diagnostic imaging*; D015588:Observer Variation; D011237:Predictive Value of Tests; D011857:Radiographic Image Interpretation, Computer-Assisted; D013902:Radiography, Thoracic / Q000379:methods*; D012984:Software; D003074:Solitary Pulmonary Nodule / Q000000981:diagnostic imaging*; D018709:Statistics, Nonparametric; D014057:Tomography, X-Ray Computed; D014584:User-Computer Interface