Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study.
Numerous publications and commercial systems are available that deal with automatic detection of pulmonary nodules in thoracic computed tomography scans, but a comparative study where many systems are applied to the same data set has not yet been performed. This paper introduces ANODE09 ( http://anode09.isi.uu.nl), a database of 55 scans from a lung cancer screening program and a web-based framework for objective evaluation of nodule detection algorithms. Any team can upload results to facilitate benchmarking. The performance of six algorithms for which results are available are compared; five from academic groups and one commercially available system. A method to combine the output of multiple systems is proposed. Results show a substantial performance difference between algorithms, and demonstrate that combining the output of algorithms leads to marked performance improvements.
van Ginneken
Bram
B
Image Sciences Institute, University Medical Center Utrecht, The Netherlands. bram@isi.uu.nl
Armato
Samuel G
SG
de Hoop
Bartjan
B
van Amelsvoort-van de Vorst
Saskia
S
Duindam
Thomas
T
Niemeijer
Meindert
M
Murphy
Keelin
K
Schilham
Arnold
A
Retico
Alessandra
A
Fantacci
Maria Evelina
ME
Camarlinghi
Niccolò
N
Bagagli
Francesco
F
Gori
Ilaria
I
Hara
Takeshi
T
Fujita
Hiroshi
H
Gargano
Gianfranco
G
Bellotti
Roberto
R
Tangaro
Sabina
S
Bolaños
Lourdes
L
De Carlo
Francesco
F
Cerello
Piergiorgio
P
Cristian Cheran
Sorin
S
Lopez Torres
Ernesto
E
Prokop
Mathias
M
D000368:Aged; D000465:Algorithms; D005260:Female; D006801:Humans; D008175:Lung Neoplasms / Q000000981:diagnostic imaging*; D008297:Male; D008875:Middle Aged; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012984:Software; D012986:Software Validation; D003074:Solitary Pulmonary Nodule / Q000000981:diagnostic imaging*; D014057:Tomography, X-Ray Computed / Q000379:methods*