Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms.
Efficiently obtaining a reliable coronary artery centerline from computed tomography angiography data is relevant in clinical practice. Whereas numerous methods have been presented for this purpose, up to now no standardized evaluation methodology has been published to reliably evaluate and compare the performance of the existing or newly developed coronary artery centerline extraction algorithms. This paper describes a standardized evaluation methodology and reference database for the quantitative evaluation of coronary artery centerline extraction algorithms. The contribution of this work is fourfold: (1) a method is described to create a consensus centerline with multiple observers, (2) well-defined measures are presented for the evaluation of coronary artery centerline extraction algorithms, (3) a database containing 32 cardiac CTA datasets with corresponding reference standard is described and made available, and (4) 13 coronary artery centerline extraction algorithms, implemented by different research groups, are quantitatively evaluated and compared. The presented evaluation framework is made available to the medical imaging community for benchmarking existing or newly developed coronary centerline extraction algorithms.
Schaap
Michiel
M
Biomedical Imaging Group Rotterdam, Dept. of Radiology and Med. Informatics, Erasmus MC, Rotterdam, The Netherlands. michiel.schaap@erasmusmc.nl
Metz
Coert T
CT
van Walsum
Theo
T
van der Giessen
Alina G
AG
Weustink
Annick C
AC
Mollet
Nico R
NR
Bauer
Christian
C
Bogunović
Hrvoje
H
Castro
Carlos
C
Deng
Xiang
X
Dikici
Engin
E
O'Donnell
Thomas
T
Frenay
Michel
M
Friman
Ola
O
Hernández Hoyos
Marcela
M
Kitslaar
Pieter H
PH
Krissian
Karl
K
Kühnel
Caroline
C
Luengo-Oroz
Miguel A
MA
Orkisz
Maciej
M
Smedby
Orjan
O
Styner
Martin
M
Szymczak
Andrzej
A
Tek
Hüseyin
H
Wang
Chunliang
C
Warfield
Simon K
SK
Zambal
Sebastian
S
Zhang
Yong
Y
Krestin
Gabriel P
GP
Niessen
Wiro J
WJ
D000465:Algorithms; D017023:Coronary Angiography / Q000592:standards*; D006801:Humans; D009426:Netherlands; D010363:Pattern Recognition, Automated / Q000592:standards*; D011856:Radiographic Image Enhancement / Q000379:methods / Q000592:standards; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods* / Q000592:standards*; D012016:Reference Values; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012984:Software / Q000592:standards*; D012986:Software Validation; D014057:Tomography, X-Ray Computed / Q000592:standards*