title: Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms.
abstract: Efficiently obtaining a reliable coronary artery centerline from computed tomography angiography data is relevant in clinical practice. Whereas numerous methods have been presented for this purpose, up to now no standardized evaluation methodology has been published to reliably evaluate and compare the performance of the existing or newly developed coronary artery centerline extraction algorithms. This paper describes a standardized evaluation methodology and reference database for the quantitative evaluation of coronary artery centerline extraction algorithms. The contribution of this work is fourfold: (1) a method is described to create a consensus centerline with multiple observers, (2) well-defined measures are presented for the evaluation of coronary artery centerline extraction algorithms, (3) a database containing 32 cardiac CTA datasets with corresponding reference standard is described and made available, and (4) 13 coronary artery centerline extraction algorithms, implemented by different research groups, are quantitatively evaluated and compared. The presented evaluation framework is made available to the medical imaging community for benchmarking existing or newly developed coronary centerline extraction algorithms.
authors.affiliation: Biomedical Imaging Group Rotterdam, Dept. of Radiology and Med. Informatics, Erasmus MC, Rotterdam, The Netherlands. michiel.schaap@erasmusmc.nl
authors.forename: Michiel
authors.initials: M
authors.lastname: Schaap
authors.forename: Coert T
authors.initials: CT
authors.lastname: Metz
authors.forename: Theo
authors.initials: T
authors.lastname: van Walsum
authors.forename: Alina G
authors.initials: AG
authors.lastname: van der Giessen
authors.forename: Annick C
authors.initials: AC
authors.lastname: Weustink
authors.forename: Nico R
authors.initials: NR
authors.lastname: Mollet
authors.forename: Christian
authors.initials: C
authors.lastname: Bauer
authors.forename: Hrvoje
authors.initials: H
authors.lastname: Bogunović
authors.forename: Carlos
authors.initials: C
authors.lastname: Castro
authors.forename: Xiang
authors.initials: X
authors.lastname: Deng
authors.forename: Engin
authors.initials: E
authors.lastname: Dikici
authors.forename: Thomas
authors.initials: T
authors.lastname: O'Donnell
authors.forename: Michel
authors.initials: M
authors.lastname: Frenay
authors.forename: Ola
authors.initials: O
authors.lastname: Friman
authors.forename: Marcela
authors.initials: M
authors.lastname: Hernández Hoyos
authors.forename: Pieter H
authors.initials: PH
authors.lastname: Kitslaar
authors.forename: Karl
authors.initials: K
authors.lastname: Krissian
authors.forename: Caroline
authors.initials: C
authors.lastname: Kühnel
authors.forename: Miguel A
authors.initials: MA
authors.lastname: Luengo-Oroz
authors.forename: Maciej
authors.initials: M
authors.lastname: Orkisz
authors.forename: Orjan
authors.initials: O
authors.lastname: Smedby
authors.forename: Martin
authors.initials: M
authors.lastname: Styner
authors.forename: Andrzej
authors.initials: A
authors.lastname: Szymczak
authors.forename: Hüseyin
authors.initials: H
authors.lastname: Tek
authors.forename: Chunliang
authors.initials: C
authors.lastname: Wang
authors.forename: Simon K
authors.initials: SK
authors.lastname: Warfield
authors.forename: Sebastian
authors.initials: S
authors.lastname: Zambal
authors.forename: Yong
authors.initials: Y
authors.lastname: Zhang
authors.forename: Gabriel P
authors.initials: GP
authors.lastname: Krestin
authors.forename: Wiro J
authors.initials: WJ
authors.lastname: Niessen
mesh_terms: D000465:Algorithms; D017023:Coronary Angiography / Q000592:standards*; D006801:Humans; D009426:Netherlands; D010363:Pattern Recognition, Automated / Q000592:standards*; D011856:Radiographic Image Enhancement / Q000379:methods / Q000592:standards; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods* / Q000592:standards*; D012016:Reference Values; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012984:Software / Q000592:standards*; D012986:Software Validation; D014057:Tomography, X-Ray Computed / Q000592:standards*