title: Standardized evaluation framework for evaluating coronary artery stenosis detection, stenosis quantification and lumen segmentation algorithms in computed tomography angiography.
abstract: Though conventional coronary angiography (CCA) has been the standard of reference for diagnosing coronary artery disease in the past decades, computed tomography angiography (CTA) has rapidly emerged, and is nowadays widely used in clinical practice. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms devised to detect and quantify the coronary artery stenoses, and to segment the coronary artery lumen in CTA data. The objective of this evaluation framework is to demonstrate the feasibility of dedicated algorithms to: (1) (semi-)automatically detect and quantify stenosis on CTA, in comparison with quantitative coronary angiography (QCA) and CTA consensus reading, and (2) (semi-)automatically segment the coronary lumen on CTA, in comparison with expert's manual annotation. A database consisting of 48 multicenter multivendor cardiac CTA datasets with corresponding reference standards are described and made available. The algorithms from 11 research groups were quantitatively evaluated and compared. The results show that (1) some of the current stenosis detection/quantification algorithms may be used for triage or as a second-reader in clinical practice, and that (2) automatic lumen segmentation is possible with a precision similar to that obtained by experts. The framework is open for new submissions through the website, at http://coronary.bigr.nl/stenoses/.
authors.affiliation: Biomedical Imaging Group Rotterdam, Dept.of Radiology and Med. Informatics, Erasmus MC, Rotterdam, The Netherlands; Div. of Image Processing, Dept.of Radiology, Leiden UMC, Leiden, The Netherlands.
authors.forename: H A
authors.initials: HA
authors.lastname: Kirişli
authors.forename: M
authors.initials: M
authors.lastname: Schaap
authors.forename: C T
authors.initials: CT
authors.lastname: Metz
authors.forename: A S
authors.initials: AS
authors.lastname: Dharampal
authors.forename: W B
authors.initials: WB
authors.lastname: Meijboom
authors.forename: S L
authors.initials: SL
authors.lastname: Papadopoulou
authors.forename: A
authors.initials: A
authors.lastname: Dedic
authors.forename: K
authors.initials: K
authors.lastname: Nieman
authors.forename: M A
authors.initials: MA
authors.lastname: de Graaf
authors.forename: M F L
authors.initials: MF
authors.lastname: Meijs
authors.forename: M J
authors.initials: MJ
authors.lastname: Cramer
authors.forename: A
authors.initials: A
authors.lastname: Broersen
authors.forename: S
authors.initials: S
authors.lastname: Cetin
authors.forename: A
authors.initials: A
authors.lastname: Eslami
authors.forename: L
authors.initials: L
authors.lastname: Flórez-Valencia
authors.forename: K L
authors.initials: KL
authors.lastname: Lor
authors.forename: B
authors.initials: B
authors.lastname: Matuszewski
authors.forename: I
authors.initials: I
authors.lastname: Melki
authors.forename: B
authors.initials: B
authors.lastname: Mohr
authors.forename: I
authors.initials: I
authors.lastname: Oksüz
authors.forename: R
authors.initials: R
authors.lastname: Shahzad
authors.forename: C
authors.initials: C
authors.lastname: Wang
authors.forename: P H
authors.initials: PH
authors.lastname: Kitslaar
authors.forename: G
authors.initials: G
authors.lastname: Unal
authors.forename: A
authors.initials: A
authors.lastname: Katouzian
authors.forename: M
authors.initials: M
authors.lastname: Örkisz
authors.forename: C M
authors.initials: CM
authors.lastname: Chen
authors.forename: F
authors.initials: F
authors.lastname: Precioso
authors.forename: L
authors.initials: L
authors.lastname: Najman
authors.forename: S
authors.initials: S
authors.lastname: Masood
authors.forename: D
authors.initials: D
authors.lastname: Ünay
authors.forename: L
authors.initials: L
authors.lastname: van Vliet
authors.forename: R
authors.initials: R
authors.lastname: Moreno
authors.forename: R
authors.initials: R
authors.lastname: Goldenberg
authors.forename: E
authors.initials: E
authors.lastname: Vuçini
authors.forename: G P
authors.initials: GP
authors.lastname: Krestin
authors.forename: W J
authors.initials: WJ
authors.lastname: Niessen
authors.forename: T
authors.initials: T
authors.lastname: van Walsum
mesh_terms: D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D000465:Algorithms; D017023:Coronary Angiography / Q000592:standards*; D023921:Coronary Stenosis / Q000000981:diagnostic imaging*; D006801:Humans; D008875:Middle Aged; D009426:Netherlands; D010363:Pattern Recognition, Automated / Q000379:methods*; D011856:Radiographic Image Enhancement / Q000379:methods / Q000592:standards; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods* / Q000592:standards*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014057:Tomography, X-Ray Computed / Q000592:standards*
keywords: Computed tomography angiography (CTA); Coronary arteries; Standardized evaluation framework; stenoses detection; stenoses quantification