title: Standardized evaluation methodology and reference database for evaluating IVUS image segmentation.
abstract: This paper describes an evaluation framework that allows a standardized and quantitative comparison of IVUS lumen and media segmentation algorithms. This framework has been introduced at the MICCAI 2011 Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop, comparing the results of eight teams that participated. We describe the available data-base comprising of multi-center, multi-vendor and multi-frequency IVUS datasets, their acquisition, the creation of the reference standard and the evaluation measures. The approaches address segmentation of the lumen, the media, or both borders; semi- or fully-automatic operation; and 2-D vs. 3-D methodology. Three performance measures for quantitative analysis have been proposed. The results of the evaluation indicate that segmentation of the vessel lumen and media is possible with an accuracy that is comparable to manual annotation when semi-automatic methods are used, as well as encouraging results can be obtained also in case of fully-automatic segmentation. The analysis performed in this paper also highlights the challenges in IVUS segmentation that remains to be solved.
authors.affiliation: Computer Vision Center, Bellaterra, Spain; Dept. Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain. Electronic address: balocco.simone@gmail.com.
authors.forename: Simone
authors.initials: S
authors.lastname: Balocco
authors.affiliation: Computer Vision Center, Bellaterra, Spain.
authors.forename: Carlo
authors.initials: C
authors.lastname: Gatta
authors.affiliation: Computer Vision Center, Bellaterra, Spain; Dept. Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain.
authors.forename: Francesco
authors.initials: F
authors.lastname: Ciompi
authors.affiliation: Department of Electrical & Computer Engineering, The University of Iowa, Iowa City, USA.
authors.forename: Andreas
authors.initials: A
authors.lastname: Wahle
authors.affiliation: Computer Vision Center, Bellaterra, Spain; Dept. Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain.
authors.forename: Petia
authors.initials: P
authors.lastname: Radeva
authors.affiliation: UZ Brussel, Department of Cardiology, Brussels, Belgium.
authors.forename: Stephane
authors.initials: S
authors.lastname: Carlier
authors.affiliation: Faculty of Engineering and Natural Sciences, Sabanci University, Turkey.
authors.forename: Gozde
authors.initials: G
authors.lastname: Unal
authors.affiliation: Cardiovascular Research Foundation, New York, USA.
authors.forename: Elias
authors.initials: E
authors.lastname: Sanidas
authors.affiliation: Hospital Universitari "Germans Trias i Pujol", Badalona, Spain.
authors.forename: Josepa
authors.initials: J
authors.lastname: Mauri
authors.affiliation: Hospital Universitari "Germans Trias i Pujol", Badalona, Spain.
authors.forename: Xavier
authors.initials: X
authors.lastname: Carillo
authors.affiliation: 2nd Department of Internal Medicine, Charles University, Prague, Czech Republic.
authors.forename: Tomas
authors.initials: T
authors.lastname: Kovarnik
authors.affiliation: National Taiwan University of Science and Technology, Taiwan.
authors.forename: Ching-Wei
authors.initials: CW
authors.lastname: Wang
authors.affiliation: National Taiwan University of Science and Technology, Taiwan.
authors.forename: Hsiang-Chou
authors.initials: HC
authors.lastname: Chen
authors.affiliation: Institute of Molecular Biology and Biotechnology, Department of Biomedical Research, Foundation for Research and Technology Hellas, University of Ioannina, Ioannina, Greece.
authors.forename: Themis P
authors.initials: TP
authors.lastname: Exarchos
authors.affiliation: Institute of Molecular Biology and Biotechnology, Department of Biomedical Research, Foundation for Research and Technology Hellas, University of Ioannina, Ioannina, Greece.
authors.forename: Dimitrios I
authors.initials: DI
authors.lastname: Fotiadis
authors.affiliation: Laboratory of Biorheology and Medical Ultrasonics, University of Montreal Hospital Research Center (CRCHUM), Montreal, Canada.
authors.forename: François
authors.initials: F
authors.lastname: Destrempes
authors.affiliation: Laboratory of Biorheology and Medical Ultrasonics, University of Montreal Hospital Research Center (CRCHUM), Montreal, Canada; Department of Radiology, Radio-Oncology and Nuclear Medicine, Institute of Biomedical Engineering, University of Montreal, Montreal, Canada.
authors.forename: Guy
authors.initials: G
authors.lastname: Cloutier
authors.affiliation: Dept. Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain.
authors.forename: Oriol
authors.initials: O
authors.lastname: Pujol
authors.affiliation: Computer Vision Center, Bellaterra, Spain; Dept. Matemàtica Aplicada i Anàlisi, Universitat de Barcelona, Barcelona, Spain.
authors.forename: Marina
authors.initials: M
authors.lastname: Alberti
authors.affiliation: Computational Biomedicine Lab, Department of Computer Science, University of Houston, Houston, TX, USA.
authors.forename: E Gerardo
authors.initials: EG
authors.lastname: Mendizabal-Ruiz
authors.affiliation: Centro de Investigacion en Matematicas, Guanajuato, Mexico.
authors.forename: Mariano
authors.initials: M
authors.lastname: Rivera
authors.affiliation: Faculty of Engineering and Natural Sciences, Sabanci University, Turkey.
authors.forename: Timur
authors.initials: T
authors.lastname: Aksoy
authors.affiliation: Department of Electrical & Computer Engineering, The University of Iowa, Iowa City, USA.
authors.forename: Richard W
authors.initials: RW
authors.lastname: Downe
authors.affiliation: Computational Biomedicine Lab, Department of Computer Science, University of Houston, Houston, TX, USA.
authors.forename: Ioannis A
authors.initials: IA
authors.lastname: Kakadiaris
mesh_terms: D003324:Coronary Artery Disease / Q000000981:diagnostic imaging*; D016208:Databases, Factual / Q000592:standards*; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods* / Q000592:standards*; D038622:Internationality; D017410:Practice Guidelines as Topic; D012016:Reference Values; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D018084:Ultrasonography, Interventional / Q000379:methods* / Q000592:standards*
keywords: Algorithm comparison; Evaluation framework; IVUS (intravascular ultrasound); Image segmentation