title: Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study.
abstract: The VESSEL12 (VESsel SEgmentation in the Lung) challenge objectively compares the performance of different algorithms to identify vessels in thoracic computed tomography (CT) scans. Vessel segmentation is fundamental in computer aided processing of data generated by 3D imaging modalities. As manual vessel segmentation is prohibitively time consuming, any real world application requires some form of automation. Several approaches exist for automated vessel segmentation, but judging their relative merits is difficult due to a lack of standardized evaluation. We present an annotated reference dataset containing 20 CT scans and propose nine categories to perform a comprehensive evaluation of vessel segmentation algorithms from both academia and industry. Twenty algorithms participated in the VESSEL12 challenge, held at International Symposium on Biomedical Imaging (ISBI) 2012. All results have been published at the VESSEL12 website http://vessel12.grand-challenge.org. The challenge remains ongoing and open to new participants. Our three contributions are: (1) an annotated reference dataset available online for evaluation of new algorithms; (2) a quantitative scoring system for objective comparison of algorithms; and (3) performance analysis of the strengths and weaknesses of the various vessel segmentation methods in the presence of various lung diseases.
authors.affiliation: Center for Applied Medical Research, University of Navarra, Spain. Electronic address: rina.rudyanto@gmail.com.
authors.forename: Rina D
authors.initials: RD
authors.lastname: Rudyanto
authors.affiliation: Diagnostic Image Analysis Group, Radboud University Nijmegen Medical Centre, The Netherlands.
authors.forename: Sjoerd
authors.initials: S
authors.lastname: Kerkstra
authors.affiliation: Diagnostic Image Analysis Group, Radboud University Nijmegen Medical Centre, The Netherlands.
authors.forename: Eva M
authors.initials: EM
authors.lastname: van Rikxoort
authors.affiliation: Institut SudParis Telecom, France.
authors.forename: Catalin
authors.initials: C
authors.lastname: Fetita
authors.affiliation: Institut SudParis Telecom, France.
authors.forename: Pierre-Yves
authors.initials: PY
authors.lastname: Brillet
authors.affiliation: Institut SudParis Telecom, France.
authors.forename: Christophe
authors.initials: C
authors.lastname: Lefevre
authors.affiliation: Arizona State University, USA.
authors.forename: Wenzhe
authors.initials: W
authors.lastname: Xue
authors.affiliation: Arizona State University, USA.
authors.forename: Xiangjun
authors.initials: X
authors.lastname: Zhu
authors.affiliation: Arizona State University, USA.
authors.forename: Jianming
authors.initials: J
authors.lastname: Liang
authors.affiliation: Bahcesehir University, Turkey.
authors.forename: Ilkay
authors.initials: I
authors.lastname: Öksüz
authors.affiliation: Bahcesehir University, Turkey.
authors.forename: Devrim
authors.initials: D
authors.lastname: Ünay
authors.affiliation: Bahcesehir University, Turkey.
authors.forename: Kamuran
authors.initials: K
authors.lastname: Kadipaşaoğlu
authors.affiliation: Brigham and Womens Hospital, Boston, USA.
authors.forename: Raúl San José
authors.initials: RS
authors.lastname: Estépar
authors.affiliation: Brigham and Womens Hospital, Boston, USA.
authors.forename: James C
authors.initials: JC
authors.lastname: Ross
authors.affiliation: Brigham and Womens Hospital, Boston, USA.
authors.forename: George R
authors.initials: GR
authors.lastname: Washko
authors.affiliation: CREATIS, Université de Lyon, France.
authors.forename: Juan-Carlos
authors.initials: JC
authors.lastname: Prieto
authors.affiliation: Universidad de los Andes, Bogota, Colombia.
authors.forename: Marcela Hernández
authors.initials: MH
authors.lastname: Hoyos
authors.affiliation: CREATIS, Université de Lyon, France.
authors.forename: Maciej
authors.initials: M
authors.lastname: Orkisz
authors.affiliation: Fraunhofer MEVIS, Germany.
authors.forename: Hans
authors.initials: H
authors.lastname: Meine
authors.affiliation: Fraunhofer MEVIS, Germany.
authors.forename: Markus
authors.initials: M
authors.lastname: Hüllebrand
authors.affiliation: Fraunhofer MEVIS, Germany.
authors.forename: Christina
authors.initials: C
authors.lastname: Stöcker
authors.affiliation: Universitat Politècnica de València, Spain.
authors.forename: Fernando Lopez
authors.initials: FL
authors.lastname: Mir
authors.affiliation: Universitat Politècnica de València, Spain.
authors.forename: Valery
authors.initials: V
authors.lastname: Naranjo
authors.affiliation: Universitat Politècnica de València, Spain.
authors.forename: Eliseo
authors.initials: E
authors.lastname: Villanueva
authors.affiliation: Division of Image Processing (LKEB), Leiden University Medical Center, The Netherlands.
authors.forename: Marius
authors.initials: M
authors.lastname: Staring
authors.affiliation: Hunan University, China.
authors.forename: Changyan
authors.initials: C
authors.lastname: Xiao
authors.affiliation: Division of Image Processing (LKEB), Leiden University Medical Center, The Netherlands.
authors.forename: Berend C
authors.initials: BC
authors.lastname: Stoel
authors.affiliation: Institute of Applied Computer Science, Lodz University of Technology, Poland.
authors.forename: Anna
authors.initials: A
authors.lastname: Fabijanska
authors.affiliation: Norwegian University of Science and Technology, Norway.
authors.forename: Erik
authors.initials: E
authors.lastname: Smistad
authors.affiliation: Norwegian University of Science and Technology, Norway.
authors.forename: Anne C
authors.initials: AC
authors.lastname: Elster
authors.affiliation: Norwegian University of Science and Technology, Norway.
authors.forename: Frank
authors.initials: F
authors.lastname: Lindseth
authors.affiliation: Shahed University, Iran.
authors.forename: Amir Hossein
authors.initials: AH
authors.lastname: Foruzan
authors.affiliation: University of Alberta, Canada.
authors.forename: Ryan
authors.initials: R
authors.lastname: Kiros
authors.affiliation: University of Alberta, Canada.
authors.forename: Karteek
authors.initials: K
authors.lastname: Popuri
authors.affiliation: University of Alberta, Canada.
authors.forename: Dana
authors.initials: D
authors.lastname: Cobzas
authors.affiliation: Universidad Politécnica de Madrid, Spain; CIBER-BBN, Spain.
authors.forename: Daniel
authors.initials: D
authors.lastname: Jimenez-Carretero
authors.affiliation: Universidad Politécnica de Madrid, Spain; CIBER-BBN, Spain.
authors.forename: Andres
authors.initials: A
authors.lastname: Santos
authors.affiliation: Universidad Politécnica de Madrid, Spain; CIBER-BBN, Spain.
authors.forename: Maria J
authors.initials: MJ
authors.lastname: Ledesma-Carbayo
authors.affiliation: Graz University of Technology, Institute for Computer Vision and Graphics, Austria.
authors.forename: Michael
authors.initials: M
authors.lastname: Helmberger
authors.affiliation: Ludwig Boltzmann Institute for Clinical Forensic Imaging, Graz, Austria.
authors.forename: Martin
authors.initials: M
authors.lastname: Urschler
authors.affiliation: Ludwig Boltzmann Institute for Lung Vascular Research, Graz, Austria.
authors.forename: Michael
authors.initials: M
authors.lastname: Pienn
authors.affiliation: Diagnostic Image Analysis Group, Radboud University Nijmegen Medical Centre, The Netherlands.
authors.forename: Dennis G H
authors.initials: DG
authors.lastname: Bosboom
authors.affiliation: Pulmonary Department, Clínica Universidad de Navarra, University of Navarra, Spain.
authors.forename: Arantza
authors.initials: A
authors.lastname: Campo
authors.affiliation: Diagnostic Image Analysis Group, Radboud University Nijmegen Medical Centre, The Netherlands.
authors.forename: Mathias
authors.initials: M
authors.lastname: Prokop
authors.affiliation: Department of Radiology, University Medical Center, Utrecht, The Netherlands.
authors.forename: Pim A
authors.initials: PA
authors.lastname: de Jong
authors.affiliation: Center for Applied Medical Research, University of Navarra, Spain.
authors.forename: Carlos
authors.initials: C
authors.lastname: Ortiz-de-Solorzano
authors.affiliation: Center for Applied Medical Research, University of Navarra, Spain.
authors.forename: Arrate
authors.initials: A
authors.lastname: Muñoz-Barrutia
authors.affiliation: Diagnostic Image Analysis Group, Radboud University Nijmegen Medical Centre, The Netherlands.
authors.forename: Bram
authors.initials: B
authors.lastname: van Ginneken
mesh_terms: D000465:Algorithms; D003287:Contrast Media; D006801:Humans; D008168:Lung / Q000098:blood supply* / Q000000981:diagnostic imaging*; D009426:Netherlands; D010363:Pattern Recognition, Automated; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods*; D012680:Sensitivity and Specificity; D013030:Spain; D014057:Tomography, X-Ray Computed / Q000379:methods*
chemical_list: D003287:Contrast Media
keywords: Algorithm comparison; Challenge; Lung vessels; Segmentation; Thoracic computed tomography
references.citation: Med Image Anal. 2009 Oct;13(5):757-70
references.pmid: 19646913
references.citation: Eur Radiol. 2009 Feb;19(2):324-32
references.pmid: 18726597
references.citation: Med Image Anal. 2010 Aug;14(4):527-38
references.pmid: 20395163
references.citation: Radiographics. 2005 Mar-Apr;25(2):525-36
references.pmid: 15798068
references.citation: J Anat. 2007 Nov;211(5):579-88
references.pmid: 17919291
references.citation: Comput Med Imaging Graph. 2006 Jul;30(5):299-313
references.pmid: 16920331
references.citation: IEEE Trans Med Imaging. 2013 Feb;32(2):210-22
references.pmid: 23014712
references.citation: IEEE Trans Med Imaging. 2002 Feb;21(2):61-75
references.pmid: 11929106
references.citation: Med Phys. 2010 Apr;37(4):1522-32
references.pmid: 20443473
references.citation: Med Image Anal. 2011 Aug;15(4):477-88
references.pmid: 21419689
references.citation: Med Image Anal. 1998 Jun;2(2):143-68
references.pmid: 10646760
references.citation: Acad Radiol. 2005 Jun;12(6):782-92
references.pmid: 15935977
references.citation: IEEE Trans Med Imaging. 2001 Aug;20(8):689-703
references.pmid: 11513021
references.citation: J Thorac Imaging. 2011 Feb;26(1):4-5
references.pmid: 21258223
references.citation: IEEE Trans Med Imaging. 2012 Nov;31(11):2093-107
references.pmid: 22855226
references.citation: IEEE Trans Med Imaging. 2006 Apr;25(4):435-50
references.pmid: 16608059
references.citation: Med Image Anal. 2010 Apr;14(2):172-84
references.pmid: 20060769
references.citation: IEEE Trans Med Imaging. 2009 Aug;28(8):1251-65
references.pmid: 19211338
references.citation: Neuroimage. 2006 Aug 1;32(1):138-45
references.pmid: 16750398
references.citation: Med Phys. 2009 Jul;36(7):2934-47
references.pmid: 19673192
references.citation: Proc IEEE Int Symp Biomed Imaging. 2012;:1479-1482
references.pmid: 23743962
references.citation: IEEE Trans Med Imaging. 2000 Feb;19(2):103-14
references.pmid: 10784282
references.citation: IEEE Trans Med Imaging. 2005 Apr;24(4):486-99
references.pmid: 15822807
references.citation: IEEE Trans Med Imaging. 2011 Nov;30(11):1901-20
references.pmid: 21632295
references.citation: Med Phys. 2007 Dec;34(12):4567-77
references.pmid: 18196782
references.citation: IEEE Trans Med Imaging. 2009 Feb;28(2):202-14
references.pmid: 19188109
references.citation: IEEE Trans Med Imaging. 2003 Oct;22(10):1224-34
references.pmid: 14552577
references.citation: IEEE Trans Med Imaging. 2002 Dec;21(12):1517-23
references.pmid: 12588035
references.citation: Med Image Anal. 2010 Dec;14(6):707-22
references.pmid: 20573538
references.citation: Med Image Anal. 2009 Dec;13(6):819-45
references.pmid: 19818675
references.citation: Med Image Anal. 2011 Feb;15(1):112-24
references.pmid: 20951629
references.citation: IEEE Pulse. 2011 Nov;2(6):60-70
references.pmid: 22147070
references.citation: Am J Respir Crit Care Med. 2010 Feb 1;181(3):218-25
references.pmid: 19875683
references.citation: Med Image Anal. 2009 Oct;13(5):701-14
references.pmid: 19632885
references.citation: Eur Radiol. 2009 Nov;19(11):2569-75
references.pmid: 19471936
references.citation: Chest. 2007 Dec;132(6):1932-8
references.pmid: 18079226
references.citation: IEEE Trans Inf Technol Biomed. 2011 Mar;15(2):214-20
references.pmid: 21317088
references.citation: IEEE Trans Image Process. 2013 Jan;22(1):174-88
references.pmid: 22955905