title: Evaluation of segmentation methods on head and neck CT: Auto-segmentation challenge 2015.
abstract: OBJECTIVE
  Automated delineation of structures and organs is a key step in medical imaging. However, due to the large number and diversity of structures and the large variety of segmentation algorithms, a consensus is lacking as to which automated segmentation method works best for certain applications. Segmentation challenges are a good approach for unbiased evaluation and comparison of segmentation algorithms.
  
  
  METHODS
  In this work, we describe and present the results of the Head and Neck Auto-Segmentation Challenge 2015, a satellite event at the Medical Image Computing and Computer Assisted Interventions (MICCAI) 2015 conference. Six teams participated in a challenge to segment nine structures in the head and neck region of CT images: brainstem, mandible, chiasm, bilateral optic nerves, bilateral parotid glands, and bilateral submandibular glands.
  
  
  RESULTS
  This paper presents the quantitative results of this challenge using multiple established error metrics and a well-defined ranking system. The strengths and weaknesses of the different auto-segmentation approaches are analyzed and discussed.
  
  
  CONCLUSIONS
  The Head and Neck Auto-Segmentation Challenge 2015 was a good opportunity to assess the current state-of-the-art in segmentation of organs at risk for radiotherapy treatment. Participating teams had the possibility to compare their approaches to other methods under unbiased and standardized circumstances. The results demonstrate a clear tendency toward more general purpose and fewer structure-specific segmentation algorithms.
authors.affiliation: Department of Biomedical Computer Science and Mechatronics, Institute for Biomedical Image Analysis, UMIT, Hall, Tyrol, 6060, Austria.
authors.forename: Patrik F
authors.initials: PF
authors.lastname: Raudaschl
authors.affiliation: Department of Experimental and Clinical Medicine, Magna Graecia University of Catanzaro, Catanzaro, 88100, Italy.
authors.forename: Paolo
authors.initials: P
authors.lastname: Zaffino
authors.affiliation: Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, 02114, USA.
authors.forename: Gregory C
authors.initials: GC
authors.lastname: Sharp
authors.affiliation: Department of Experimental and Clinical Medicine, Magna Graecia University of Catanzaro, Catanzaro, 88100, Italy.
authors.forename: Maria Francesca
authors.initials: MF
authors.lastname: Spadea
authors.affiliation: Merck and Co., Inc., West Point, PA, 19422, USA.
authors.forename: Antong
authors.initials: A
authors.lastname: Chen
authors.affiliation: Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, 37235, USA.
authors.forename: Benoit M
authors.initials: BM
authors.lastname: Dawant
authors.affiliation: Varian Medical Systems, Baden, 5404, Switzerland.
authors.forename: Thomas
authors.initials: T
authors.lastname: Albrecht
authors.affiliation: Varian Medical Systems, Baden, 5404, Switzerland.
authors.forename: Tobias
authors.initials: T
authors.lastname: Gass
authors.affiliation: University of Basel, Basel, 4001, Switzerland.
authors.forename: Christoph
authors.initials: C
authors.lastname: Langguth
authors.affiliation: University of Basel, Basel, 4001, Switzerland.
authors.forename: Marcel
authors.initials: M
authors.lastname: Lüthi
authors.affiliation: Fraunhofer, 64283, Darmstadt, Germany.
authors.forename: Florian
authors.initials: F
authors.lastname: Jung
authors.affiliation: Fraunhofer, 64283, Darmstadt, Germany.
authors.forename: Oliver
authors.initials: O
authors.lastname: Knapp
authors.affiliation: Fraunhofer, 64283, Darmstadt, Germany.
authors.forename: Stefan
authors.initials: S
authors.lastname: Wesarg
authors.affiliation: Imorphics Ltd., Kilburn House, Manchester Science Park, Manchester, M15 6SE, UK.
authors.forename: Richard
authors.initials: R
authors.lastname: Mannion-Haworth
authors.affiliation: Imorphics Ltd., Kilburn House, Manchester Science Park, Manchester, M15 6SE, UK.
authors.forename: Mike
authors.initials: M
authors.lastname: Bowes
authors.affiliation: Imorphics Ltd., Kilburn House, Manchester Science Park, Manchester, M15 6SE, UK.
authors.forename: Annaliese
authors.initials: A
authors.lastname: Ashman
authors.affiliation: Imorphics Ltd., Kilburn House, Manchester Science Park, Manchester, M15 6SE, UK.
authors.forename: Gwenael
authors.initials: G
authors.lastname: Guillard
authors.affiliation: Imorphics Ltd., Kilburn House, Manchester Science Park, Manchester, M15 6SE, UK.
authors.forename: Alan
authors.initials: A
authors.lastname: Brett
authors.affiliation: Imorphics Ltd., Kilburn House, Manchester Science Park, Manchester, M15 6SE, UK.
authors.forename: Graham
authors.initials: G
authors.lastname: Vincent
authors.affiliation: Signal Processing and Recognition Group, Universidad Nacional de Colombia, Colombia.
authors.forename: Mauricio
authors.initials: M
authors.lastname: Orbes-Arteaga
authors.affiliation: Signal Processing and Recognition Group, Universidad Nacional de Colombia, Colombia.
authors.forename: David
authors.initials: D
authors.lastname: Cárdenas-Peña
authors.affiliation: Signal Processing and Recognition Group, Universidad Nacional de Colombia, Colombia.
authors.forename: German
authors.initials: G
authors.lastname: Castellanos-Dominguez
authors.affiliation: University of Washington, Seattle, WA, 98105, USA.
authors.forename: Nava
authors.initials: N
authors.lastname: Aghdasi
authors.affiliation: University of Washington, Seattle, WA, 98105, USA.
authors.forename: Yangming
authors.initials: Y
authors.lastname: Li
authors.affiliation: University of Washington, Seattle, WA, 98105, USA.
authors.forename: Angelique
authors.initials: A
authors.lastname: Berens
authors.affiliation: University of Washington, Seattle, WA, 98105, USA.
authors.forename: Kris
authors.initials: K
authors.lastname: Moe
authors.affiliation: University of Washington, Seattle, WA, 98105, USA.
authors.forename: Blake
authors.initials: B
authors.lastname: Hannaford
authors.affiliation: Department of Biomedical Computer Science and Mechatronics, Institute for Biomedical Image Analysis, UMIT, Hall, Tyrol, 6060, Austria.
authors.forename: Rainer
authors.initials: R
authors.lastname: Schubert
authors.affiliation: Department of Biomedical Computer Science and Mechatronics, Institute for Biomedical Image Analysis, UMIT, Hall, Tyrol, 6060, Austria.
authors.forename: Karl D
authors.initials: KD
authors.lastname: Fritscher
mesh_terms: D000465:Algorithms; D006257:Head; D006258:Head and Neck Neoplasms / Q000000981:diagnostic imaging*; D006801:Humans; D009333:Neck; D014057:Tomography, X-Ray Computed
keywords: atlas-based segmentation; automated segmentation; model-based segmentation; segmentation challenge