title: Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography.
abstract: Real-time 3D Echocardiography (RT3DE) has been proven to be an accurate tool for left ventricular (LV) volume assessment. However, identification of the LV endocardium remains a challenging task, mainly because of the low tissue/blood contrast of the images combined with typical artifacts. Several semi and fully automatic algorithms have been proposed for segmenting the endocardium in RT3DE data in order to extract relevant clinical indices, but a systematic and fair comparison between such methods has so far been impossible due to the lack of a publicly available common database. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms developed to segment the LV border in RT3DE. A database consisting of 45 multivendor cardiac ultrasound recordings acquired at different centers with corresponding reference measurements from three experts are made available. The algorithms from nine research groups were quantitatively evaluated and compared using the proposed online platform. The results showed that the best methods produce promising results with respect to the experts' measurements for the extraction of clinical indices, and that they offer good segmentation precision in terms of mean distance error in the context of the experts' variability range. The platform remains open for new submissions.
authors.forename: Olivier
authors.initials: O
authors.lastname: Bernard
authors.forename: Johan G
authors.initials: JG
authors.lastname: Bosch
authors.forename: Brecht
authors.initials: B
authors.lastname: Heyde
authors.forename: Martino
authors.initials: M
authors.lastname: Alessandrini
authors.forename: Daniel
authors.initials: D
authors.lastname: Barbosa
authors.forename: Sorina
authors.initials: S
authors.lastname: Camarasu-Pop
authors.forename: Frederic
authors.initials: F
authors.lastname: Cervenansky
authors.forename: Sebastien
authors.initials: S
authors.lastname: Valette
authors.forename: Oana
authors.initials: O
authors.lastname: Mirea
authors.forename: Michel
authors.initials: M
authors.lastname: Bernier
authors.forename: Pierre-Marc
authors.initials: PM
authors.lastname: Jodoin
authors.forename: Jaime Santo
authors.initials: JS
authors.lastname: Domingos
authors.forename: Richard V
authors.initials: RV
authors.lastname: Stebbing
authors.forename: Kevin
authors.initials: K
authors.lastname: Keraudren
authors.forename: Ozan
authors.initials: O
authors.lastname: Oktay
authors.forename: Jose
authors.initials: J
authors.lastname: Caballero
authors.forename: Wei
authors.initials: W
authors.lastname: Shi
authors.forename: Daniel
authors.initials: D
authors.lastname: Rueckert
authors.forename: Fausto
authors.initials: F
authors.lastname: Milletari
authors.forename: Seyed-Ahmad
authors.initials: SA
authors.lastname: Ahmadi
authors.forename: Erik
authors.initials: E
authors.lastname: Smistad
authors.forename: Frank
authors.initials: F
authors.lastname: Lindseth
authors.forename: Maartje
authors.initials: M
authors.lastname: van Stralen
authors.forename: Chen
authors.initials: C
authors.lastname: Wang
authors.forename: Orjan
authors.initials: O
authors.lastname: Smedby
authors.forename: Erwan
authors.initials: E
authors.lastname: Donal
authors.forename: Mark
authors.initials: M
authors.lastname: Monaghan
authors.forename: Alex
authors.initials: A
authors.lastname: Papachristidis
authors.forename: Marcel L
authors.initials: ML
authors.lastname: Geleijnse
authors.forename: Elena
authors.initials: E
authors.lastname: Galli
authors.forename: Jan
authors.initials: J
authors.lastname: D'hooge
mesh_terms: D000465:Algorithms; D019560:Echocardiography, Three-Dimensional / Q000379:methods*; D006352:Heart Ventricles / Q000000981:diagnostic imaging*; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000379:methods*