title: Endoscopic video manifolds.
abstract: Postprocedural analysis of gastrointestinal (GI) endoscopic videos is a difficult task because the videos often suffer from a large number of poor-quality frames due to the motion or out-of-focus blur, specular highlights and artefacts caused by turbid fluid inside the GI tract. Clinically, each frame of the video is examined individually by the endoscopic expert due to the lack of a suitable visualisation technique. In this work, we introduce a low dimensional representation of endoscopic videos based on a manifold learning approach. The introduced endoscopic video manifolds (EVMs) enable the clustering of poor-quality frames and grouping of different segments of the GI endoscopic video in an unsupervised manner to facilitate subsequent visual assessment. In this paper, we present two novel inter-frame similarity measures for manifold learning to create structured manifolds from complex endoscopic videos. Our experiments demonstrate that the proposed method yields high precision and recall values for uninformative frame detection (90.91% and 82.90%) and results in well-structured manifolds for scene clustering.
authors.affiliation: Chair for Computer Aided Medical Procedures (CAMP), TU Munich, Germany. atasoy@cs.tum.edu
authors.forename: Selen
authors.initials: S
authors.lastname: Atasoy
authors.forename: Diana
authors.initials: D
authors.lastname: Mateus
authors.forename: Joe
authors.initials: J
authors.lastname: Lallemand
authors.forename: Alexander
authors.initials: A
authors.lastname: Meining
authors.forename: Guang-Zhong
authors.initials: GZ
authors.lastname: Yang
authors.forename: Nassir
authors.initials: N
authors.lastname: Navab
mesh_terms: D000465:Algorithms; D016000:Cluster Analysis; D016099:Endoscopy, Gastrointestinal / Q000379:methods*; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity