title: Semi-automated query construction for content-based endomicroscopy video retrieval.
abstract: Content-based video retrieval has shown promising results to help physicians in their interpretation of medical videos in general and endomicroscopic ones in particular. Defining a relevant query for CBVR can however be a complex and time-consuming task for non-expert and even expert users. Indeed, uncut endomicroscopy videos may very well contain images corresponding to a variety of different tissue types. Using such uncut videos as queries may lead to drastic performance degradations for the system. In this study, we propose a semi-automated methodology that allows the physician to create meaningful and relevant queries in a simple and efficient manner. We believe that this will lead to more reproducible and more consistent results. The validation of our method is divided into two approaches. The first one is an indirect validation based on per video classification results with histopathological ground-truth. The second one is more direct and relies on perceived inter-video visual similarity ground-truth. We demonstrate that our proposed method significantly outperforms the approach with uncut videos and approaches the performance of a tedious manual query construction by an expert. Finally, we show that the similarity perceived between videos by experts is significantly correlated with the inter-video similarity distance computed by our retrieval system.
authors.forename: Marzieh Kohandani
authors.initials: MK
authors.lastname: Tafreshi
authors.forename: Nicolas
authors.initials: N
authors.lastname: Linard
authors.forename: Barbara
authors.initials: B
authors.lastname: André
authors.forename: Nicholas
authors.initials: N
authors.lastname: Ayache
authors.forename: Tom
authors.initials: T
authors.lastname: Vercauteren
mesh_terms: D000465:Algorithms; D003111:Colonic Polyps / Q000473:pathology*; D003113:Colonoscopy / Q000379:methods*; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods*; D008853:Microscopy / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014584:User-Computer Interface