title: Epitomized summarization of wireless capsule endoscopic videos for efficient visualization.
abstract: A video recording of an examination by Wireless Capsule Endoscopy (WCE) may typically contain more than 55,000 video frames, which makes the manual visual screening by an experienced gastroenterologist a highly time-consuming task. In this paper, we propose a novel method of epitomized summarization of WCE videos for efficient visualization to a gastroenterologist. For each short sequence of a WCE video, an epitomized frame is generated. New constraints are introduced into the epitome formulation to achieve the necessary visual quality for manual examination, and an EM algorithm for learning the epitome is derived. First, the local context weights are introduced to generate the epitomized frame. The epitomized frame preserves the appearance of all the input patches from the frames of the short sequence. Furthermore, by introducing spatial distributions for semantic interpretation of image patches in our epitome formulation, we show that it also provides a framework to facilitate the semantic description of visual features to generate organized visual summarization of WCE video, where the patches in different positions correspond to different semantic information. Our experiments on real WCE videos show that, using epitomized summarization, the number of frames have to be examined by the gastroenterologist can be reduced to less than one-tenth of the original frames in the video.
authors.affiliation: Institute for Infocomm Research, Singapore. xchu@i2r.a-star.edu.sg
authors.forename: Xinqi
authors.initials: X
authors.lastname: Chu
authors.forename: Chee Khun
authors.initials: CK
authors.lastname: Poh
authors.forename: Liyuan
authors.initials: L
authors.lastname: Li
authors.forename: Kap Luk
authors.initials: KL
authors.lastname: Chan
authors.forename: Shuicheng
authors.initials: S
authors.lastname: Yan
authors.forename: Weijia
authors.initials: W
authors.lastname: Shen
authors.forename: That Mon
authors.initials: TM
authors.lastname: Htwe
authors.forename: Jiang
authors.initials: J
authors.lastname: Liu
authors.forename: Joo Hwee
authors.initials: JH
authors.lastname: Lim
authors.forename: Eng Hui
authors.initials: EH
authors.lastname: Ong
authors.forename: Khek Yu
authors.initials: KY
authors.lastname: Ho
mesh_terms: D000465:Algorithms; D053704:Capsule Endoscopy / Q000379:methods*; D006801:Humans; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique; D013686:Telemetry / Q000379:methods*