title: Interframe coding of feature descriptors for mobile augmented reality.
abstract: Streaming mobile augmented reality applications require both real-time recognition and tracking of objects of interest in a video sequence. Typically, local features are calculated from the gradients of a canonical patch around a keypoint in individual video frames. In this paper, we propose a temporally coherent keypoint detector and design efficient interframe predictive coding techniques for canonical patches, feature descriptors, and keypoint locations. In the proposed system, we strive to transmit each patch or its equivalent feature descriptor with as few bits as possible by modifying a previously transmitted patch or descriptor. Our solution enables server-based mobile augmented reality where a continuous stream of salient information, sufficient for image-based retrieval, and object localization, is sent at a bit-rate that is practical for today's wireless links and less than one-tenth of the bit-rate needed to stream the compressed video to the server.
authors: Mina
authors: M
authors: Makar
authors: Vijay
authors: V
authors: Chandrasekhar
authors: Sam S
authors: SS
authors: Tsai
authors: David
authors: D
authors: Chen
authors: Bernd
authors: B
authors: Girod
mesh_terms: D000465:Algorithms; D044962:Data Compression / Q000379:methods*; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D009862:Online Systems; D010781:Photography / Q000379:methods*; D012680:Sensitivity and Specificity; D012815:Signal Processing, Computer-Assisted; D014584:User-Computer Interface; D014741:Video Recording / Q000379:methods*