Video repairing under variable illumination using cyclic motions.
This paper presents a complete system capable of synthesizing a large number of pixels that are missing due to occlusion or damage in an uncalibrated input video. These missing pixels may correspond to the static background or cyclic motions of the captured scene. Our system employs user-assisted video layer segmentation, while the main processing in video repair is fully automatic. The input video is first decomposed into the color and illumination videos. The necessary temporal consistency is maintained by tensor voting in the spatio-temporal domain. Missing colors and illumination of the background are synthesized by applying image repairing. Finally, the occluded motions are inferred by spatio-temporal alignment of collected samples at multiple scales. We experimented on our system with some difficult examples with variable illumination, where the capturing camera can be stationary or in motion.
Jia
Jiaya
J
Department of Computer Science and Engineering, the Chinese University of Hong Kong, Shatin NT. leojia@cse.cuhk.edu.hk
Tai
Yu-Wing
YW
Wu
Tai-Pang
TP
Tang
Chi-Keung
CK
D000465:Algorithms; D001185:Artificial Intelligence; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods; D008029:Lighting; D009038:Motion; D009991:Oscillometry / Q000379:methods; D010363:Pattern Recognition, Automated / Q000379:methods*; D010781:Photography / Q000379:methods; D010783:Photometry / Q000379:methods*; D013382:Subtraction Technique; D014741:Video Recording / Q000379:methods*