Human perception based video preprocessing for telesurgery.
Video transmission plays a critical role in robotic telesurgery because of the required high bandwidth and quality requirement. We propose an adaptive video preprocessing technique to accelerate the transmission of telesurgical video. Using this technique, the bandwidth can be reallocated adaptively from non-essential surrounding regions to the region of interest when preprocessed image sequences are passed to the video encoder, ensuring excellent image quality of critical regions (e.g. surgical landscape). The algorithm first generates a physiologically appropriate attention map which can be updated dynamically. Then, an adaptive edge-preserving image smoothing filter is utilized to remove insignificant features. The parameters of the filter are adjusted according to the attention map. Our experimental result shows that, with the preprocessing technique, over half of the bandwidth can be reduced while there is no significant visual effect at the site of remote observer.
Xu
Jian
J
Laboratory for Computational Neuroscience, Department of Neurosurgery, University of Pittsburgh, PA 15260, USA.
Sclabassi
Robert J
RJ
Liu
Qiang
Q
Chaparro
Luis F
LF
Marchessault
Ronald
R
Sun
Mingui
M
D003196:Computer Graphics; D044962:Data Compression / Q000379:methods*; D003626:Data Display; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D021621:Imaging, Three-Dimensional / Q000379:methods*; D012815:Signal Processing, Computer-Assisted; D025321:Surgery, Computer-Assisted / Q000379:methods*; D017216:Telemedicine / Q000379:methods*; D014584:User-Computer Interface; D014741:Video Recording / Q000379:methods*; D014796:Visual Perception / Q000502:physiology*