Belief propagation for depth cue fusion in minimally invasive surgery.
In minimally invasive surgery, dense 3D surface reconstruction is important for surgical navigation and integrating pre- and intra-operative data. Despite recent developments in 3D tissue deformation techniques, their general applicability is limited by specific constraints and underlying assumptions. The need for accurate and robust tissue deformation recovery has motivated research into fusing multiple visual cues for depth recovery. In this paper, a Markov Random Field (MRF) based Bayesian belief propagation framework has been proposed for the fusion of different depth cues. By using the underlying MRF structure to ensure spatial continuity in an image, the proposed method offers the possibility of inferring surface depth by fusing the posterior node probabilities in a node's Markov blanket together with the monocular and stereo depth maps. Detailed phantom validation and in vivo results are provided to demonstrate the accuracy, robustness, and practical value of the technique.
Lo
Benny
B
Institute of Biomedical Engineering, Imperial College London, United Kingdom. benny.lo@imperial.ac.uk
Scarzanella
Marco Visentini
MV
Stoyanov
Danail
D
Yang
Guang-Zhong
GZ
D000465:Algorithms; D001185:Artificial Intelligence; D003463:Cues; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods; D019060:Minimally Invasive Surgical Procedures / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique; D025321:Surgery, Computer-Assisted / Q000379:methods*; D014584:User-Computer Interface