Pq-space based non-photorealistic rendering for augmented reality.
The increasing use of robotic assisted minimally invasive surgery (MIS) provides an ideal environment for using Augmented Reality (AR) for performing image guided surgery. Seamless synthesis of AR depends on a number of factors relating to the way in which virtual objects appear and visually interact with a real environment. Traditional overlaid AR approaches generally suffer from a loss of depth perception. This paper presents a new AR method for robotic assisted MIS, which uses a novel pq-space based non-photorealistic rendering technique for providing see-through vision of the embedded virtual object whilst maintaining salient anatomical details of the exposed anatomical surface. Experimental results with both phantom and in vivo lung lobectomy data demonstrate the visual realism achieved for the proposed method and its accuracy in providing high fidelity AR depth perception.
Institute of Biomedical Engineering, Imperial College, London SW7 2AZ, UK. mirna.lerotic@imperial.ac.uk
Mirna
M
Lerotic
Adrian J
AJ
Chung
George
G
Mylonas
Guang-Zhong
GZ
Yang
D000465:Algorithms; D001185:Artificial Intelligence; D003196:Computer Graphics; D003198:Computer Simulation; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008954:Models, Biological; D010363:Pattern Recognition, Automated / Q000379:methods*; D012371:Robotics / Q000379:methods; D025321:Surgery, Computer-Assisted / Q000379:methods*; D014584:User-Computer Interface