Patient-specific bronchoscopy visualization through BRDF estimation and disocclusion correction.
This paper presents an image-based method for virtual bronchoscope with photo-realistic rendering. The technique is based on recovering bidirectional reflectance distribution function (BRDF) parameters in an environment where the choice of viewing positions, directions, and illumination conditions are restricted. Video images of bronchoscopy examinations are combined with patient-specific three-dimensional (3-D) computed tomography data through two-dimensional (2-D)/3-D registration and shading model parameters are then recovered by exploiting the restricted lighting configurations imposed by the bronchoscope. With the proposed technique, the recovered BRDF is used to predict the expected shading intensity, allowing a texture map independent of lighting conditions to be extracted from each video frame. To correct for disocclusion artefacts, statistical texture synthesis was used to recreate the missing areas. New views not present in the original bronchoscopy video are rendered by evaluating the BRDF with different viewing and illumination parameters. This allows free navigation of the acquired 3-D model with enhanced photo-realism. To assess the practical value of the proposed technique, a detailed visual scoring that involves both real and rendered bronchoscope images is conducted.
Chung
Adrian J
AJ
Royal Society/Wolfson Foundation Medical Image Computing Laboratory, Department of Computing, Imperial College London, London SW7 2BZ, UK.
Deligianni
Fani
F
Shah
Pallav
P
Wells
Athol
A
Yang
Guang-Zhong
GZ
D000465:Algorithms; D016477:Artifacts; D001185:Artificial Intelligence; D001999:Bronchoscopy / Q000379:methods*; D003198:Computer Simulation; D006801:Humans; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods; D008954:Models, Biological; D010363:Pattern Recognition, Automated / Q000379:methods; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique; D014057:Tomography, X-Ray Computed / Q000379:methods*; D014584:User-Computer Interface