title: A physically-based approach to reflection separation: from physical modeling to constrained optimization.
abstract: We propose a physically-based approach to separate reflection using multiple polarized images with a background scene captured behind glass. The input consists of three polarized images, each captured from the same view point but with a different polarizer angle separated by 45 degrees. The output is the high-quality separation of the reflection and background layers from each of the input images. A main technical challenge for this problem is that the mixing coefficient for the reflection and background layers depends on the angle of incidence and the orientation of the plane of incidence, which are spatially varying over the pixels of an image. Exploiting physical properties of polarization for a double-surfaced glass medium, we propose a multiscale scheme which automatically finds the optimal separation of the reflection and background layers. Through experiments, we demonstrate that our approach can generate superior results to those of previous methods.
authors.affiliation: Korea Advanced Institute of Science and Technology, Daejeon.
authors.forename: Naejin
authors.initials: N
authors.lastname: Kong
authors.affiliation: Korea Advanced Institute of Science and Technology, Daejeon.
authors.forename: Yu-Wing
authors.initials: YW
authors.lastname: Tai
authors.affiliation: Korea Advanced Institute of Science and Technology, Daejeon.
authors.forename: Joseph S
authors.initials: JS
authors.lastname: Shin
mesh_terms: D000465:Algorithms; D003198:Computer Simulation; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008962:Models, Theoretical; D010363:Pattern Recognition, Automated / Q000379:methods*; D012031:Refractometry / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique