title: Semi-parametric color reproduction method for optical see-through head-mounted displays.
abstract: The fundamental issues in Augmented Reality (AR) are on how to naturally mediate the reality with virtual content as seen by users. In AR applications with Optical See-Through Head-Mounted Displays (OST-HMD), the issues often raise the problem of rendering color on the OST-HMD consistently to input colors. However, due to various display constraints and eye properties, it is still a challenging task to indistinguishably reproduce the colors on OST-HMDs. An approach to solve this problem is to pre-process the input color so that a user perceives the output color on the display to be the same as the input. We propose a color calibration method for OST-HMDs. We start from modeling the physical optics in the rendering and perception process between the HMD and the eye. We treat the color distortion as a semi-parametric model which separates the non-linear color distortion and the linear color shift. We demonstrate that calibrated images regain their original appearance on two OST-HMD setups with both synthetic and real datasets. Furthermore, we analyze the limitations of the proposed method and remaining problems of the color reproduction in OST-HMDs. We then discuss how to realize more practical color reproduction methods for future HMD-eye system.
authors.affiliation: Department of Informatics at Technical University of Munich.
authors.forename: Yuta
authors.initials: Y
authors.lastname: Itoh
authors.affiliation: Department of Informatics at Technical University of Munich.
authors.forename: Maksym
authors.initials: M
authors.lastname: Dzitsiuk
authors.affiliation: Faculty of Systems Engineering at Wakayama University.
authors.forename: Toshiyuki
authors.initials: T
authors.lastname: Amano
authors.affiliation: Department of Informatics at Technical University of Munich.
authors.forename: Gudrun
authors.initials: G
authors.lastname: Klinker
mesh_terms: D000465:Algorithms; D003116:Color; D003196:Computer Graphics; D004867:Equipment Design; D006257:Head / Q000502:physiology; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000295:instrumentation* / Q000379:methods*; D014584:User-Computer Interface; D014741:Video Recording