title: Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation.
abstract: With the fast development of visual noise-shaping related applications (visual compression, error resilience, watermarking, encryption, and display), there is an increasingly significant demand on incorporating perceptual characteristics into these applications for improved performance. In this paper, a very important mechanism of the human brain, visual attention, is introduced for visual sensitivity and visual quality evaluation. Based upon the analysis, a new numerical measure for visual attention's modulatory aftereffects, perceptual quality significance map (PQSM), is proposed. To a certain extent, the PQSM reflects the processing ability of the human brain on local visual contents statistically. The PQSM is generated with the integration of local perceptual stimuli from color contrast, texture contrast, motion, as well as cognitive features (skin color and face in this study). Experimental results with subjective viewing demonstrate the performance improvement on two PQSM-modulated visual sensitivity models and two PQSM-based visual quality metrics.
authors.affiliation: Institute for Infocomm Research, Agency for Science, Technology, and Research, Singapore. zklu@i2r.a-star.edu.sg
authors.forename: Zhongkang
authors.initials: Z
authors.lastname: Lu
authors.forename: Weisi
authors.initials: W
authors.lastname: Lin
authors.forename: Xiaokang
authors.initials: X
authors.lastname: Yang
authors.forename: EePing
authors.initials: E
authors.lastname: Ong
authors.forename: Susu
authors.initials: S
authors.lastname: Yao
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001288:Attention / Q000502:physiology*; D032701:Biomimetics / Q000379:methods*; D003198:Computer Simulation; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods; D008954:Models, Biological; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D014796:Visual Perception / Q000502:physiology*