title: A perceptual space of local image statistics.
abstract: Local image statistics are important for visual analysis of textures, surfaces, and form. There are many kinds of local statistics, including those that capture luminance distributions, spatial contrast, oriented segments, and corners. While sensitivity to each of these kinds of statistics have been well-studied, much less is known about visual processing when multiple kinds of statistics are relevant, in large part because the dimensionality of the problem is high and different kinds of statistics interact. To approach this problem, we focused on binary images on a square lattice - a reduced set of stimuli which nevertheless taps many kinds of local statistics. In this 10-parameter space, we determined psychophysical thresholds to each kind of statistic (16 observers) and all of their pairwise combinations (4 observers). Sensitivities and isodiscrimination contours were consistent across observers. Isodiscrimination contours were elliptical, implying a quadratic interaction rule, which in turn determined ellipsoidal isodiscrimination surfaces in the full 10-dimensional space, and made predictions for sensitivities to complex combinations of statistics. These predictions, including the prediction of a combination of statistics that was metameric to random, were verified experimentally. Finally, check size had only a mild effect on sensitivities over the range from 2.8 to 14min, but sensitivities to second- and higher-order statistics was substantially lower at 1.4min. In sum, local image statistics form a perceptual space that is highly stereotyped across observers, in which different kinds of statistics interact according to simple rules.
authors.affiliation: Brain and Mind Research Institute, Weill Cornell Medical College, 1300 York Avenue, New York, NY 10065, United States. Electronic address: jdvicto@med.cornell.edu.
authors.forename: Jonathan D
authors.initials: JD
authors.lastname: Victor
authors.affiliation: Brain and Mind Research Institute, Weill Cornell Medical College, 1300 York Avenue, New York, NY 10065, United States.
authors.forename: Daniel J
authors.initials: DJ
authors.lastname: Thengone
authors.affiliation: Brain and Mind Research Institute, Weill Cornell Medical College, 1300 York Avenue, New York, NY 10065, United States.
authors.forename: Syed M
authors.initials: SM
authors.lastname: Rizvi
authors.affiliation: Brain and Mind Research Institute, Weill Cornell Medical College, 1300 York Avenue, New York, NY 10065, United States.
authors.forename: Mary M
authors.initials: MM
authors.lastname: Conte
mesh_terms: D000328:Adult; D001699:Biometry; D015350:Contrast Sensitivity / Q000502:physiology*; D005260:Female; D005556:Form Perception / Q000502:physiology*; D006801:Humans; D008297:Male; D008875:Middle Aged; D010364:Pattern Recognition, Visual / Q000502:physiology*; D013223:Statistics as Topic; D055815:Young Adult
keywords: Intermediate vision; Local features; Metamers; Multipoint correlations; Visual textures