title: The statistics of local motion signals in naturalistic movies.
abstract: Extraction of motion from visual input plays an important role in many visual tasks, such as separation of figure from ground and navigation through space. Several kinds of local motion signals have been distinguished based on mathematical and computational considerations (e.g., motion based on spatiotemporal correlation of luminance, and motion based on spatiotemporal correlation of flicker), but little is known about the prevalence of these different kinds of signals in the real world. To address this question, we first note that different kinds of local motion signals (e.g., Fourier, non-Fourier, and glider) are characterized by second- and higher-order correlations in slanted spatiotemporal regions. The prevalence of local motion signals in natural scenes can thus be estimated by measuring the extent to which each of these correlations are present in space-time patches and whether they are coherent across spatiotemporal scales. We apply this technique to several popular movies. The results show that all three kinds of local motion signals are present in natural movies. While the balance of the different kinds of motion signals varies from segment to segment during the course of each movie, the overall pattern of prevalence of the different kinds of motion and their subtypes, and the correlations between them, is strikingly similar across movies (but is absent from white noise movies). In sum, naturalistic movies contain a diversity of local motion signals that occur with a consistent prevalence and pattern of covariation, indicating a substantial regularity of their high-order spatiotemporal image statistics.
authors.affiliation: Department of Computational Biology and Statistics, Cornell University, Ithaca, NY, USA.
authors.forename: Eyal I
authors.initials: EI
authors.lastname: Nitzany
authors.forename: Jonathan D
authors.initials: JD
authors.lastname: Victor
mesh_terms: D005583:Fourier Analysis; D006801:Humans; D008959:Models, Neurological; D009039:Motion Perception / Q000502:physiology*; D009040:Motion Pictures; D010775:Photic Stimulation / Q000379:methods
keywords: glider motion; local motion signals; non-Fourier motion; spatiotemporal image statistics
references.citation: Vision Res. 1994 Nov;34(22):3057-79
references.pmid: 7975340
references.citation: J Vis. 2010 Mar 25;10(3):9.1-16
references.pmid: 20377286
references.citation: J Opt Soc Am A Opt Image Sci Vis. 2001 Sep;18(9):2331-70
references.pmid: 11551067
references.citation: J Opt Soc Am A. 1985 Feb;2(2):284-99
references.pmid: 3973762
references.citation: Annu Rev Neurosci. 2004;27:649-77
references.pmid: 15217346
references.citation: Proc Natl Acad Sci U S A. 2002 Apr 16;99(8):5661-3
references.pmid: 11960019
references.citation: J Opt Soc Am A. 1991 Feb;8(2):377-85
references.pmid: 2007912
references.citation: Science. 1982 Oct 29;218(4571):486-7
references.pmid: 7123249
references.citation: Percept Psychophys. 1994 Jan;55(1):48-121
references.pmid: 8036093
references.citation: Network. 1999 Nov;10(4):341-50
references.pmid: 10695763
references.citation: Vision Res. 2011 Jul 1;51(13):1431-56
references.pmid: 21324335
references.citation: Perception. 1997;26(12):1539-48
references.pmid: 9616481
references.citation: J Comp Physiol A. 1987 Sep;161(4):533-47
references.pmid: 3681769
references.citation: J Opt Soc Am A. 1985 Feb;2(2):300-21
references.pmid: 3973763
references.citation: Iperception. 2011;2(6):569-76
references.pmid: 23145246
references.citation: J Opt Soc Am A. 1988 Nov;5(11):1986-2007
references.pmid: 3210090
references.citation: Vision Res. 1985;25(5):625-60
references.pmid: 3895725
references.citation: Vis Neurosci. 1990 Oct;5(4):353-69
references.pmid: 2265150
references.citation: J Cogn Neurosci. 2000 Sep;12(5):711-20
references.pmid: 11054914
references.citation: Proc Natl Acad Sci U S A. 2011 Aug 2;108(31):12909-14
references.pmid: 21768376
references.citation: J Neurosci. 1998 May 15;18(10):3816-30
references.pmid: 9570811
references.citation: Proc R Soc Lond B Biol Sci. 1979 Jan 15;203(1153):405-26
references.pmid: 34162
references.citation: J Opt Soc Am A. 1987 Dec;4(12):2379-94
references.pmid: 3430225
references.citation: Proc Biol Sci. 1998 Mar 7;265(1394):359-66
references.pmid: 9523437