Statistical model of natural stimuli predicts edge-like pooling of spatial frequency channels in V2.
BACKGROUND
It has been shown that the classical receptive fields of simple and complex cells in the primary visual cortex emerge from the statistical properties of natural images by forcing the cell responses to be maximally sparse or independent. We investigate how to learn features beyond the primary visual cortex from the statistical properties of modelled complex-cell outputs. In previous work, we showed that a new model, non-negative sparse coding, led to the emergence of features which code for contours of a given spatial frequency band.


RESULTS
We applied ordinary independent component analysis to modelled outputs of complex cells that span different frequency bands. The analysis led to the emergence of features which pool spatially coherent across-frequency activity in the modelled primary visual cortex. Thus, the statistically optimal way of processing complex-cell outputs abandons separate frequency channels, while preserving and even enhancing orientation tuning and spatial localization. As a technical aside, we found that the non-negativity constraint is not necessary: ordinary independent component analysis produces essentially the same results as our previous work.


CONCLUSIONS
We propose that the pooling that emerges allows the features to code for realistic low-level image features related to step edges. Further, the results prove the viability of statistical modelling of natural images as a framework that produces quantitative predictions of visual processing.
Hyvärinen
Aapo
A
HIIT Basic Research Unit and Dept of Computer Science, University of Helsinki, Finland. ahyvarin@cc.helsinki.fi
Gutmann
Michael
M
Hoyer
Patrik O
PO
D015233:Models, Statistical; D016571:Neural Networks, Computer; D016011:Normal Distribution; D010775:Photic Stimulation / Q000379:methods; D011237:Predictive Value of Tests; D014793:Visual Cortex / Q000502:physiology*
Proc Biol Sci. 1998 Mar 7;265(1394):359-66
9523437
Nature. 1999 Oct 21;401(6755):788-91
10548103
J Vis. 2002;2(4):324-53
12678582
Vision Res. 2004 Feb;44(4):407-21
14659967
Vision Res. 2002 Jun;42(12):1593-605
12074953
Network. 2001 Aug;12(3):331-50
11563533
Vision Res. 2001 Mar;41(6):711-24
11248261
Perception. 1997;26(9):1101-20
9509146
Nat Neurosci. 2001 Aug;4(8):819-25
11477428
Nature. 1996 Jun 13;381(6583):607-9
8637596
Proc Biol Sci. 1998 Dec 7;265(1412):2315-20
9881476
Vision Res. 2002 Apr;42(8):1017-33
11934453
Nat Neurosci. 1998 Jun;1(2):150-4
10195131
J Opt Soc Am A Opt Image Sci Vis. 2001 Jan;18(1):65-77
11152005
J Neurophysiol. 2002 Nov;88(5):2557-74
12424294
Neural Comput. 2003 Mar;15(3):663-91
12620162
J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1237-52
12868630
Network. 2000 Aug;11(3):191-210
11014668
Vision Res. 1997 Dec;37(23):3327-38
9425547
Nat Neurosci. 1999 Mar;2(3):277-82
10195222
Proc Natl Acad Sci U S A. 2001 Feb 13;98(4):1935-40
11172054
J Neurophysiol. 1998 Dec;80(6):2811-23
9862886
J Neurophysiol. 2004 Jun;91(6):2859-73
14749316
IEEE Trans Neural Netw. 1999;10(3):626-34
18252563
Vision Res. 1999 Mar;39(5):887-95
10341942
Neural Comput. 2000 Jul;12(7):1705-20
10935923
Vision Res. 1985;25(3):365-74
3895724