title: Deformation-specific and deformation-invariant visual object recognition: pose vs. identity recognition of people and deforming objects.
abstract: When we see a human sitting down, standing up, or walking, we can recognize one of these poses independently of the individual, or we can recognize the individual person, independently of the pose. The same issues arise for deforming objects. For example, if we see a flag deformed by the wind, either blowing out or hanging languidly, we can usually recognize the flag, independently of its deformation; or we can recognize the deformation independently of the identity of the flag. We hypothesize that these types of recognition can be implemented by the primate visual system using temporo-spatial continuity as objects transform as a learning principle. In particular, we hypothesize that pose or deformation can be learned under conditions in which large numbers of different people are successively seen in the same pose, or objects in the same deformation. We also hypothesize that person-specific representations that are independent of pose, and object-specific representations that are independent of deformation and view, could be built, when individual people or objects are observed successively transforming from one pose or deformation and view to another. These hypotheses were tested in a simulation of the ventral visual system, VisNet, that uses temporal continuity, implemented in a synaptic learning rule with a short-term memory trace of previous neuronal activity, to learn invariant representations. It was found that depending on the statistics of the visual input, either pose-specific or deformation-specific representations could be built that were invariant with respect to individual and view; or that identity-specific representations could be built that were invariant with respect to pose or deformation and view. We propose that this is how pose-specific and pose-invariant, and deformation-specific and deformation-invariant, perceptual representations are built in the brain.
authors.affiliation: Department of Computer Science, University of Warwick Coventry, UK.
authors.forename: Tristan J
authors.initials: TJ
authors.lastname: Webb
authors.affiliation: Department of Computer Science, University of Warwick Coventry, UK ; Oxford Centre for Computational Neuroscience Oxford, UK.
authors.forename: Edmund T
authors.initials: ET
authors.lastname: Rolls
keywords: VisNet; deformation; inferior temporal visual cortex; invariance; object recognition; pose; trace learning rule
references.citation: Vision Res. 2006 Nov;46(23):3994-4006
references.pmid: 16996556
references.citation: Exp Brain Res. 1991;86(1):159-73
references.pmid: 1756786
references.citation: Nature. 1988 Oct 27;335(6193):817-20
references.pmid: 3185711
references.citation: Neural Comput. 2002 Nov;14(11):2585-96
references.pmid: 12433291
references.citation: Proc Biol Sci. 1994 Jul 22;257(1348):9-15
references.pmid: 8090795
references.citation: Science. 2008 Sep 12;321(5895):1502-7
references.pmid: 18787171
references.citation: Biol Cybern. 1980;36(4):193-202
references.pmid: 7370364
references.citation: Neural Comput. 2007 Jan;19(1):139-69
references.pmid: 17134320
references.citation: Neural Comput. 1991 Summer;3(2):194-200
references.pmid: 31167302
references.citation: Proc R Soc Lond B Biol Sci. 1987 Jul 22;231(1263):251-88
references.pmid: 2889214
references.citation: Network. 2007 Jun;18(2):161-87
references.pmid: 17966074
references.citation: Kybernetik. 1973 Dec 31;14(2):85-100
references.pmid: 4786750
references.citation: Neural Netw. 2000 Apr;13(3):305-15
references.pmid: 10937964
references.citation: PLoS Comput Biol. 2007 Aug;3(8):e166
references.pmid: 17784780
references.citation: Proc R Soc Lond B Biol Sci. 1985 Jan 22;223(1232):293-317
references.pmid: 2858100
references.citation: Nat Neurosci. 2000 Nov;3 Suppl:1199-204
references.pmid: 11127838
references.citation: Exp Brain Res. 1989;75(2):417-29
references.pmid: 2721619
references.citation: Brain Res. 1985 Sep 2;342(1):91-102
references.pmid: 4041820
references.citation: Exp Brain Res. 2010 Jul;204(2):255-70
references.pmid: 20544186
references.citation: J Physiol. 1995 Jan 15;482 ( Pt 2):325-52
references.pmid: 7536248
references.citation: Neural Comput. 2000 Nov;12(11):2547-72
references.pmid: 11110127
references.citation: J Math Biol. 1982;15(3):267-73
references.pmid: 7153672
references.citation: Exp Brain Res. 1997 Mar;114(1):149-62
references.pmid: 9125461
references.citation: Biol Cybern. 2002 Jan;86(1):59-71
references.pmid: 11924570
references.citation: Cereb Cortex. 1998 Sep;8(6):510-23
references.pmid: 9758214
references.citation: Neuron. 1990 Sep;5(3):247-53
references.pmid: 1976014
references.citation: Neural Netw. 2008 Sep;21(7):888-903
references.pmid: 18440774
references.citation: Vision Res. 1985;25(8):1021-35
references.pmid: 4071982
references.citation: J Neurosci. 1987 Feb;7(2):330-42
references.pmid: 3819816
references.citation: Science. 1992 Jan 24;255(5043):419-23
references.pmid: 1734518
references.citation: Vision Res. 1987;27(3):311-26
references.pmid: 3660594
references.citation: Neuron. 2010 Sep 23;67(6):1062-75
references.pmid: 20869601
references.citation: Behav Brain Res. 1989 Apr 1;32(3):203-18
references.pmid: 2713076
references.citation: Neural Comput. 2002 Apr;14(4):715-70
references.pmid: 11936959
references.citation: Prog Neurobiol. 2011 Nov;95(3):448-90
references.pmid: 21907758
references.citation: J Neurosci. 2012 May 9;32(19):6611-20
references.pmid: 22573683
references.citation: Vision Res. 2004 Mar;44(6):621-42
references.pmid: 14693189
references.citation: J Comput Neurosci. 1997 Nov;4(4):309-33
references.pmid: 9427118
references.citation: Cereb Cortex. 1991 May-Jun;1(3):199-220
references.pmid: 1822733
references.citation: Neuron. 2000 Aug;27(2):205-18
references.pmid: 10985342
references.citation: Psychol Rev. 1992 Jul;99(3):480-517
references.pmid: 1502274
references.citation: IEEE Trans Pattern Anal Mach Intell. 2007 Mar;29(3):411-26
references.pmid: 17224612
references.citation: Network. 2001 May;12(2):111-29
references.pmid: 11405418
references.citation: Cereb Cortex. 1996 May-Jun;6(3):498-505
references.pmid: 8670675
references.citation: Neuropsychologia. 2007 Jan 7;45(1):124-43
references.pmid: 16797609
references.citation: Biol Cybern. 2006 Feb;94(2):128-42
references.pmid: 16369795
references.citation: Prog Brain Res. 2006;154:135-48
references.pmid: 17010707
references.citation: Eur J Neurosci. 2008 Jun;27(11):2783-802
references.pmid: 18588525
references.citation: Psychol Rev. 1981 Mar;88(2):135-70
references.pmid: 7291377
references.citation: Science. 1981 Jun 19;212(4501):1409-11
references.pmid: 7233231
references.citation: PLoS Biol. 2006 May;4(5):e120
references.pmid: 16605306
references.citation: Exp Brain Res. 1986;65(1):38-48
references.pmid: 3803509
references.citation: J Neurophysiol. 1994 Sep;72(3):1049-60
references.pmid: 7807195
references.citation: Neural Comput. 2003 Sep;15(9):2147-77
references.pmid: 12959670
references.citation: J Physiol Paris. 2006 Jul-Sep;100(1-3):43-62
references.pmid: 17071062
references.citation: Behav Brain Res. 1995 Jan 23;66(1-2):177-85
references.pmid: 7755888
references.citation: Network. 1999 Nov;10(4):325-40
references.pmid: 10695762
references.citation: Front Comput Neurosci. 2012 Jun 19;6:35
references.pmid: 22723777
references.citation: Prog Neurobiol. 1997 Feb;51(2):167-94
references.pmid: 9247963
references.citation: Philos Trans R Soc Lond B Biol Sci. 1992 Jan 29;335(1273):11-20; discussion 20-1
references.pmid: 1348130
references.citation: Biol Cybern. 2007 Jun;96(6):547-60
references.pmid: 17410377
references.citation: Front Comput Neurosci. 2012 Jun 25;6:37
references.pmid: 22754523
references.citation: J Neurosci. 2003 Jan 1;23(1):339-48
references.pmid: 12514233
references.citation: Front Psychol. 2013 Aug 15;4:497
references.pmid: 23966963