title: Interactions of timing and prediction error learning.
abstract: Timing and prediction error learning have historically been treated as independent processes, but growing evidence has indicated that they are not orthogonal. Timing emerges at the earliest time point when conditioned responses are observed, and temporal variables modulate prediction error learning in both simple conditioning and cue competition paradigms. In addition, prediction errors, through changes in reward magnitude or value alter timing of behavior. Thus, there appears to be a bi-directional interaction between timing and prediction error learning. Modern theories have attempted to integrate the two processes with mixed success. A neurocomputational approach to theory development is espoused, which draws on neurobiological evidence to guide and constrain computational model development. Heuristics for future model development are presented with the goal of sparking new approaches to theory development in the timing and prediction error fields.
authors: Kansas State University, United States. Electronic address: kirkpatr@ksu.edu.
authors: Kimberly
authors: K
authors: Kirkpatrick
mesh_terms: D000818:Animals; D001921:Brain / Q000502:physiology*; D003214:Conditioning, Classical / Q000502:physiology; D006801:Humans; D007858:Learning / Q000502:physiology*; D008959:Models, Neurological; D009042:Motivation; D009434:Neural Pathways / Q000502:physiology; D012201:Reward
keywords: Computational modeling; Motivation; Prediction error learning; Timing
references: J Exp Anal Behav. 2002 Jul;78(1):17-30
references: 12144310
references: Learn Motiv. 2010 May;41(2):108-124
references: 27226650
references: Curr Opin Neurobiol. 2008 Apr;18(2):137-44
references: 18692573
references: J Exp Psychol Anim Behav Process. 2005 Jan;31(1):31-9
references: 15656725
references: Psychol Rev. 2006 Apr;113(2):300-326
references: 16637763
references: Eur J Neurosci. 2009 Nov;30(9):1749-55
references: 19863656
references: Exp Brain Res. 2003 Jan;148(2):238-46
references: 12520413
references: Proc Natl Acad Sci U S A. 2010 Dec 14;107(50):21767-72
references: 21118983
references: Science. 2004 Oct 15;306(5695):503-7
references: 15486304
references: Science. 2003 Aug 22;301(5636):1104-7
references: 12934011
references: Behav Neurosci. 2003 Apr;117(2):202-11
references: 12708516
references: Behav Processes. 1998 Dec;44(2):163-82
references: 24896973
references: Science. 2001 Jun 29;292(5526):2499-501
references: 11375482
references: Nature. 2001 Aug 2;412(6846):546-9
references: 11484055
references: Comp Cogn Behav Rev. 2010;5:1-22
references: 21359131
references: Q J Exp Psychol B. 1982 Feb;34 (Pt 1):19-30
references: 6890222
references: Psychopharmacology (Berl). 2007 Nov;195(1):71-84
references: 17659381
references: J Neurosci. 2001 Nov 15;21(22):9018-26
references: 11698612
references: Nat Neurosci. 2001 Mar;4(3):317-23
references: 11224550
references: Ann N Y Acad Sci. 1984;423:528-41
references: 6588813
references: Behav Processes. 2002 Apr 28;57(2-3):89-106
references: 11947991
references: J Neurophysiol. 1998 Jul;80(1):1-27
references: 9658025
references: Nature. 2006 Jun 15;441(7095):876-9
references: 16778890
references: Science. 2004 Mar 5;303(5663):1506-8
references: 15001776
references: Neuropsychopharmacology. 2005 Apr;30(4):669-82
references: 15688093
references: Behav Processes. 2011 Mar;86(3):359-63
references: 21244854
references: J Exp Psychol Anim Behav Process. 1983 Jul;9(3):307-19
references: 6886633
references: Behav Neurosci. 2003 Aug;117(4):760-73
references: 12931961
references: Behav Neurosci. 2010 Feb;124(1):26-43
references: 20141278
references: Behav Neurosci. 2009 Aug;123(4):720-30
references: 19634929
references: Psychon Bull Rev. 2007 Aug;14(4):543-59
references: 17972717
references: J Neurosci. 1996 Mar 1;16(5):1936-47
references: 8774460
references: J Neurosci. 2004 May 19;24(20):4718-22
references: 15152031
references: Science. 2006 Feb 3;311(5761):596-8
references: 16456050
references: J Exp Psychol Anim Behav Process. 1993 Oct;19(4):327-41
references: 8228832
references: J Cogn Neurosci. 2008 Dec;20(12):2185-97
references: 18457512
references: Neuron. 2003 Apr 24;38(2):317-27
references: 12718864
references: Brain Res Cogn Brain Res. 2004 Oct;21(2):139-70
references: 15464348
references: Behav Processes. 2006 Feb 28;71(2-3):297-306
references: 16406376
references: Prog Neurobiol. 2004 Apr;72(5):341-72
references: 15157726
references: J Exp Psychol Anim Behav Process. 1999 Oct;25(4):433-50
references: 17763570
references: Nat Neurosci. 2007 Dec;10(12):1625-33
references: 17982449
references: Science. 2005 Mar 11;307(5715):1642-5
references: 15761155
references: J Exp Psychol Anim Behav Process. 2004 Jul;30(3):213-28
references: 15279512
references: J Neurosci. 2011 Jun 22;31(25):9238-53
references: 21697374
references: Curr Opin Neurobiol. 2004 Apr;14(2):148-55
references: 15082318
references: Brain Res. 2006 Sep 13;1109(1):93-107
references: 16890210
references: Psychopharmacology (Berl). 2008 Apr;197(2):339-50
references: 18167622
references: Behav Processes. 2010 Jun;84(2):581-90
references: 20219650
references: Brain Res. 2010 Apr 14;1325:89-99
references: 20167208
references: Behav Brain Res. 2010 Dec 1;213(2):135-41
references: 20420859
references: Behav Processes. 2012 May;90(1):142-53
references: 22421220
references: Anim Cogn. 2003 Jun;6(2):113-20
references: 12720110
references: Annu Rev Psychol. 2006;57:87-115
references: 16318590
references: J Exp Anal Behav. 2007 Mar;87(2):201-18
references: 17465312
references: J Neurophysiol. 2008 Jan;99(1):166-86
references: 18003881
references: Curr Opin Neurobiol. 2008 Apr;18(2):145-52
references: 18708142
references: Neuron. 2009 Sep 24;63(6):733-45
references: 19778504
references: Behav Processes. 2006 Feb 28;71(2-3):318-29
references: 16378697
references: Psychol Rev. 2009 Jul;116(3):519-39
references: 19618985
references: Cogn Affect Behav Neurosci. 2009 Dec;9(4):343-64
references: 19897789
references: Psychol Rev. 1997 Apr;104(2):241-65
references: 9127582
references: J Neurosci. 2009 Dec 16;29(50):15727-34
references: 20016088
references: Neuropsychopharmacology. 2011 Jan;36(1):3-25
references: 20668434
references: J Neurosci. 2009 Nov 25;29(47):14803-11
references: 19940175
references: Eur J Neurosci. 2005 Nov;22(10):2605-16
references: 16307603
references: Psychol Rev. 1981 Mar;88(2):135-70
references: 7291377
references: Pavlov J Biol Sci. 1982 Jan-Mar;17(1):16-29
references: 7099730
references: J Exp Psychol Anim Behav Process. 1989 Oct;15(4):295-310
references: 2794867
references: Neuron. 2003 Aug 28;39(5):855-67
references: 12948451
references: J Exp Psychol Anim Behav Process. 1981 Jul;7(3):242-68
references: 7252428
references: Behav Processes. 2010 Oct;85(2):204-6
references: 20600698
references: Curr Opin Neurobiol. 1996 Apr;6(2):228-36
references: 8725965
references: Psychol Rev. 1988 Apr;95(2):274-95
references: 3375401
references: Eur J Neurosci. 2010 Nov;32(10):1735-43
references: 21044174
references: Neuron. 2010 Nov 18;68(4):789-800
references: 21092866
references: Cognition. 1990 Nov;37(1-2):55-81
references: 2269008
references: J Exp Psychol Anim Behav Process. 1998 Jul;24(3):291-315
references: 9679306
references: J Neurosci. 2004 Mar 31;24(13):3295-303
references: 15056709
references: Psychol Rev. 1996 Oct;103(4):720-33
references: 8888652
references: Nature. 2001 Jul 5;412(6842):43-8
references: 11452299
references: Behav Processes. 2013 May;95:90-9
references: 23428705
references: Trends Cogn Sci. 2011 May;15(5):227-39
references: 21497544
references: J Neurosci. 2006 Sep 6;26(36):9196-204
references: 16957076
references: Philos Trans R Soc Lond B Biol Sci. 2007 May 29;362(1481):933-42
references: 17395573
references: Nat Neurosci. 2007 Dec;10(12):1615-24
references: 18026098
references: Psychol Rev. 2000 Apr;107(2):289-344
references: 10789198
references: Neuropsychologia. 2013 Jan;51(2):293-308
references: 22903038
references: J Neurophysiol. 2009 Mar;101(3):1507-23
references: 19164109
references: Trends Neurosci. 2009 Feb;32(2):73-8
references: 19136158
references: Science. 1997 Mar 14;275(5306):1593-9
references: 9054347
references: Neuron. 2005 Jul 7;47(1):129-41
references: 15996553
references: Nat Rev Neurosci. 2002 Jul;3(7):563-73
references: 12094212
references: Nat Rev Neurosci. 2005 Oct;6(10):755-65
references: 16163383
references: Neural Comput. 2008 Dec;20(12):3034-54
references: 18624657
references: Behav Brain Res. 2010 Dec 1;213(2):269-77
references: 20570596
references: Brain Res Cogn Brain Res. 1996 Jun;3(3-4):227-42
references: 8806025
references: J Exp Psychol Anim Behav Process. 2007 Oct;33(4):464-75
references: 17924793
references: J Neurosci. 2001 Jan 15;21(2):682-90
references: 11160447
references: Learn Behav. 2003 Feb;31(1):3-21
references: 18450066
references: Learn Behav. 2012 Sep;40(3):305-19
references: 22927003
references: Neurosci Biobehav Rev. 2010 Apr;34(5):701-20
references: 19944716