title: Separation of time-based and trial-based accounts of the partial reinforcement extinction effect.
abstract: Two appetitive conditioning experiments with rats examined time-based and trial-based accounts of the partial reinforcement extinction effect (PREE). In the PREE, the loss of responding that occurs in extinction is slower when the conditioned stimulus (CS) has been paired with a reinforcer on some of its presentations (partially reinforced) instead of every presentation (continuously reinforced). According to a time-based or "time-accumulation" view (e.g., Gallistel and Gibbon, 2000), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger amount of time has accumulated in the CS over trials. In contrast, according to a trial-based view (e.g., Capaldi, 1967), the PREE occurs because the organism has learned in partial reinforcement to expect the reinforcer after a larger number of CS presentations. Experiment 1 used a procedure that equated partially and continuously reinforced groups on their expected times to reinforcement during conditioning. A PREE was still observed. Experiment 2 then used an extinction procedure that allowed time in the CS and the number of trials to accumulate differentially through extinction. The PREE was still evident when responding was examined as a function of expected time units to the reinforcer, but was eliminated when responding was examined as a function of expected trial units to the reinforcer. There was no evidence that the animal responded according to the ratio of time accumulated during the CS in extinction over the time in the CS expected before the reinforcer. The results thus favor a trial-based account over a time-based account of extinction and the PREE. This article is part of a Special Issue entitled: Associative and Temporal Learning.
authors: University of Vermont, United States. Electronic address: mark.bouton@uvm.edu.
authors: Mark E
authors: ME
authors: Bouton
authors: University of Vermont, United States.
authors: Amanda M
authors: AM
authors: Woods
authors: University of Vermont, United States.
authors: Travis P
authors: TP
authors: Todd
mesh_terms: D000818:Animals; D001245:Association Learning / Q000502:physiology*; D003213:Conditioning, Psychological / Q000502:physiology*; D005108:Extinction, Psychological / Q000502:physiology*; D005260:Female; D051381:Rats; D017208:Rats, Wistar; D012055:Reinforcement Schedule; D012054:Reinforcement, Psychology
keywords: Associative models; Extinction; Partial reinforcement extinction effect; Timing models
references: Q J Exp Psychol (Hove). 2006 May;59(5):809-29
references: 16608748
references: Behav Processes. 2012 May;90(1):66-80
references: 22391153
references: J Exp Psychol Anim Behav Process. 2003 Apr;29(2):153-66
references: 12735279
references: J Exp Psychol Anim Behav Process. 2003 Jan;29(1):62-77
references: 12561134
references: Psychol Rev. 1994 Oct;101(4):587-607
references: 7984708
references: J Exp Psychol Anim Behav Process. 2011 Apr;37(2):151-64
references: 21381859
references: J Exp Psychol Anim Behav Process. 2004 Jul;30(3):240-50
references: 15279514
references: J Exp Psychol Anim Behav Process. 2006 Oct;32(4):371-85
references: 17044740
references: Psychol Rev. 2000 Apr;107(2):289-344
references: 10789198
references: Trends Neurosci. 2009 Feb;32(2):73-8
references: 19136158
references: Proc Natl Acad Sci U S A. 2004 Sep 7;101(36):13124-31
references: 15331782
references: Psychon Bull Rev. 1994 Jun;1(2):156-81
references: 24203468
references: Psychol Rev. 1980 Nov;87(6):532-52
references: 7443916
references: Comp Cogn Behav Rev. 2010;5:1-22
references: 21359131
references: Biol Cybern. 1988;58(6):405-15
references: 3395634
references: Learn Behav. 2008 May;36(2):104-15
references: 18543711
references: Learn Behav. 2004 May;32(2):220-9
references: 15281394
references: J Neurosci. 2010 Apr 7;30(14):4990-8
references: 20371819
references: Learn Mem. 2004 Sep-Oct;11(5):485-94
references: 15466298
references: J Exp Psychol Anim Behav Process. 2011 Jan;37(1):79-93
references: 21261415
references: J Exp Psychol Anim Behav Process. 2005 Jul;31(3):319-33
references: 16045386
references: J Exp Psychol Anim Behav Process. 1999 Oct;25(4):433-50
references: 17763570
references: J Exp Psychol Anim Behav Process. 2004 Jul;30(3):163-76
references: 15279508
references: Annu Rev Psychol. 2001;52:111-39
references: 11148301
references: Learn Behav. 2004 Aug;32(3):321-34
references: 15672827
references: Behav Processes. 2006 Feb 28;71(2-3):307-17
references: 16412585
references: J Exp Psychol Anim Behav Process. 2012 Oct;38(4):381-93
references: 22924827
references: J Exp Psychol Anim Behav Process. 1977 Jul;3(3):216-28
references: 881613
references: J Exp Psychol Anim Behav Process. 2008 Jan;34(1):94-105
references: 18248117
references: Q J Exp Psychol B. 2003 Feb;56(1):7-29
references: 12623534
references: Behav Processes. 2010 May;84(1):412-20
references: 20067824