title: Comparing pleasure and pain: the fundamental mathematical equivalence of reward gain and shock reduction under variable interval schedules.
abstract: The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or electric shocks (negative reinforcement VI), there is a fundamental mathematical equivalence between reward gain and shock reduction. We also provide the first normative account of how animals should respond on a negative VI schedule, showing that it is better to space responses evenly than to respond with a variable interresponse time (IRT). Published data from rats, however, indicate that these animals respond irregularly, often with a burst of activity immediately following a shock. While this is irrational in the experimental setting, it may represent an appropriate response to the heterogeneity of stimuli commonly encountered in natural environments. We discuss the broader implications of our analysis for understanding how animals evaluate appetitive and aversive stimuli.
authors.affiliation: Modelling Animal Decisions (MAD) Group, School of Biological Sciences, University of Bristol, England. Dave.Mallpress@bristol.ac.uk
authors.forename: Dave E W
authors.initials: DE
authors.lastname: Mallpress
authors.forename: Tim W
authors.initials: TW
authors.lastname: Fawcett
authors.forename: John M
authors.initials: JM
authors.lastname: McNamara
authors.forename: Alasdair I
authors.initials: AI
authors.lastname: Houston
mesh_terms: D000818:Animals; D001362:Avoidance Learning; D008960:Models, Psychological; D011582:Psychological Theory; D051381:Rats; D012055:Reinforcement Schedule; D012054:Reinforcement, Psychology; D012201:Reward
keywords: law of effect; lever-press; negative reinforcement; optimality; rat; shock reduction; variable interval schedule