title: The discovery of novel actions is affected by very brief reinforcement delays and reinforcement modality.
abstract: ABSTRACT The authors investigated the ability of human participants to discover novel actions under conditions of delayed reinforcement. Participants used a joystick to search for a target indicated by visual or auditory reinforcement. Reinforcement delays of 75-150 ms were found to significantly impair action acquisition. They also found an effect of modality, with acquisition superior with auditory feedback. The duration at which delay was found to impede action discovery is, to the authors' knowledge, shorter than that previously reported from work with operant and causal learning paradigms. The sensitivity to delay reported, and the difference between modalities, is consistent with accounts of action discovery that emphasize the importance of a time stamp in the motor record for solving the credit assignment problem.
authors.affiliation: Department of Psychology, University of Sheffield, Western Bank, Sheffield, S10 2TP, England.
authors.forename: Tom
authors.initials: T
authors.lastname: Walton
authors.forename: Martin
authors.initials: M
authors.lastname: Thirkettle
authors.forename: Pete
authors.initials: P
authors.lastname: Redgrave
authors.forename: Kevin N
authors.initials: KN
authors.lastname: Gurney
authors.forename: Tom
authors.initials: T
authors.lastname: Stafford
mesh_terms: D000161:Acoustic Stimulation; D000293:Adolescent; D003216:Conditioning, Operant; D005260:Female; D006801:Humans; D008297:Male; D010775:Photic Stimulation; D011597:Psychomotor Performance; D012054:Reinforcement, Psychology; D013997:Time Factors; D055815:Young Adult