title: Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees.
abstract: When planning a series of actions, it is usually infeasible to consider all potential future sequences; instead, one must prune the decision tree. Provably optimal pruning is, however, still computationally ruinous and the specific approximations humans employ remain unknown. We designed a new sequential reinforcement-based task and showed that human subjects adopted a simple pruning strategy: during mental evaluation of a sequence of choices, they curtailed any further evaluation of a sequence as soon as they encountered a large loss. This pruning strategy was Pavlovian: it was reflexively evoked by large losses and persisted even when overwhelmingly counterproductive. It was also evident above and beyond loss aversion. We found that the tendency towards Pavlovian pruning was selectively predicted by the degree to which subjects exhibited sub-clinical mood disturbance, in accordance with theories that ascribe Pavlovian behavioural inhibition, via serotonin, a role in mood disorders. We conclude that Pavlovian behavioural inhibition shapes highly flexible, goal-directed choices in a manner that may be important for theories of decision-making in mood disorders.
authors.affiliation: Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom. qhuys@cantab.net
authors.forename: Quentin J M
authors.initials: QJ
authors.lastname: Huys
authors.forename: Neir
authors.initials: N
authors.lastname: Eshel
authors.forename: Elizabeth
authors.initials: E
authors.lastname: O'Nions
authors.forename: Luke
authors.initials: L
authors.lastname: Sheridan
authors.forename: Peter
authors.initials: P
authors.lastname: Dayan
authors.forename: Jonathan P
authors.initials: JP
authors.lastname: Roiser
mesh_terms: D000465:Algorithms; D003198:Computer Simulation; D003657:Decision Making / Q000502:physiology*; D006040:Goals; D006801:Humans; D008959:Models, Neurological; D012054:Reinforcement, Psychology; D013647:Task Performance and Analysis