title: Including cognitive biases and distance-based rewards in a connectionist model of complex problem solving.
abstract: We present a cognitive, connectionist-based model of complex problem solving that integrates cognitive biases and distance-based and environmental rewards under a temporal-difference learning mechanism. The model is tested against experimental data obtained in a well-defined and planning-intensive problem. We show that incorporating cognitive biases (symmetry and simplicity) in a temporal-difference learning rule (SARSA) increases model adequacy-the solution space explored by biased models better fits observed human solutions. While learning from explicit rewards alone is intrinsically slow, adding distance-based rewards, a measure of closeness to goal, to the learning rule significantly accelerates learning. Finally, the model correctly predicts that explicit rewards have little impact on problem solvers' ability to discover optimal solutions.
authors.affiliation: Department of Psychology, Université de Montréal, 90 Vincent-d'Indy Avenue, Montreal, Quebec, H2V 2S9, Canada. frederic.dandurand@gmail.com
authors.forename: Frédéric
authors.initials: F
authors.lastname: Dandurand
authors.forename: Thomas R
authors.initials: TR
authors.lastname: Shultz
authors.forename: Arnaud
authors.initials: A
authors.lastname: Rey
mesh_terms: D003071:Cognition / Q000502:physiology; D006801:Humans; D016571:Neural Networks, Computer; D011340:Problem Solving / Q000502:physiology; D012201:Reward