title: Constructing evidence-based treatment strategies using methods from computer science.
abstract: This paper details a new methodology, instance-based reinforcement learning, for constructing adaptive treatment strategies from randomized trials. Adaptive treatment strategies are operationalized clinical guidelines which recommend the next best treatment for an individual based on his/her personal characteristics and response to earlier treatments. The instance-based reinforcement learning methodology comes from the computer science literature, where it was developed to optimize sequences of actions in an evolving, time varying system. When applied in the context of treatment design, this method provides the means to evaluate both the therapeutic and diagnostic effects of treatments in constructing an adaptive treatment strategy. The methodology is illustrated with data from the STAR*D trial, a multi-step randomized study of treatment alternatives for individuals with treatment-resistant major depressive disorder.
authors.affiliation: McGill University, School of Computer Science, Montreal, Que. H3A 2A7, Canada. jpineau@cs.mcgill.ca
authors.forename: Joelle
authors.initials: J
authors.lastname: Pineau
authors.forename: Marc G
authors.initials: MG
authors.lastname: Bellemare
authors.forename: A John
authors.initials: AJ
authors.lastname: Rush
authors.forename: Adrian
authors.initials: A
authors.lastname: Ghizaru
authors.forename: Susan A
authors.initials: SA
authors.lastname: Murphy
mesh_terms: D003201:Computers; D003657:Decision Making; D019317:Evidence-Based Medicine / Q000379:methods*; D006801:Humans; D007858:Learning; D012054:Reinforcement, Psychology; D019966:Substance-Related Disorders / Q000534:rehabilitation*