Dynamic Treatment Regimes.
A dynamic treatment regime consists of a sequence of decision rules, one per stage of intervention, that dictate how to individualize treatments to patients based on evolving treatment and covariate history. These regimes are particularly useful for managing chronic disorders, and fit well into the larger paradigm ofpersonalized medicine. They provide one way to operationalize aclinical decision support system. Statistics plays a key role in the construction ofevidence-baseddynamic treatment regimes - informing best study design as well as efficient estimation and valid inference. Due to the many novel methodological challenges it offers, this area has been growing in popularity among statisticians in recent years. In this article, we review the key developments in this exciting field of research. In particular, we discuss the sequential multiple assignment randomized trial designs, estimation techniques like Q-learning and marginal structural models, and several inference techniques designed to address the associated non-standard asymptotics. We reference software, whenever available. We also outline some important future directions.
Department of Biostatistics, Columbia University, New York, USA, 10032.
Bibhas
B
Chakraborty
Department of Statistics and Institute for Social Research, University of Michigan, Ann Arbor, USA, 48109.
Susan A
SA
Murphy
Q-learning; dynamic treatment regime; non-regularity; reinforcement learning; sequential randomization