Selecting treatment strategies with dynamic limited-memory influence diagrams.
OBJECTIVE
The development of dynamic limited-memory influence diagrams as a framework for representing factorized infinite-horizon partially observable Markov decision processes (POMDPs), the introduction of algorithms for their (approximate) solution, and the application to a dynamic decision problem in clinical oncology.


METHODS
A dynamic limited-memory influence diagram for high-grade carcinoid tumor pathophysiology was developed in collaboration with an expert physician. Three algorithms, known as single policy updating, single rule updating, and simulated annealing have been examined for approximating the optimal treatment strategy from a space of 10(19) possible strategies.


RESULTS
Single policy updating proved intractable for finding a treatment strategy for carcinoid tumors. Single rule updating and simulated annealing both found the treatment strategy that is applied by physicians in practice.


CONCLUSIONS
Dynamic limited-memory influence diagrams are a suitable framework for the representation of factorized infinite-horizon POMDPs, and the developed algorithms find acceptable solutions under the assumption of limited memory about past observations. The framework allows for finding reasonable treatment strategies for complex dynamic decision problems in medicine.
van Gerven
Marcel A J
MA
Institute for Computing and Information Sciences, Radboud University Nijmegen, Toernooiveld 1, 6525 ED Nijmegen, The Netherlands. marcelge@cs.ru.nl
Díez
Francisco J
FJ
Taal
Babs G
BG
Lucas
Peter J F
PJ
D000465:Algorithms; D002276:Carcinoid Tumor / Q000473:pathology / Q000628:therapy; D003661:Decision Support Techniques; D008390:Markov Chains; D019057:Quality-Adjusted Life Years; D013269:Stochastic Processes