title: Model discrimination through adaptive experimentation.
abstract: An ideal experiment is one in which data collection is efficient and the results are maximally informative. This standard can be difficult to achieve because of uncertainties about the consequences of design decisions. We demonstrate the success of a Bayesian adaptive method (adaptive design optimization, ADO) in optimizing design decisions when comparing models of the time course of forgetting. Across a series of testing stages, ADO intelligently adapts the retention interval in order to maximally discriminate power and exponential models. Compared with two different control (non-adaptive) methods, ADO distinguishes the models decisively, with the results unambiguously favoring the power model. Analyses suggest that ADO's success is due in part to its flexibility in adjusting to individual differences. This implementation of ADO serves as an important first step in assessing its applicability and usefulness to psychology.
authors.affiliation: Department of Psychology, The Ohio State University, 1835 Neil Avenue, Columbus, OH 43210, USA. cavagnaro.2@osu.edu
authors.forename: Daniel R
authors.initials: DR
authors.lastname: Cavagnaro
authors.forename: Mark A
authors.initials: MA
authors.lastname: Pitt
authors.forename: Jay I
authors.initials: JI
authors.lastname: Myung
mesh_terms: D001288:Attention; D001499:Bayes Theorem; D003198:Computer Simulation; D003625:Data Collection / Q000706:statistics & numerical data*; D003662:Decision Theory; D006801:Humans; D008962:Models, Theoretical; D012107:Research Design / Q000706:statistics & numerical data*; D012153:Retention, Psychology; D014706:Verbal Learning