Comparison of adaptive psychometric procedures motivated by the theory of optimal experiments: simulated and experimental results.
The wide use of psychometric assessments and the time necessary to conduct comprehensive psychometric tests has motivated significant research into the development of psychometric testing procedures that will provide accurate and efficient estimates of the parameters of interest. One potential framework for developing adaptive psychometric procedures is the Theory of Optimal Experiments. The Theory of Optimal Experiments provides several metrics for determining informative stimulus values based on a model of the psychometric function to be provided by the investigator. In this study, two methods based on a previous implementation of the Theory of Optimal Experiments are presented for comparison to two fixed step size staircase methods and also an existing adaptive method that utilizes a Bayesian framework. The psychometric procedures were used to measure detection thresholds and discrimination limens on two separate psychoacoustic tasks with normal-hearing subjects. Computer simulations were performed based on the outcomes of the experimental psychoacoustic detection task to analyze performance over a large sample size in the case of known truth. Results suggest that the proposed stimulus selection rules motivated by the Theory of Optimal Experiments perform better than previous techniques and also extend estimation to multiple parameters.
Remus
Jeremiah J
JJ
Department of Electrical and Computer Engineering, Duke University, Box 90291, Durham, North Carolina 27708-0291, USA.
Collins
Leslie M
LM
D001499:Bayes Theorem; D003198:Computer Simulation; D006801:Humans; D015233:Models, Statistical; D011594:Psychometrics; D011601:Psychophysics / Q000295:instrumentation