The two errors of using the within-subject standard deviation (WSD) as the standard error of a reliable change index.
In this Journal, Lewis and colleagues introduced a new Reliable Change Index (RCI(WSD)), which incorporated the within-subject standard deviation (WSD) of a repeated measurement design as the standard error. In this note, two opposite errors in using WSD this way are demonstrated. First, being the standard error of measurement of only a single assessment makes WSD too small when practice effects are absent. Then, too many individuals will be designated reliably changed. Second, WSD can grow unlimitedly to the extent that differential practice effects occur. This can even make RCI(WSD) unable to detect any reliable change.
Maassen
Gerard H
GH
Department of Methodology and Statistics, Faculty of Social Sciences, Utrecht University, The Netherlands. g.h.maassen@uu.nl
D003627:Data Interpretation, Statistical; D006801:Humans; D009483:Neuropsychological Tests / Q000706:statistics & numerical data*; D010043:Outcome and Process Assessment, Health Care / Q000706:statistics & numerical data*; D011594:Psychometrics; D015203:Reproducibility of Results