title: Assessing clinical significance: does it matter which method we use?
abstract: Measures of clinical significance are frequently used to evaluate client change during therapy. Several alternatives to the original method devised by N. S. Jacobson, W. C. Follette, & D. Revenstorf (1984) have been proposed, each purporting to increase accuracy. However, researchers have had little systematic guidance in choosing among alternatives. In this simulation study, the authors systematically explored data parameters (e.g., reliability of measurement, pre-post effect size, and pre-post correlation) that might yield differing results among the most widely considered clinical significance methods. Results indicated that classification across methods was far more similar than different, especially at greater levels of reliability. As such, the existing methods of clinical significance appear highly comparable; future directions for clinical significance use and research are discussed.
authors.affiliation: Travis Research Institute, Fuller Graduate School of Psychology, Pasadena, CA 91101, USA. datkins@fuller.edu
authors.forename: David C
authors.initials: DC
authors.lastname: Atkins
authors.forename: Jamie D
authors.initials: JD
authors.lastname: Bedics
authors.forename: Joseph B
authors.initials: JB
authors.lastname: McGlinchey
authors.forename: Theodore P
authors.initials: TP
authors.lastname: Beauchaine
mesh_terms: D003627:Data Interpretation, Statistical; D006801:Humans; D008960:Models, Psychological; D017063:Outcome Assessment, Health Care / Q000379:methods* / Q000706:statistics & numerical data; D011594:Psychometrics / Q000379:methods*; D011613:Psychotherapy; D015203:Reproducibility of Results; D016896:Treatment Outcome