title: Methods for Quantifying the Clinical Significance of Change During Intervention Program Participation.
abstract: Assessing the practical or clinical significance (CS) of an intervention program's outcomes is useful in determining its effectiveness. The CS approach gives information beyond traditional analyses by quantifying the proportions of people who meaningfully improve and deteriorate. We link latent transition analyses (LTA) to the CS literature and use a case study to contrast it with the long-standing Jacobson and Truax (JT) approach. Data came from 2,717 individuals convicted of a substance-related offense who participated in an indicated prevention program Prime For Life®(PFL). We selected outcomes describing drinking beliefs and behavior. Both CS approaches categorized a majority of participants as improved (i.e., transitioning from baseline subgroups with risky behaviors and cognitions into posttest subgroups showing lower risk). Results demonstrate how the JT approach allows the assessment of improvements on individual outcomes, while the LTA provides more nuanced information about risk groupings. Selecting a CS approach depends on research goals, availability of normative data, and data considerations. JT is an appropriate method when evaluating single outcomes. In contrast, LTA is better when a multivariate description is desired, advanced missing data handling methods are needed, or outcomes are not normally distributed. Although infrequently done, evaluating CS provides useful information about program effectiveness.
authors.affiliation: Prevention Research Institute, Lexington, KY, USA blair.beadnell@primeforlife.org.
authors.forename: Blair
authors.initials: B
authors.lastname: Beadnell
authors.affiliation: Prevention Research Institute, Lexington, KY, USA.
authors.forename: Pamela A
authors.initials: PA
authors.lastname: Stafford
authors.affiliation: University of Maryland, Baltimore County, Baltimore, MD, USA.
authors.forename: Michele A
authors.initials: MA
authors.lastname: Crisafulli
authors.affiliation: University of Washington Tacoma, Tacoma, WA, USA.
authors.forename: Erin A
authors.initials: EA
authors.lastname: Casey
authors.affiliation: Prevention Research Institute, Lexington, KY, USA.
authors.forename: David B
authors.initials: DB
authors.lastname: Rosengren
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D000437:Alcoholism / Q000523:psychology / Q000628:therapy; D005260:Female; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D008297:Male; D008875:Middle Aged; D015397:Program Evaluation / Q000379:methods*; D012107:Research Design; D012189:Retrospective Studies; D012309:Risk-Taking; D019966:Substance-Related Disorders / Q000523:psychology* / Q000628:therapy*; D014481:United States; D055815:Young Adult
keywords: clinical significance; impaired driving; practical significance; prevention; substance abuse