The Alcohol Intervention Mechanisms Scale (AIMS): Preliminary Reliability and Validity of a Common Factor Observational Rating Measure.
The present work provides an overview, and pilot reliability and validity for the Alcohol Intervention Mechanisms Scale (AIMS). The AIMS measures therapist interventions that occur broadly across modalities of behavioral treatment for alcohol use disorder. It was developed based on identified commonalities in the function rather than content of therapist interventions in observed therapy sessions, as well as from existing observer rating systems. In the AIMS, the primary function areas are: explore (four behavior count codes), teach (five behavior count codes), and connect (three behavior count codes). Therapist behavior counts provide a frequency rating of occurrence (i.e., adherence). The three functions (explore, teach, connect) are then rated on global skillfulness, which provides a quality valence (i.e., competence) to the entire session. In the present study, three independent raters received roughly 30 hours of training on the use of the AIMS by the first author. Data were a sample of therapy session audio files from a Project MATCH clinical research site. Reliability results showed generally good performance for the measure. Specifically, 2-way mixed intraclass coefficients were 'excellent', ranging from .94 to .99 for function summary scores, while prevalence-adjusted, bias-adjusted kappa for global skillfulness measures were in the 'fair' to 'moderate' range (k=.36 to.40). Internal consistency reliability was acceptable, as were preliminary factor models by behavioral treatment function (i.e., explore, teach, connect). However, confirmatory fit for the subsequent three factor model was poor. In concurrent validity analyses, AIMS summary and skillfulness scores showed associations with relevant Project MATCH criterion measures (i.e., MATCH Tape Rating Scale) that were consistent with expectations. The AIMS is a promising and reliable observational measure of three proposed common functions of behavioral alcohol treatment.
Center for Alcohol and Addiction Studies, Brown University, Providence, RI, USA. Electronic address: molly_magill@brown.edu.
M
M
Magill
Children's Mercy Kansas City, USA; University of Missouri-Kansas City School of Medicine, USA.
Timothy R
TR
Apodaca
Center for Alcohol and Addiction Studies, Brown University, Providence, RI, USA.
Justin
J
Walthers
Center for Alcohol and Addiction Studies, Brown University, Providence, RI, USA; Lausanne University Hospital, Lausanne, Switzerland.
Jacques
J
Gaume
Center for Alcohol and Addiction Studies, Brown University, Providence, RI, USA.
Ayla
A
Durst
Center for Alcohol and Addiction Studies, Brown University, Providence, RI, USA.
Richard
R
Longabaugh
Center for Alcohol and Addiction Studies, Brown University, Providence, RI, USA; Pacific Institute for Research and Evaluation, Providence, RI, USA.
Robert L
RL
Stout
Yale University School of Medicine, New Haven, CT, USA.
Kathleen M
KM
Carroll
D019973:Alcohol-Related Disorders / Q000628:therapy*; D001521:Behavior Therapy / Q000379:methods*; D006801:Humans; D010865:Pilot Projects; D017410:Practice Guidelines as Topic; D017064:Process Assessment, Health Care; D011594:Psychometrics / Q000295:instrumentation*; D015203:Reproducibility of Results
Alcohol; Common factors; Process research; Project MATCH; Psychometrics
Addiction. 2012 Aug;107(8):1431-40
22340523
JAMA. 2006 May 3;295(17):2003-17
16670409
J Consult Clin Psychol. 2003 Feb;71(1):118-28
12602432
Psychotherapy (Chic). 2014 Dec;51(4):467-81
24377408
Alcohol Alcohol. 2008 Nov-Dec;43(6):675-82
18818190
Biometrics. 1977 Jun;33(2):363-74
884196
J Consult Clin Psychol. 2014 Dec;82(6):973-83
24841862
Annu Rev Clin Psychol. 2007;3:1-27
17716046
J Consult Clin Psychol. 2005 Dec;73(6):1015-25
16392975
Psychol Addict Behav. 2014 Dec;28(4):1077-88
25528049
Addiction. 2007 Sep;102(9):1377-89
17610541
J Psychother Pract Res. 1997 Winter;6(1):12-24
9058557
Psychol Bull. 1990 Mar;107(2):238-46
2320703
Psychol Addict Behav. 2008 Dec;22(4):533-43
19071978
Subst Abus. 2013;34(1):20-32
23327501
Addiction. 2010 Dec;105(12):2120-7
20854334
Tutor Quant Methods Psychol. 2012;8(1):23-34
22833776
Psychotherapy (Chic). 2014 Dec;51(4):510-3
25111379
J Subst Abuse Treat. 2016 Apr;63:10-7
26898715
Addiction. 2008 Feb;103(2):228-38
18070238
Addiction. 2009 May;104(5):705-15
19413785
Curr Psychiatry Rep. 2011 Oct;13(5):382-9
21750958
J Consult Clin Psychol. 1998 Apr;66(2):290-303
9583332
Addiction. 2000 Oct;95(10):1475-90
11070524
Drug Alcohol Depend. 2000 Jan 1;57(3):225-38
10661673
Alcohol Clin Exp Res. 2007 Oct;31(10 Suppl):40s-47s
17880345
J Clin Epidemiol. 1990;43(6):543-9
2348207
J Stud Alcohol. 1997 Jan;58(1):7-29
8979210
Psychol Addict Behav. 2010 Dec;24(4):600-7
21038931
J Consult Clin Psychol. 2014 Dec;82(6):1219-27
25090041
Addiction. 1997 Dec;92(12):1671-98
9581001
Addiction. 2007 Aug;102(8):1280-91
17624978
Addiction. 2016 Jun;111(6):1011-20
26780564