title: Advancing methods for reliably assessing motivational interviewing fidelity using the motivational interviewing skills code.
abstract: The current paper presents novel methods for collecting MISC data and accurately assessing reliability of behavior codes at the level of the utterance. The MISC 2.1 was used to rate MI interviews from five randomized trials targeting alcohol and drug use. Sessions were coded at the utterance-level. Utterance-based coding reliability was estimated using three methods and compared to traditional reliability estimates of session tallies. Session-level reliability was generally higher compared to reliability using utterance-based codes, suggesting that typical methods for MISC reliability may be biased. These novel methods in MI fidelity data collection and reliability assessment provided rich data for therapist feedback and further analyses. Beyond implications for fidelity coding, utterance-level coding schemes may elucidate important elements in the counselor-client interaction that could inform theories of change and the practice of MI.
authors.affiliation: Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA. Electronic address: grinlord@uw.edu.
authors.forename: Sarah Peregrine
authors.initials: SP
authors.lastname: Lord
authors.affiliation: Signal Analysis and Interpretation Laboratory, Departments of Electrical Engineering and Computer Science, University of Southern California, Los Angeles, CA, USA.
authors.forename: Doğan
authors.initials: D
authors.lastname: Can
authors.affiliation: Department of Cognitive Sciences, University of California Irvine, Irvine, CA, USA.
authors.forename: Michael
authors.initials: M
authors.lastname: Yi
authors.affiliation: Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA.
authors.forename: Rebeca
authors.initials: R
authors.lastname: Marin
authors.affiliation: Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA.
authors.forename: Christopher W
authors.initials: CW
authors.lastname: Dunn
authors.affiliation: Department of Educational Psychology, University of Utah, Salt Lake City, UT, USA.
authors.forename: Zac E
authors.initials: ZE
authors.lastname: Imel
authors.affiliation: Signal Analysis and Interpretation Laboratory, Departments of Electrical Engineering and Computer Science, University of Southern California, Los Angeles, CA, USA.
authors.forename: Panayiotis
authors.initials: P
authors.lastname: Georgiou
authors.affiliation: Signal Analysis and Interpretation Laboratory, Departments of Electrical Engineering and Computer Science, University of Southern California, Los Angeles, CA, USA.
authors.forename: Shrikanth
authors.initials: S
authors.lastname: Narayanan
authors.affiliation: Department of Cognitive Sciences, University of California Irvine, Irvine, CA, USA.
authors.forename: Mark
authors.initials: M
authors.lastname: Steyvers
authors.affiliation: Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA.
authors.forename: David C
authors.initials: DC
authors.lastname: Atkins
mesh_terms: D006801:Humans; D062405:Motivational Interviewing / Q000592:standards*; D016032:Randomized Controlled Trials as Topic / Q000592:standards*; D015203:Reproducibility of Results; D019966:Substance-Related Disorders / Q000628:therapy
keywords: Fidelity assessment; Inter-rater reliability; MISC; Motivational interviewing