A Behaviorally-Anchored Rating System to Monitor Treatment Integrity for Community Clinicians Using the Adolescent Community Reinforcement Approach.
This study evaluated a process for training raters to reliably rate clinicians delivering the Adolescent Community Reinforcement Approach (A-CRA) in a national dissemination project. The unique A-CRA coding system uses specific behavioral anchors throughout its 73 procedure components. Five randomly-selected raters each rated "passing" and "not passing" examples of the 19 A-CRA procedures. Ninety-four percent of the final ICCs were at least 'good' (≥.60) and 66.7% were 'excellent' (≥.75), and 95% of the ratings exceeded the 60% or better agreement threshold between raters and the gold standard. Raters can be trained to provide reliable A-CRA feedback for large-scale dissemination projects.
Department of Psychology, University of New Mexico, Albuquerque, NM.
Jane Ellen
JE
Smith
Yale University School of Medicine, Psychiatry, New Haven, CT.
Loren M
LM
Gianini
Chestnut Health Systems, Normal, IL.
Bryan R
BR
Garner
Chestnut Health Systems, Normal, IL.
Karen L
KL
Malek
Chestnut Health Systems, Normal, IL.
Susan H
SH
Godley
A-CRA; Evidence-based treatment; coder training; community reinforcement; rater training; treatment adherence