title: Comparison of Assertive Community Treatment Fidelity Assessment Methods: Reliability and Validity.
abstract: Assertive community treatment is known for improving consumer outcomes, but is difficult to implement. On-site fidelity measurement can help ensure model adherence, but is costly in large systems. This study compared reliability and validity of three methods of fidelity assessment (on-site, phone-administered, and expert-scored self-report) using a stratified random sample of 32 mental health intensive case management teams from the Department of Veterans Affairs. Overall, phone, and to a lesser extent, expert-scored self-report fidelity assessments compared favorably to on-site methods in inter-rater reliability and concurrent validity. If used appropriately, these alternative protocols hold promise in monitoring large-scale program fidelity with limited resources.
authors.affiliation: HSR&D Center for Health Information and Communication, Richard L. Roudebush VAMC, 1481 W. 10th Street, 11-H, Indianapolis, IN, 46202, USA. alrollin@iupui.edu.|Department of Psychology, Indiana University Purdue University Indianapolis, Indianapolis, USA. alrollin@iupui.edu.
authors.forename: Angela L
authors.initials: AL
authors.lastname: Rollins
authors.affiliation: Department of Psychology, Indiana University Purdue University Indianapolis, Indianapolis, USA. jmcgrew@iupui.edu.
authors.forename: John H
authors.initials: JH
authors.lastname: McGrew
authors.affiliation: HSR&D Center for Health Information and Communication, Richard L. Roudebush VAMC, 1481 W. 10th Street, 11-H, Indianapolis, IN, 46202, USA. mkukla@iupui.edu.|Department of Psychology, Indiana University Purdue University Indianapolis, Indianapolis, USA. mkukla@iupui.edu.
authors.forename: Marina
authors.initials: M
authors.lastname: Kukla
authors.affiliation: HSR&D Center for Health Information and Communication, Richard L. Roudebush VAMC, 1481 W. 10th Street, 11-H, Indianapolis, IN, 46202, USA. abmcguir@iupui.edu.|Department of Psychology, Indiana University Purdue University Indianapolis, Indianapolis, USA. abmcguir@iupui.edu.
authors.forename: Alan B
authors.initials: AB
authors.lastname: McGuire
authors.affiliation: HSR&D Center for Health Information and Communication, Richard L. Roudebush VAMC, 1481 W. 10th Street, 11-H, Indianapolis, IN, 46202, USA. meflanag@iupui.edu.
authors.forename: Mindy E
authors.initials: ME
authors.lastname: Flanagan
authors.affiliation: Office of Mental Health Operations, VA Northeast Program Evaluation Center, West Haven, USA. Marcia.hunt2@va.gov.
authors.forename: Marcia G
authors.initials: MG
authors.lastname: Hunt
authors.affiliation: College of Medicine, Penn State University, University Park, USA. dleslie@phs.psu.edu.
authors.forename: Doug L
authors.initials: DL
authors.lastname: Leslie
authors.affiliation: HSR&D Center for Health Information and Communication, Richard L. Roudebush VAMC, 1481 W. 10th Street, 11-H, Indianapolis, IN, 46202, USA. linda.collins4@va.gov.
authors.forename: Linda A
authors.initials: LA
authors.lastname: Collins
authors.affiliation: School of Social Work, University of Cincinnati, Cincinnati, USA. jennifer.wright-berryman@uc.edu.
authors.forename: Jennifer L
authors.initials: JL
authors.lastname: Wright-Berryman
authors.affiliation: Adult & Child Center, Indianapolis, USA. lhicks@adultandchild.org.
authors.forename: Lia J
authors.initials: LJ
authors.lastname: Hicks
authors.affiliation: Department of Psychology, Indiana University Purdue University Indianapolis, Indianapolis, USA. mpsalyer@iupui.edu.
authors.forename: Michelle P
authors.initials: MP
authors.lastname: Salyers
mesh_terms: D019090:Case Management / Q000592:standards*; D003156:Community Mental Health Services / Q000592:standards*; D003430:Cross-Sectional Studies; D019983:Guideline Adherence; D006801:Humans; D001523:Mental Disorders / Q000534:rehabilitation*; D011785:Quality Assurance, Health Care; D015203:Reproducibility of Results; D057566:Self Report; D013689:Telephone; D014481:United States; D014493:United States Department of Veterans Affairs
keywords: Assertive community treatment; Fidelity; Implementation; Quality measurement