title: A comparison of phone-based and on-site assessment of fidelity for assertive community treatment in Indiana.
abstract: OBJECTIVE
  This study investigated the reliability and validity of a phone-administered fidelity assessment instrument based on the Dartmouth Assertive Community Treatment Scale (DACTS).
  
  
  METHODS
  An experienced rater paired with a research assistant without fidelity assessment experience or a consultant familiar with the treatment site conducted phone-based assessments of 23 teams providing assertive community treatment in Indiana. Using the DACTS, consultants conducted on-site evaluations of the programs.
  
  
  RESULTS
  The pairs of phone raters revealed high levels of consistency [intraclass correlation coefficient (ICC)=.92] and consensus (mean absolute difference of .07). Phone and on-site assessment showed strong agreement (ICC=.87) and consensus (mean absolute difference of .07) and agreed within .1 scale point, or 2% of the scoring range, for 83% of sites and within .15 scale point for 91% of sites. Results were unaffected by the expertise level of the rater.
  
  
  CONCLUSIONS
  Phone-based assessment could help agencies monitor faithful implementation of evidence-based practices.
authors.affiliation: Department of Psychology, Indiana University-Purdue University Indianapolis (IUPUI), Indianapolis, IN 46202, USA. jmcgrew@iupui.edu
authors.forename: John H
authors.initials: JH
authors.lastname: McGrew
authors.forename: Laura G
authors.initials: LG
authors.lastname: Stull
authors.forename: Angela L
authors.initials: AL
authors.lastname: Rollins
authors.forename: Michelle P
authors.initials: MP
authors.lastname: Salyers
authors.forename: Lia J
authors.initials: LJ
authors.lastname: Hicks
mesh_terms: D003156:Community Mental Health Services / Q000379:methods* / Q000592:standards*; D055317:Evidence-Based Practice / Q000379:methods / Q000592:standards; D006302:Health Services Research / Q000379:methods*; D006801:Humans; D007196:Indiana; D015588:Observer Variation; D010043:Outcome and Process Assessment, Health Care / Q000379:methods*; D011785:Quality Assurance, Health Care / Q000379:methods / Q000592:standards; D013689:Telephone