title: Computer Assessment of Simulated Patient Interviews (CASPI): psychometric properties of a web-based system for the assessment of motivational interviewing skills.
abstract: OBJECTIVE
  Benefits of empirically supported interventions hinge on clinician skill, particularly for motivational interviewing (MI). Existing MI skill assessments are limited with respect to validity (e.g., self-report) and practicality (e.g., coding session tapes). To address these limitations, we developed and evaluated two versions of a web-based assessment of MI skills, the Computer Assessment of Simulated Patient Interviews (CASPI).
  
  
  METHODS
  Ninety-six counselors from the community and 24 members of the Motivational Interviewing Network of Trainers (MINT) completed the CASPI (N = 120), in which they verbally responded via microphones to video clips comprising three 9-item vignettes. Three coders used an emergent coding scheme, which was compared with alternative MI skills measures.
  
  
  RESULTS
  CASPI demonstrated excellent internal consistency when averaging across two or three vignettes (α's = .86-.89). Intraclass correlations were above .40 for most items. Confirmatory factor analyses supported a correlated three-factor model: MI-consistent, resistance-engendering, and global change talk orientation rating. Means and factor loadings were invariant across forms (i.e., the two alternative versions of CASPI), and factor loadings were invariant across subgroup (i.e., community counselor or MINT member). Test-retest reliability was good for MI-consistent and resistance-engendering scores (r = .74 and .80, respectively) but low for change talk orientation (r = .29) unless coder was taken into account (r = .69). CASPI showed excellent construct and criterion-related validity.
  
  
  CONCLUSIONS
  CASPI represents a promising method of assessing MI skills. Future studies are needed to establish its performance in real-world contexts.
authors.affiliation: Department of Psychology, University of Washington, Seattle, Washington, USA. jsbaer@uw.edu
authors.forename: John S
authors.initials: JS
authors.lastname: Baer
authors.forename: Kelly M
authors.initials: KM
authors.lastname: Carpenter
authors.forename: Blair
authors.initials: B
authors.lastname: Beadnell
authors.forename: Susan A
authors.initials: SA
authors.lastname: Stoner
authors.forename: Michelle Hansten
authors.initials: MH
authors.lastname: Ingalsbe
authors.forename: Bryan
authors.initials: B
authors.lastname: Hartzler
authors.forename: David B
authors.initials: DB
authors.lastname: Rosengren
authors.forename: Zach
authors.initials: Z
authors.lastname: Drager
mesh_terms: D000328:Adult; D003198:Computer Simulation / Q000592:standards*; D005260:Female; D005500:Follow-Up Studies; D006801:Humans; D020407:Internet / Q000592:standards*; D007406:Interview, Psychological / Q000379:methods / Q000592:standards*; D008297:Male; D008875:Middle Aged; D009042:Motivation; D005791:Patient Care / Q000379:methods / Q000592:standards; D010865:Pilot Projects; D011361:Professional Competence / Q000592:standards*; D011594:Psychometrics; D011795:Surveys and Questionnaires / Q000592:standards