title: Development and evaluation of an instrument for assessing brief behavioral change interventions.
abstract: OBJECTIVE
  To develop an observational coding instrument for evaluating the fidelity and quality of brief behavioral change interventions based on the behavioral theories of the 5 A's, Stages of Change and Motivational Interviewing.
  
  
  METHODS
  Content and face validity were assessed prior to an intervention where psychometric properties were evaluated with a prospective cohort of 116 medical students. Properties assessed included the inter-rater reliability of the instrument, internal consistency of the full scale and sub-scales and descriptive statistics of the instrument. Construct validity was assessed based on student's scores.
  
  
  RESULTS
  Inter-rater reliability for the instrument was 0.82 (intraclass correlation). Internal consistency for the full scale was 0.70 (KR20). Internal consistencies for the sub-scales were as follows: MI intervention component (KR20=.7); stage-appropriate MI-based intervention (KR20=.55); MI spirit (KR20=.5); appropriate assessment (KR20=.45) and appropriate assisting (KR20=.56).
  
  
  CONCLUSIONS
  The instrument demonstrated good inter-rater reliability and moderate overall internal consistency when used to assess performing brief behavioral change interventions by medical students.
  
  
  CONCLUSIONS
  This practical instrument can be used with minimal training and demonstrates promising psychometric properties when evaluated with medical students counseling standardized patients. Further testing is required to evaluate its usefulness in clinical settings.
authors.affiliation: University of Virginia, Department of Family Medicine, Charlottesville, VA 22908, USA. sstrayer@virginia.edu
authors.forename: Scott M
authors.initials: SM
authors.lastname: Strayer
authors.forename: James R
authors.initials: JR
authors.lastname: Martindale
authors.forename: Sandra L
authors.initials: SL
authors.lastname: Pelletier
authors.forename: Salehin
authors.initials: S
authors.lastname: Rais
authors.forename: Jon
authors.initials: J
authors.lastname: Powell
authors.forename: John B
authors.initials: JB
authors.lastname: Schorling
mesh_terms: D001521:Behavior Therapy / Q000295:instrumentation* / Q000379:methods; D003376:Counseling; D005260:Female; D015438:Health Behavior; D006801:Humans; D007407:Interviews as Topic; D008297:Male; D009042:Motivation; D015588:Observer Variation; D010817:Physician-Patient Relations; D010865:Pilot Projects; D011320:Primary Health Care; D011594:Psychometrics / Q000295:instrumentation*; D015203:Reproducibility of Results; D013337:Students, Medical; D011795:Surveys and Questionnaires; D055815:Young Adult