title: Development and evaluation of two instruments for assessing screening, brief intervention, and referral to treatment (SBIRT) competency.
abstract: Screening, brief intervention, and referral to treatment (SBIRT) is shown to be effective in identifying, intervening with, and making appropriate referrals for patients with unhealthy alcohol use. SBIRT training consists of knowledge-based and skill-based components and has increased the use of screening and intervention skills in clinical settings. This article reports on the development and evaluation of 2 SBIRT proficiency checklists for use across institutions to assess SBIRT skills in both simulated and clinical encounters.
  
  
  
  A national panel of 16 experts identified 137 discrete SBIRT skills items for the checklists. From this final list, 2 proficiency checklists were derived: the SBIRT Proficiency Checklist (SPC), composed of 22 questions for videotaped interviews, and the Clinical SBIRT Proficiency Checklist (CSPC), composed of 13 questions for direct clinical observation. An evaluation was conducted to test the reliability of the SPC and to assess the utility of the CSPC.
  
  
  
  Two checklists for assessing SBIRT proficiency were developed by a collaborative workgroup. Fleiss' kappa analyses indicated moderate agreement. In addition, faculty recorded satisfaction with the CSPC for assessing residents on their SBIRT performance during clinical encounters.
  
  
  
  The SPC and the CSPC are practical tools for assessing competence with SBIRT and are easily integrated as standard instruments in a wide range of training settings. Future advancements to the checklists and their evaluation include modification of the SPC rating scale to be consistent with the CSPC, developing a training program for using the checklists, and further testing to improve interrater reliability.
authors.affiliation: a Program Evaluation and Research Unit, University of Pittsburgh School of Pharmacy , Pittsburgh , Pennsylvania , USA.
authors.forename: Janice L
authors.initials: JL
authors.lastname: Pringle
authors.affiliation: b Department of Family Medicine , Mercer University School of Medicine and Navicent Health , Macon , Georgia , USA.
authors.forename: J Paul
authors.initials: JP
authors.lastname: Seale
authors.affiliation: b Department of Family Medicine , Mercer University School of Medicine and Navicent Health , Macon , Georgia , USA.
authors.forename: Sylvia
authors.initials: S
authors.lastname: Shellenberger
authors.affiliation: a Program Evaluation and Research Unit, University of Pittsburgh School of Pharmacy , Pittsburgh , Pennsylvania , USA.
authors.forename: Kim M
authors.initials: KM
authors.lastname: Grasso
authors.affiliation: c Department of Family and Community Medicine , Baylor College of Medicine , Houston , Texas , USA.
authors.forename: Alicia
authors.initials: A
authors.lastname: Kowalchuk
authors.affiliation: c Department of Family and Community Medicine , Baylor College of Medicine , Houston , Texas , USA.
authors.forename: Larry
authors.initials: L
authors.lastname: Laufman
authors.affiliation: c Department of Family and Community Medicine , Baylor College of Medicine , Houston , Texas , USA.
authors.forename: James H
authors.initials: JH
authors.lastname: Bray
authors.affiliation: d RTI International , Durham , North Carolina , USA.
authors.forename: Arnie
authors.initials: A
authors.lastname: Aldridge
mesh_terms: D000328:Adult; D057189:Checklist / Q000295:instrumentation*; D002983:Clinical Competence; D005260:Female; D006801:Humans; D007388:Internal Medicine / Q000379:methods* / Q000592:standards; D008297:Male; D008875:Middle Aged; D011614:Psychotherapy, Brief; D012017:Referral and Consultation; D015203:Reproducibility of Results; D019966:Substance-Related Disorders / Q000175:diagnosis* / Q000628:therapy*
keywords: Assessment; SBIRT; proficiency checklist; substance abuse