title: Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy.
abstract: The purpose of this small pilot study was three-fold: (a) to begin development of a coding scheme for supervisor and therapist skill acquisition, (b) to preliminarily investigate a pilot train-the-trainer paradigm for skill development, and (c) to evaluate self-reported versus observed indicators of skill mastery in that pilot program. Participants included four supervisor-therapist dyads (N = 8) working with public mental health sector youth. Master trainers taught cognitive-behavioral therapy techniques to supervisors, who in turn trained therapists on these techniques. Supervisor and therapist skill acquisition and supervisor use of teaching strategies were repeatedly assessed through coding of scripted role-plays with a multiple-baseline across participants and behaviors design. The coding system, the Practice Element Train the Trainer - Supervisor/Therapist Versions of the Therapy Process Observational Coding System for Child Psychotherapy, was developed and evaluated though the course of the investigation. The coding scheme demonstrated excellent reliability (ICCs [1,2] = 0.81-0.91) across 168 video recordings. As calculated through within-subject effect sizes, supervisor and therapist participants, respectively, evidenced skill improvements related to teaching and performing therapy techniques. Self-reported indicators of skill mastery were inflated in comparison to observed skill mastery. Findings lend initial support for further developing an evaluative approach for a train-the-trainer effort focused on disseminating evidence-based practices.
authors.affiliation: University of Hawaii at Manoa, 2530 Dole Street, Sakamaki Hall C 400, Honolulu, HI 96822, USA. Electronic address: bradn@hawaii.edu.
authors.forename: Brad J
authors.initials: BJ
authors.lastname: Nakamura
authors.affiliation: University of Hawaii at Manoa, 2530 Dole Street, Sakamaki Hall C 400, Honolulu, HI 96822, USA. Electronic address: amsb@hawaii.edu.
authors.forename: Alexandra
authors.initials: A
authors.lastname: Selbo-Bruns
authors.affiliation: University of Hawaii at Manoa, 2530 Dole Street, Sakamaki Hall C 400, Honolulu, HI 96822, USA. Electronic address: kelsieo@hawaii.edu.
authors.forename: Kelsie
authors.initials: K
authors.lastname: Okamura
authors.affiliation: University of Hawaii at Manoa, 2530 Dole Street, Sakamaki Hall C 400, Honolulu, HI 96822, USA. Electronic address: jpchang@hawaii.edu.
authors.forename: Jaime
authors.initials: J
authors.lastname: Chang
authors.affiliation: Child and Adolescent Mental Health Division, Hawai'i State Department of Health, 3627 Kilauea Avenue, Room 101, Honolulu, HI 96816, USA. Electronic address: Lesley.Slavin@doh.hawaii.gov.
authors.forename: Lesley
authors.initials: L
authors.lastname: Slavin
authors.affiliation: Child and Adolescent Mental Health Division, Hawai'i State Department of Health, 3627 Kilauea Avenue, Room 101, Honolulu, HI 96816, USA. Electronic address: Scott.Shimabukuro@doh.hawaii.gov.
authors.forename: Scott
authors.initials: S
authors.lastname: Shimabukuro
mesh_terms: D000293:Adolescent; D002983:Clinical Competence; D015928:Cognitive Behavioral Therapy / Q000193:education*; D004502:Education, Medical, Continuing / Q000379:methods*; D055317:Evidence-Based Practice; D005260:Female; D006282:Health Personnel / Q000193:education*; D006801:Humans; D008297:Male; D010865:Pilot Projects
keywords: Case-series design; Dissemination; Evidence-based practice; Train-the-trainer