title: A formative multi-method approach to evaluating training.
abstract: This article describes how we used a formative multi-method evaluation approach to gather real-time information about the processes of a complex, multi-day training with 24 community coalitions in the United States. The evaluation team used seven distinct, evaluation strategies to obtain evaluation data from the first Community Health Improvement Leadership Academy (CHILA) within a three-prong framework (inquiry, observation, and reflection). These methods included: comprehensive survey, rapid feedback form, learning wall, observational form, team debrief, social network analysis and critical moments reflection. The seven distinct methods allowed for both real time quality improvement during the CHILA and long term planning for the next CHILA. The methods also gave a comprehensive picture of the CHILA, which when synthesized allowed the evaluation team to assess the effectiveness of a training designed to tap into natural community strengths and accelerate health improvement. We hope that these formative evaluation methods can continue to be refined and used by others to evaluate training.
authors.affiliation: University of South Carolina, 915 Green Street, Suite 506, Columbia, SC 29208, United States. Electronic address: hayeshg@mailbox.sc.edu.
authors.forename: Holly
authors.initials: H
authors.lastname: Hayes
authors.affiliation: University of North Carolina at Charlotte, 9201 University City Blvd, Charlotte, NC 28223, United States. Electronic address: victoria.chien@gmail.com.
authors.forename: Victoria
authors.initials: V
authors.lastname: Scott
authors.affiliation: University of South Carolina, Department of Psychology, 1512 Pendleton Street, Columbia, SC 29208, United States. Electronic address: michelle.abraczinskas@gmail.com.
authors.forename: Michelle
authors.initials: M
authors.lastname: Abraczinskas
authors.affiliation: Institute for Healthcare Improvement, 20 University Road, Cambridge, MA 02138, United States. Electronic address: jonathan.p.scaccia@gmail.com.
authors.forename: Jonathan
authors.initials: J
authors.lastname: Scaccia
authors.affiliation: Institute for Healthcare Improvement, 20 University Road, Cambridge, MA 02138, United States. Electronic address: sstout@IHI.org.
authors.forename: Soma
authors.initials: S
authors.lastname: Stout
authors.affiliation: University of South Carolina, Department of Psychology, 1512 Pendleton Street, Columbia, SC 29208, United States. Electronic address: WANDERAH@mailbox.sc.edu.
authors.forename: Abraham
authors.initials: A
authors.lastname: Wandersman
mesh_terms: D003256:Community Participation / Q000379:methods*; D006304:Health Status; D006801:Humans; D007318:Inservice Training / Q000379:methods*; D007857:Leadership; D015397:Program Evaluation / Q000379:methods*; D013997:Time Factors; D014481:United States