Responsive evaluation of competency-based public health preparedness training programs.
OBJECTIVE
To describe how the Michigan Center for Public Health Preparedness (MI-CPHP) responded to the challenge and urgency in delivering competency-based preparedness training and documenting its impact utilizing a responsive evaluation approach.


METHODS
Pretest-posttest evaluation designs were implemented when feasible to document the impact of training activities on knowledge and competency gains. The development of evaluation instruments is described with a focus on being responsive to the specific goals of each training activity. A randomized experimental design was used to examine the effects of taking a pretest for one of the training events.


RESULTS
The analyses noted statistically significant improvements for every comprehensive training event in key content knowledge and self-rated competencies. The impact of taking a pretest revealed a modest, but statistically significant, effect on the self-rated competencies and a nonsignificant effect on the content knowledge scores.


CONCLUSIONS
A summary of the results and their implications is followed by a discussion about taking a responsive approach to evaluating the training activities of the MI-CPHP. The challenge of evaluating the impact of knowledge-focused training activities on the development of performance competencies was also reviewed.
Reischl
Thomas M
TM
University of Michigan School of Public Health, 109 S. Observatory Street, Ann Arbor, MI 48109, USA. reischl@umich.edu
Buss
Amy N
AN
D023482:Bioterrorism; D003162:Competency-Based Education; D004189:Disaster Planning / Q000458:organization & administration*; D040381:Education, Public Health Professional / Q000379:methods*; D004521:Educational Measurement; D006801:Humans; D008824:Michigan