title: The use of trained observers as an evaluation tool for a multi-hospital bioterrorism exercise.
abstract: BACKGROUND
  Evidence suggests that regular disaster exercises have beneficial effects on subsequent mock and actual disaster responses. The purpose of this report is to describe a multiple hospital, bioterrorism exercise, evaluated by independent observers who used an evaluation template.
  
  
  METHODS
  The overall tabletop exercise design included participation from 23 Joint Commission Accreditation of Healthcare Organizations hospitals, four health departments, and a representative from one federal agency. The exercise was evaluated by trained exercise observers utilizing an independently prepared, evaluation protocol.
  
  
  RESULTS
  All exercise sites successfully identified the bio-agent involved and answered after-exercise debriefing questions without much difficulty. Evaluations, in the form of an after-action report by the independent observers, commented upon the many limitations to the construct of the exercise.
  
  
  CONCLUSIONS
  Having an independent observer group at the exercise appeared to provide a value-added benefit for capturing subjective information and data. However, these data were not in a form conducive to statistical analysis. Further work is needed to create an evaluation tool that would allow for statistical analysis so that exercises can be compared and improvements can be objective.
authors: Department of Emergency Medicine, Wayne State University/Michigan Department of Community Health, Detroit, MI USA. KKlein@dmc.org
authors: Kelly R
authors: KR
authors: Klein
authors: Dale C
authors: DC
authors: Brandenburg
authors: Jenny G
authors: JG
authors: Atas
authors: Ann
authors: A
authors: Maher
mesh_terms: D023482:Bioterrorism / Q000517:prevention & control*; D004189:Disaster Planning / Q000379:methods*; D004632:Emergency Medical Services / Q000458:organization & administration*; D019983:Guideline Adherence; D006801:Humans; D008824:Michigan; D017410:Practice Guidelines as Topic; D015397:Program Evaluation / Q000379:methods*