title: Reliability and validity of a simulation-based acute care skills assessment for medical students and residents.
abstract: BACKGROUND
  Medical students and residents are expected to be able to manage a variety of critical events after training, but many of these individuals have limited clinical experiences in the diagnosis and treatment of these conditions. Life-sized mannequins that model critical events can be used to evaluate the skills required to manage and treat acute medical conditions. The purpose of this study was to develop and test simulation exercises and associated scoring methods that could be used to evaluate the acute care skills of final-year medical students and first-year residents.
  
  
  METHODS
  The authors developed and tested 10 simulated acute care situations that clinical faculty at a major medical school expects graduating physicians to be able to recognize and treat at the conclusion of training. Forty medical students and residents participated in the evaluation of the exercises. Four faculty members scored the students/residents.
  
  
  RESULTS
  The reliability of the simulation scores was moderate and was most strongly influenced by the choice and number of simulated encounters. The validity of the simulation scores was supported through comparisons of students'/residents' performances in relation to their clinical backgrounds and experience.
  
  
  CONCLUSIONS
  Acute care skills can be validly and reliably measured using a simulation technology. However, multiple simulated encounters, covering a broad domain, are needed to effectively and accurately estimate student/resident abilities in acute care settings.
authors.affiliation: Research and Evaluation, Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania 19104-2685, USA. jboulet@ecfmg.org
authors.forename: John R
authors.initials: JR
authors.lastname: Boulet
authors.forename: David
authors.initials: D
authors.lastname: Murray
authors.forename: Joe
authors.initials: J
authors.lastname: Kras
authors.forename: Julie
authors.initials: J
authors.lastname: Woodhouse
authors.forename: John
authors.initials: J
authors.lastname: McAllister
authors.forename: Amitai
authors.initials: A
authors.lastname: Ziv
mesh_terms: D002983:Clinical Competence; D003422:Critical Care; D004521:Educational Measurement; D006801:Humans; D007396:Internship and Residency; D016544:Patient Simulation; D013337:Students, Medical