title: An acute care skills evaluation for graduating medical students: a pilot study using clinical simulation.
abstract: OBJECTIVE
  This investigation aimed to explore the measurement properties of scores from a patient simulator exercise.
  
  
  METHODS
  Analytic and holistic scores were obtained for groups of medical students and residents. Item analysis techniques were used to explore the nature of specific examinee actions. Interrater reliability was calculated. Scores were contrasted for third year medical students, fourth year medical students and emergency department residents.
  
  
  RESULTS
  Interrater reliabilities for analytic and holistic scores were 0.92 and 0.81, respectively. Based on item analysis, proper timing and sequencing of actions discriminated between low- and high-ability examinees. In general, examinees with more advanced training obtained higher scores on the simulation exercise.
  
  
  CONCLUSIONS
  Reliable and valid measures of clinical performance can be obtained from a trauma simulation provided that care is taken in the development and scoring of the scenario.
mesh_terms: D000704:Analysis of Variance; D002983:Clinical Competence; D003422:Critical Care / Q000379:methods; D003479:Curriculum; D004504:Education, Medical, Undergraduate / Q000592:standards*; D004521:Educational Measurement / Q000592:standards*; D006801:Humans; D016544:Patient Simulation; D010865:Pilot Projects; D015203:Reproducibility of Results