Management of anesthesia equipment failure: a simulation-based resident skill assessment.
BACKGROUND
Intraoperative anesthesia equipment failures are a cause of anesthetic morbidity. Our purpose in this study was 1) to design a set of simulated scenarios that measure skill in managing intraoperative equipment-related errors and 2) to evaluate the reliability and validity of the measures from this multiple scenario assessment.


METHODS
Eight intraoperative scenarios were created to test anesthesia residents' skills in managing a number of equipment-related failures. Fifty-six resident physicians, divided into four groups based on their training year (Resident 1-Resident 4), participated in the individual simulation-based assessment of equipment-related failures. The score for each scenario was generated by a checklist of key actions relevant to each scenario and time to complete these actions.


RESULTS
The residents' scores, on average, improved with increased level of training. The more senior residents (R3 and R4) performed better than more junior residents (R1 and R2). Despite similar training background, there was a wide range of skill among the residents within each training year. The summary score on the eight scenario assessments, measured by either the key actions or the time required to manage the events, yielded a reliable estimate of a resident's skill in managing these simulated equipment failures.


CONCLUSIONS
Anesthesia residents' performances could be reliably evaluated using a set of simulated intraoperative equipment problems. This multiple scenario assessment was an effective method to evaluate individual performance. The summary results, by training year, could be used to determine how successful current instructional methods are for acquiring skill.
Waldrop
William B
WB
Howard and Joyce Wood Clinical Simulation Center, Washington University School of Medicine, St Louis, Missouri 63110, USA. waldropw@wustl.ed
Murray
David J
DJ
Boulet
John R
JR
Kras
Joseph F
JF
D000704:Analysis of Variance; D000776:Anesthesiology / Q000193:education* / Q000295:instrumentation*; D002983:Clinical Competence / Q000592:standards*; D003198:Computer Simulation; D004868:Equipment Failure; D006801:Humans; D007396:Internship and Residency; D007432:Intraoperative Period; D025341:Principal Component Analysis; D015203:Reproducibility of Results