The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills.
OBJECTIVE
To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings.


METHODS
In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated.


RESULTS
The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001).


CONCLUSIONS
The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.
Malec
James F
JF
Departments of Psychiatry and Psychology, Mayo Multidisciplinary Simulation Center and Mayo Clinic College of Medicine, Rochester, MN 55905, USA. james@mayo.edu
Torsher
Laurence C
LC
Dunn
William F
WF
Wiegmann
Douglas A
DA
Arnold
Jacqueline J
JJ
Brown
Dwight A
DA
Phatak
Vaishali
V
D003422:Critical Care / Q000458:organization & administration*; D006295:Health Resources / Q000458:organization & administration*; D006801:Humans; D033183:Interdisciplinary Communication; D008910:Minnesota; D009726:Nurses; D010820:Physicians; D011361:Professional Competence; D011594:Psychometrics; D011795:Surveys and Questionnaires / Q000592:standards