title: The relationship between performance on computer-based clinical simulations and two written methods of evaluation: cognitive examination and self-evaluation of expertise.
abstract: The purpose of this study was to explore the relationship between computer-based clinical simulation performance and two commonly used methods of evaluation: cognitive examination and self-evaluation of expertise. The convenience sample of 68 critical care nurses completed the Basic Knowledge Assessment Tool for Critical Care (BKAT), a cardiovascular self-assessment tool (CST), and two computer-based clinical simulations requiring the management of myocardial infarction patients with tachydysrhythmias (atrial flutter and ventricular tachycardia). Simulation performance was measured by proficiency score and patient outcome (live/die). Proficiency on the atrial simulation was significantly correlated with knowledge as measured by the BKAT (r = 0.46, p 0.001) and with self-evaluation of clinical expertise (r = 0.32, p = 0.008). Atrial patient outcome was also significantly correlated with the BKAT (r = 0.28, p = 0.006) and the CST score (r = 0.22, p = 0.036). However, in the ventricular simulation only proficiency score and self-evaluation of expertise were significantly correlated (r = 0.24, p = 0.049). The modest relationships found in this study may indicate that, while clinical simulation performance is related to knowledge and self-evaluation of expertise, the constructs measured are not synonymous. This evidence provides support for the use of clinical simulations as an adjunct to other methods of evaluation.
authors.affiliation: Department of Mental Health, Community and Administrative Nursing, University of California, San Francisco 94143-0608.
authors.forename: S B
authors.initials: SB
authors.lastname: Henry
authors.forename: W L
authors.initials: WL
authors.lastname: Holzemer
mesh_terms: D000328:Adult; D002983:Clinical Competence / Q000592:standards*; D003198:Computer Simulation; D003194:Computer-Assisted Instruction / Q000592:standards*; D003422:Critical Care; D004650:Employee Performance Appraisal / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D009730:Nursing Assessment / Q000592:standards; D015402:Nursing Education Research