A method and resources for assessing the reliability of simulation evaluation instruments.
OBJECTIVE
This article describes a successfully piloted method for facilitating rapid psychometric assessments of three simulation evaluation instruments: the Lasater Clinical judgment Rubric, the Seattle University Evaluation Tool, and the Creighton-Simulation Evaluation Instrument.


BACKGROUND
To provide valid and reliable evaluations of student performance in simulation activities, it is important to assess the psychometric properties of evaluation instruments.


METHODS
This novel method incorporates the use of a database of validated, video-archived simulations depicting nursing students performing at varying levels of proficiency.A widely dispersed sample of 29 raters viewed and scored multiple scenarios over a six-week period. Analyses are described including inter- and intrarater reliability, internal consistency, and validity assessments.


CONCLUSIONS
Descriptive and inferential statistics supported the validity of the leveled scenarios.The inter- and intrarater reliability and internal consistencies of data from the three tools are provided.The article provides information and resources for readers to access in order to assess their own simulation evaluation instruments using the described methods.
University of Washington Tacoma Nursing and Healthcare Leadership Program, USA. kadamson@u.washington.edu
Katie A
KA
Adamson
Suzan
S
Kardong-Edgren
D004508:Education, Nursing, Baccalaureate / Q000379:methods* / Q000592:standards; D004521:Educational Measurement / Q000379:methods* / Q000592:standards; D006801:Humans; D017145:Models, Educational; D015402:Nursing Education Research; D016544:Patient Simulation; D015203:Reproducibility of Results