Validation of measures from a thoracoscopic esophageal atresia/tracheoesophageal fistula repair simulator.
OBJECTIVE
A validated high fidelity simulation model would provide a safe environment to teach thoracoscopic EA/TEF repair to novices. The study purpose was to evaluate validity evidence for performance measures on an EA/TEF simulator.


METHODS
IRB-exempt data were collected from 12 self-reported "novice" and 8 "experienced" pediatric surgeons. Participants evaluated the EA/TEF repair simulator using survey ratings that were analyzed for test content validity evidence. Additionally, deidentified operative performances were videotaped and independently rated by two surgeons using the Objective Structured Assessment for Technical Skills (OSATS) instrument. Novice and experienced OSATS were compared with p<.05 significant.


RESULTS
Participants had high overall simulator ratings. Internal structure was supported by high interitem consistency (α=.95 and .96) and interrater agreement (ICC) [.52, .84] for OSATS ratings. Experienced surgeons performed at a significantly higher level than novices for all five primary and two supplemental OSATS items (p<.05).


CONCLUSIONS
Favorable participant ratings indicate the simulator is relevant to clinical practice and valuable as a learning tool. Further, performance ratings can discriminate experienced and novice performances of EA/TEF repair. These findings support the use of the simulator for performance assessment, representing the first validated measures from a simulator intended for pediatric surgical training.
Division of Pediatric Surgery, Ann and Robert H Lurie Children's Hospital of Chicago, Northwestern University Feinberg School of Medicine, Chicago, IL, USA; Center for Simulation Technology and Immersive Learning, Northwestern University Feinberg School of Medicine, Chicago, IL, USA. Electronic address: kbarsness@luriechildrens.org.
Katherine A
KA
Barsness
Department of Medical Education, University of Michigan Medical School, Ann Arbor, MI, USA.
Deborah M
DM
Rooney
Center for Simulation Technology and Immersive Learning, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Lauren M
LM
Davis
Division of Pediatric Surgery, Ann and Robert H Lurie Children's Hospital of Chicago, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Anthony C
AC
Chin
D000714:Anastomosis, Surgical / Q000379:methods; D002983:Clinical Competence; D004502:Education, Medical, Continuing / Q000379:methods*; D004521:Educational Measurement; D004933:Esophageal Atresia / Q000601:surgery*; D006801:Humans; D008953:Models, Anatomic; D010372:Pediatrics / Q000193:education*; D015203:Reproducibility of Results; D013043:Specialties, Surgical / Q000193:education*; D013906:Thoracoscopy / Q000379:methods*; D013996:Time and Motion Studies; D014138:Tracheoesophageal Fistula / Q000601:surgery*; D014743:Videotape Recording
Simulation; Thoracoscopic; Tracheoesophageal Fistula; Validation