Construct validation of a novel hybrid surgical simulator.
BACKGROUND
Simulated minimal access surgery has improved recently as both a learning and assessment tool. The construct validation of a novel simulator, ProMis, is described for use by residents in training.


METHODS
ProMis is a surgical simulator that can design tasks in both virtual and actual reality. A pilot group of surgical residents ranging from novice to expert completed three standardized tasks: orientation, dissection, and basic suturing. The tasks were tested for construct validity. Two experienced surgeons examined the recorded tasks in a blinded fashion using an objective structured assessment of technical skills format (OSATS: task-specific checklist and global rating score) as well as metrics delivered by the simulator.


RESULTS
The findings showed excellent interrater reliability (Cronbach's alpha of 0.88 for the checklist and 0.93 for the global rating). The median scores in the experience groups were statistically different in both the global rating and the task-specific checklists (p < 0.05). The scores for the orientation task alone did not reach significance (p = 0.1), suggesting that modification is required before ProMis could be used in isolation as an assessment tool.


CONCLUSIONS
The three simulated tasks in combination are construct valid for differentiating experience levels among surgeons in training. This hybrid simulator has potential added benefits of marrying the virtual with actual, and of combining simple box traits and advanced virtual reality simulation.
Broe
D
D
Department of Surgery, Professorial Surgical Unit, Level 4, The Adelaide and Meath Hospital, incorporating the National Children's Hospital, Tallaght, Dublin, 24, Ireland.
Ridgway
P F
PF
Johnson
S
S
Tierney
S
S
Conlon
K C
KC
D003198:Computer Simulation; D006801:Humans; D007396:Internship and Residency; D008953:Models, Anatomic; D015588:Observer Variation; D010865:Pilot Projects; D016037:Single-Blind Method; D013514:Surgical Procedures, Operative / Q000193:education*; D014584:User-Computer Interface