Time-efficient laparoscopic skills assessment using an augmented-reality simulator.
BACKGROUND
Computer-based, virtual-reality laparoscopic surgical simulators have several advantages over traditional video trainers. One of these advantages is that performance can be evaluated using unique computer-derived metrics, which can be digitally archived for analysis at a time convenient to instructors. This study sought to determine whether the computer-derived metrics for a unique hybrid simulator correlated with laparoscopic surgical skill.


METHODS
For this study, 24 medical students (3rd year), 19 surgical residents (postgraduate years 1-5), and 3 attending surgeons were invited to perform four different tasks three times in a hybrid laparoscopic trainer (ProMIS). Instruction with minimal supervision occurred at a time convenient to each subject. The four tasks in order of complexity were laparoscopic orientation, object positioning, sharp dissection, and intracorporeal knot tying. The metrics automatically recorded were time, path length, and smoothness. The laparoscopic operative experience for each user was quantified using case logs.


RESULTS
A statistically significant correlation was observed between experience and performance for all three metrics for tasks 2 to 4 (p < 0.01). Smoothness was the only metric that correlated with the laparoscopic orientation task. Within tasks, time and smoothness correlated much more strongly with experience and to a similar degree. The strongest correlation was observed for the knot-tying task (r(2) = 0.60 for time and 0.59 smoothness).


CONCLUSIONS
The computer-derived metrics measured by the hybrid trainer correlate with laparoscopic experience. These metrics are automatically calculated and stored. This may make skills assessment and training a more time-efficient endeavor for instructors and trainees alike. Further study is necessary to determine whether specific metrics are better indicators of actual skill.
Oostema
J Adam
JA
Department of Surgery, University of Wisconsin School of Medicine and Public Health, 600 Highland Avenue K4/762, Clinical Science Center, Madison, WI 53792, USA.
Abdel
Matthew P
MP
Gould
Jon C
JC
D000328:Adult; D002983:Clinical Competence / Q000592:standards*; D003198:Computer Simulation; D004210:Dissection / Q000193:education; D004521:Educational Measurement; D004867:Equipment Design; D005260:Female; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D010535:Laparoscopy; D008297:Male; D011597:Psychomotor Performance; D013337:Students, Medical; D013536:Suture Techniques / Q000193:education; D014584:User-Computer Interface; D055815:Young Adult