Assessment of procedural skills using virtual simulation remains a challenge.
OBJECTIVE
The LAP Mentor is a procedural simulator that provides a stepwise training for laparoscopic cholecystectomy. This study addresses its "construct" validity that is present when a simulator is able to discriminate between persons with known differences in performance level on the laparoscopic cholecystectomy in real life.


METHODS
Three groups with different skill levels performed 2 trials of 4 distinct parts of the cholecystectomy procedure (cholecystectomy exercises) and 1 full procedure on the LAP Mentor. Assessment parameters concerning the quantity and the quality of performance were compared between groups using the Kruskal-Wallis and Mann-Whitney U tests.


METHODS
The entire research was performed in the Center for Surgical Technologies, Leuven, Belgium.


METHODS
For study purposes, 5 expert abdominal laparoscopists (>100 laparoscopic cholecystectomies performed), 11 surgical residents (10-30 cholecystectomies performed), and 10 novices (minimal laparoscopic experience) were recruited.


RESULTS
With regard to the quantity of performance (time needed and number of movements), the experts showed significantly better results compared with the novices in the cholecystectomy exercises. Only in the full procedure, the results of all the parameters (except speed) were significantly different between the 3 groups, with the best results observed for the experts and worst for the novices. With respect to quality of performance, only the parameter "accuracy rate of dissection" in exercise 3 showed significantly better performance by the experts.


CONCLUSIONS
Only the full procedure of the LAP Mentor procedural simulator has enough discriminative power to claim construct validity. However, the lack of quality control, which is indispensible in the evaluation of procedural skills, makes it currently unsuited for the assessment of procedural laparoscopic skills. The role of the simulator in a training context remains to be elucidated.
Center for Surgical Technologies, Leuven, Belgium; Department of Urology, University Hospitals, Leuven, Belgium. Electronic address: siska.vanbruwaene@gmail.com.
Siska
S
Van Bruwaene
Department of Surgery, Academic Medical Center, Amsterdam, The Netherlands.
Marlies P
MP
Schijven
Center for Surgical Technologies, Leuven, Belgium; Department of Abdominal Surgery, University Hospitals, Leuven, Belgium.
Marc
M
Miserez
D017081:Cholecystectomy, Laparoscopic / Q000193:education*; D002983:Clinical Competence; D003198:Computer Simulation; D006801:Humans
LAP Mentor; Patient Care; Practice-Based Learning and Improvement; Professionalism; assessment; construct; laparoscopy; validation; virtual simulation