Validation of knowledge acquisition for surgical process models.
OBJECTIVE
Surgical Process Models (SPMs) are models of surgical interventions. The objectives of this study are to validate acquisition methods for Surgical Process Models and to assess the performance of different observer populations.


METHODS
The study examined 180 SPM of simulated Functional Endoscopic Sinus Surgeries (FESS), recorded with observation software. About 150,000 single measurements in total were analyzed.


METHODS
Validation metrics were used for assessing the granularity, content accuracy, and temporal accuracy of structures of SPMs.


RESULTS
Differences between live observations and video observations are not statistically significant. Observations performed by subjects with medical backgrounds gave better results than observations performed by subjects with technical backgrounds. Granularity was reconstructed correctly by 90%, content by 91%, and the mean temporal accuracy was 1.8 s.


CONCLUSIONS
The study shows the validity of video as well as live observations for modeling Surgical Process Models. For routine use, the authors recommend live observations due to their flexibility and effectiveness. If high precision is needed or the SPM parameters are altered during the study, video observations are the preferable approach.
Neumuth
Thomas
T
University of Leipzig, Innovation Center Computer Assisted Surgery, Semmelweisstr. 14, D-04103 Leipzig, Germany. thomas.neumuth@iccas.de
Jannin
Pierre
P
Strauss
Gero
G
Meixensberger
Juergen
J
Burgert
Oliver
O
D006801:Humans; D008953:Models, Anatomic; D012984:Software; D012985:Software Design; D013647:Task Performance and Analysis; D014584:User-Computer Interface; D014741:Video Recording