title: Validation of knowledge acquisition for surgical process models.
abstract: OBJECTIVE
  Surgical Process Models (SPMs) are models of surgical interventions. The objectives of this study are to validate acquisition methods for Surgical Process Models and to assess the performance of different observer populations.
  
  
  METHODS
  The study examined 180 SPM of simulated Functional Endoscopic Sinus Surgeries (FESS), recorded with observation software. About 150,000 single measurements in total were analyzed.
  
  
  METHODS
  Validation metrics were used for assessing the granularity, content accuracy, and temporal accuracy of structures of SPMs.
  
  
  RESULTS
  Differences between live observations and video observations are not statistically significant. Observations performed by subjects with medical backgrounds gave better results than observations performed by subjects with technical backgrounds. Granularity was reconstructed correctly by 90%, content by 91%, and the mean temporal accuracy was 1.8 s.
  
  
  CONCLUSIONS
  The study shows the validity of video as well as live observations for modeling Surgical Process Models. For routine use, the authors recommend live observations due to their flexibility and effectiveness. If high precision is needed or the SPM parameters are altered during the study, video observations are the preferable approach.
authors.affiliation: University of Leipzig, Innovation Center Computer Assisted Surgery, Semmelweisstr. 14, D-04103 Leipzig, Germany. thomas.neumuth@iccas.de
authors.forename: Thomas
authors.initials: T
authors.lastname: Neumuth
authors.forename: Pierre
authors.initials: P
authors.lastname: Jannin
authors.forename: Gero
authors.initials: G
authors.lastname: Strauss
authors.forename: Juergen
authors.initials: J
authors.lastname: Meixensberger
authors.forename: Oliver
authors.initials: O
authors.lastname: Burgert
mesh_terms: D006801:Humans; D008953:Models, Anatomic; D012984:Software; D012985:Software Design; D013647:Task Performance and Analysis; D014584:User-Computer Interface; D014741:Video Recording