title: Audio and visual analysis of urologic laparoscopic and robotic skills: objective criteria for surgical skill evaluation.
abstract: OBJECTIVE
  To assess intraoperative cognitive and motor skills using audio- and video-based analysis.
  
  
  METHODS
  The study enrolled 11 surgeons who were categorized into novice (n = 4), intermediate (n = 4), and expert (n = 3) groups. Categorization of skill level was based on years of experience and as determined by the lead expert surgeon. A total of 32 cases were available for analysis, including 5 robotic and 27 laparoscopic renal cases. For each procedure, video and audio components were recorded and sent for grading to 4 blinded judges. The previously validated global rating scale (GRS) and operation-specific rating scale (ORS), as well as a novel cognitive rating scale (CRS), were used to assess performances. Statistical comparisons were performed by analysis of variance.
  
  
  RESULTS
  Comparison of the 3 skill levels using analysis of variance showed that each scale was able to differentiate among the levels (P <.05). The mean scores for the before and after audio GRS, ORS, and CRS showed significant difference between the novice, intermediate, and expert groups, demonstrating construct validity.
  
  
  CONCLUSIONS
  The use of intraoperative audio is an innovative way to assess the cognitive ability of the surgeon. The CRS demonstrated construct validity. The addition of the CRS to the already validated GRS and ORS may serve as a reliable system to objectively evaluate laparoscopic and robotic surgical skill.
authors.affiliation: The Arthur Smith Institute for Urology, Hofstra North Shore-Long Island Jewish School of Medicine, New Hyde Park, New York11040, USA.
authors.forename: Amin S
authors.initials: AS
authors.lastname: Herati
authors.forename: Sylvia
authors.initials: S
authors.lastname: Montag
authors.forename: Sero
authors.initials: S
authors.lastname: Andonian
authors.forename: Edan Y
authors.initials: EY
authors.lastname: Shapiro
authors.forename: Meredith
authors.initials: M
authors.lastname: Akerman
authors.forename: Louis R
authors.initials: LR
authors.lastname: Kavoussi
authors.forename: Lee
authors.initials: L
authors.lastname: Richstone
mesh_terms: D002983:Clinical Competence; D006801:Humans; D010535:Laparoscopy / Q000592:standards; D012371:Robotics / Q000592:standards; D013520:Urologic Surgical Procedures / Q000379:methods* / Q000592:standards