title: Objective Evaluation of Motor Skills for Orthopedic Residents Using a Motion Tracking Drill System: Outcomes of an ABOS Approved Surgical Skills Training Program.
abstract: Orthopedics is a motor skills-demanding surgical specialty requiring surgical skills training outside of the operating room. Unfortunately, limited quantitative techniques exist to determine the effectiveness of these surgical skills training programs. Using a variety of drill, surgeon, and specimen mounted sensors, we evaluated orthopedic surgery residents during a surgical skills training course approved by the American Board of Orthopaedic Surgeons (ABOS). This evaluation consisted of quantitative measures of various kinematic and kinetic parameters with the goal of relating these to clinically-significant outcomes.
  
  
  
  Seven experienced surgeons and 22 surgical residents participated in this study, each performing 5 surgical drilling trials, pre- and post-training. Utilizing arm and tool kinematics, applied force, tool and bone vibration, and drill RPM were measured using a combination of force, acceleration, and optical tracking sensors. Post hoc screw pullout testing and resident survey data were also evaluated. Overall, 25 measured parameters were expressed as scalars and their covariance calculated.
  
  
  
  Non-trivial direct correlations whose magnitude exceeded 0.5 were: maximum penetration distance with applied force, drill toggle with drill roll angle, and drill RPM with force. Surgeons applying a high drill RPM also yielded a large force which in turn gave an increase in tendency for over-penetration. As a whole, the differences between experienced and novice surgeons measured in these trials were not statistically significant. However, when looking at specific performance criterion individually (maintaining steady force, minimizing over-penetration, minimizing both the major and minor axis diameters, minimizing toggle and drill vibration), experienced surgeons tended to outperform their novice counterparts.
  
  
  
  Objective assessment of surgical skills using sensor based technologies may help elucidate differences between novice and experienced surgeons for improved out-of-the-OR training methodologies.
authors.affiliation: Department of Mechanical Engineering, New Mexico Institute of Mining and Technology.
authors.forename: Ashkan
authors.initials: A
authors.lastname: Pourkand
authors.affiliation: Department of Orthopaedics and Rehabilitation, University of New Mexico School of Medicine; Center for Biomedical Engineering, University of New Mexico School of Medicine; Department of Mechanical Engineering, University of New Mexico School of Engineering.
authors.forename: Christina
authors.initials: C
authors.lastname: Salas
authors.affiliation: Department of Mechanical Engineering, New Mexico Institute of Mining and Technology.
authors.forename: Jasmin
authors.initials: J
authors.lastname: Regalado
authors.affiliation: Department of Mechanical Engineering, New Mexico Institute of Mining and Technology.
authors.forename: Krishan
authors.initials: K
authors.lastname: Bhakta
authors.affiliation: Department of Orthopaedics and Rehabilitation, University of New Mexico School of Medicine; Center for Biomedical Engineering, University of New Mexico School of Medicine.
authors.forename: Rachel
authors.initials: R
authors.lastname: Tufaro
authors.affiliation: Department of Orthopaedics and Rehabilitation, University of New Mexico School of Medicine.
authors.forename: Deana
authors.initials: D
authors.lastname: Mercer
authors.affiliation: Department of Mechanical Engineering, New Mexico Institute of Mining and Technology; Department of Orthopaedics and Rehabilitation, University of New Mexico School of Medicine.
authors.forename: David
authors.initials: D
authors.lastname: Grow
mesh_terms: D002983:Clinical Competence; D004521:Educational Measurement; D006801:Humans; D007396:Internship and Residency; D009048:Motor Skills; D019637:Orthopedic Procedures / Q000193:education*; D009985:Orthopedics / Q000193:education*