title: Computer-assisted assessment of one-handed knot tying skills performed within various contexts: a construct validity study.
abstract: BACKGROUND
  The widespread use of computer-assisted assessment of technical proficiency in surgical residents shows the need for further investigations of the construct validity of these devices (eg, hand motion analysis) before implementation into competency testing.
  
  
  METHODS
  Thirty general surgery residents performed 1-handed knot tying in 2 contexts: superficial and deep. The Imperial College Surgical Assessment Device (ICSAD) was used to evaluate performance. It was hypothesized that senior residents (postgraduate year [PGY] 4-5) would perform better then junior residents (PGY 1-3) and that the superficial version of the skill would be easier than the deep.
  
  
  RESULTS
  Technical efficiency scores were better for seniors than for juniors (P < .001) and on the superficial versus the deep model (P < .001). Both groups were equally affected by the contextual changes to the skill, suggesting a consistent impact on the skill-specific movement patterns.
  
  
  CONCLUSIONS
  Additional evidence for the validity of ICSAD as a competency assessment tool has been shown. First, it distinguished senior and junior residents. Second, it discerned differences on the same skill performed in 2 different contexts.
authors.affiliation: Department of Surgery, University of Toronto, Surgical Skills Centre at Mount Sinai Hospital, 600 University Avenue, Level 2-Room 250, Toronto, Ontario, M5G 1X5, Canada.
authors.forename: Ryan
authors.initials: R
authors.lastname: Brydges
authors.forename: Roger
authors.initials: R
authors.lastname: Classen
authors.forename: James
authors.initials: J
authors.lastname: Larmer
authors.forename: George
authors.initials: G
authors.lastname: Xeroulis
authors.forename: Adam
authors.initials: A
authors.lastname: Dubrowski
mesh_terms: D002983:Clinical Competence; D003194:Computer-Assisted Instruction / Q000295:instrumentation*; D004867:Equipment Design; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency / Q000379:methods*; D008432:Mathematical Computing; D011795:Surveys and Questionnaires; D014584:User-Computer Interface