title: Development of an objective structured assessment of technical skills for obstetric and gynecology residents.
abstract: OBJECTIVE
  To develop an objective structured assessment for evaluating surgical skills of obstetrics and gynecology residents and to evaluate the reliability and validity of the assessment.
  
  
  METHODS
  A seven-station, objective, structured assessment of technical skills was administered to 24 residents. The test included laparoscopic procedures (port placement, salpingostomy, suturing, vessel ligation) and open abdominal procedures (hypogastric ligation, repair of enterotomy, salpingo-oophorectomy.) All surgical tasks were done on pigs. Residents were timed and assessed at each station using three methods of scoring, a task-specific checklist, global rating scale, and pass-fail grade.
  
  
  RESULTS
  Assessment of construct validity (the ability of the test to discriminate among residency levels) found significant differences on the checklist and the global rating scale by residency level. Reliability indices calculated with Cronbach's alpha were 0.89 for the global rating scale and 0.89-0.95 for the individual skills checklists. Interrater reliability was 0.87 for the global rating scale and 0.78-0.98 for the checklists.
  
  
  CONCLUSIONS
  Objective, structured assessment of technical skills can assess residents' surgical skills with high reliability and validity. These assessments have possible application for identifying residents who need additional training and might provide a mechanism to ensure competence of surgical skills.
authors.affiliation: Department of Obstetrics and Gynecology, University of Washington School of Medicine, Seattle 98195-6460, USA. bgoff@u.washington.edu
authors.forename: B A
authors.initials: BA
authors.lastname: Goff
authors.forename: G M
authors.initials: GM
authors.lastname: Lentz
authors.forename: D
authors.initials: D
authors.lastname: Lee
authors.forename: B
authors.initials: B
authors.lastname: Houmard
authors.forename: L S
authors.initials: LS
authors.lastname: Mandel
mesh_terms: D000328:Adult; D002983:Clinical Competence; D006176:Gynecology / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D009774:Obstetrics / Q000193:education*; D015203:Reproducibility of Results; D012577:Schools, Medical; D014861:Washington