title: Validation of a novel intraoperative assessment tool: The Surgical Procedure Feedback Rubric.
abstract: BACKGROUND
  The Surgical Procedure Feedback Rubric (SPR) is a tool to document resident intraoperative performance and provide targeted feedback to support learning in a competency-based model of surgical education. It differs from other assessment tools because it defines performance criteria by increasing complexity through the use of behavioral anchors, thus embedding standards of performance within the tool. This study explores aspects of validity of the SPR as an assessment tool.
  
  
  METHODS
  A 14-month observational study was conducted in 2 surgical training programs. Factor structure of the SPR was examined using exploratory factor analysis. Discriminative ability of the SPR was examined using analysis of variance.
  
  
  RESULTS
  The SPR measures 3 factors: Operating Room Preparation, Technical skill, and intrinsic Competencies. Analysis of variance demonstrated the utility of the SPR to discriminate between intraoperative performances of residents by postgraduate training year.
  
  
  CONCLUSIONS
  This study contributes to the validity argument for the SPR by providing evidence for construct and discriminative validity.
authors.affiliation: Department of Surgery, Queen's University, Kingston General Hospital, Victory 3, 76 Stuart St., Kingston, Ontario K7L 2V7, Canada; Faculty of Education, Queen's University, Duncan McArthur Hall, 511 Union Street, Kingston, Ontario, Canada. Electronic address: ayca.toprak@gmail.com.
authors.forename: Ayca
authors.initials: A
authors.lastname: Toprak
authors.affiliation: Faculty of Education, Queen's University, Duncan McArthur Hall, 511 Union Street, Kingston, Ontario, Canada.
authors.forename: Ulemu
authors.initials: U
authors.lastname: Luhanga
authors.affiliation: Division of Pediatric Surgery, Western University, London, Ontario, Canada.
authors.forename: Sarah
authors.initials: S
authors.lastname: Jones
authors.affiliation: Department of Surgery, Queen's University, Kingston General Hospital, Victory 3, 76 Stuart St., Kingston, Ontario K7L 2V7, Canada.
authors.forename: Andrea
authors.initials: A
authors.lastname: Winthrop
authors.affiliation: Postgraduate Medical Education, Queen's University, Kingston, Ontario, Canada.
authors.forename: Laura
authors.initials: L
authors.lastname: McEwen
mesh_terms: D002983:Clinical Competence; D000068156:Formative Feedback; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D009985:Orthopedics / Q000193:education*; D015203:Reproducibility of Results
keywords: Direct observation; Intraoperative assessment; Rubric; Surgical education; Validity; Workplace-based assessment