title: A feedback system in residency to evaluate CanMEDS roles and provide high-quality feedback: Exploring its application.
abstract: BACKGROUND
  Residents benefit from regular, high quality feedback on all CanMEDS roles during their training. However, feedback mostly concerns Medical Expert, leaving the other roles behind. A feedback system was developed to guide supervisors in providing feedback on CanMEDS roles. We analyzed whether feedback was provided on the intended roles and explored differences in quality of written feedback.
  
  
  METHODS
  In the feedback system, CanMEDS roles were assigned to five authentic situations: Patient Encounter, Morning Report, On-call, CAT, and Oral Presentation. Quality of feedback was operationalized as specificity and inclusion of strengths and improvement points. Differences in specificity between roles were tested with Mann-Whitney U tests with a Bonferroni correction (α = 0.003).
  
  
  RESULTS
  Supervisors (n = 126) provided residents (n = 120) with feedback (591 times). Feedback was provided on the intended roles, most frequently on Scholar (78%) and Communicator (71%); least on Manager (47%), and Collaborator (56%). Strengths (78%) were mentioned more frequently than improvement points (52%), which were lacking in 40% of the feedback on Manager, Professional, and Collaborator. Feedback on Scholar was more frequently (p = 0.000) and on Reflective Professional was less frequently (p = 0.003) specific.
  
  
  CONCLUSIONS
  Assigning roles to authentic situations guides supervisors in providing feedback on different CanMEDS roles. We recommend additional supervisor training on how to observe and evaluate the roles.
authors.affiliation: a University of Groningen and University Medical Center Groningen , The Netherlands.
authors.forename: Nienke
authors.initials: N
authors.lastname: Renting
authors.affiliation: a University of Groningen and University Medical Center Groningen , The Netherlands.
authors.forename: Rijk O B
authors.initials: RO
authors.lastname: Gans
authors.affiliation: a University of Groningen and University Medical Center Groningen , The Netherlands.
authors.forename: Jan C C
authors.initials: JC
authors.lastname: Borleffs
authors.affiliation: a University of Groningen and University Medical Center Groningen , The Netherlands.
authors.forename: Martha A
authors.initials: MA
authors.lastname: Van Der Wal
authors.affiliation: a University of Groningen and University Medical Center Groningen , The Netherlands.
authors.forename: A Debbie C
authors.initials: AD
authors.lastname: Jaarsma
authors.affiliation: a University of Groningen and University Medical Center Groningen , The Netherlands.
authors.forename: Janke
authors.initials: J
authors.lastname: Cohen-Schotanus
mesh_terms: D002170:Canada; D002983:Clinical Competence; D003142:Communication; D003299:Cooperative Behavior; D004521:Educational Measurement; D000068156:Formative Feedback; D006801:Humans; D007388:Internal Medicine / Q000193:education; D007396:Internship and Residency / Q000379:methods*; D019359:Knowledge; D007857:Leadership; D056164:Teaching Rounds