title: Reliability of the interprofessional collaborator assessment rubric (ICAR) in multi source feedback (MSF) with post-graduate medical residents.
abstract: BACKGROUND
  Increased attention on collaboration and teamwork competency development in medical education has raised the need for valid and reliable approaches to the assessment of collaboration competencies in post-graduate medical education. The purpose of this study was to evaluate the reliability of a modified Interprofessional Collaborator Assessment Rubric (ICAR) in a multi-source feedback (MSF) process for assessing post-graduate medical residents' collaborator competencies.
  
  
  METHODS
  Post-graduate medical residents (n = 16) received ICAR assessments from three different rater groups (physicians, nurses and allied health professionals) over a four-week rotation. Internal consistency, inter-rater reliability, inter-group differences and relationship between rater characteristics and ICAR scores were analyzed using Cronbach's alpha, one-way and two-way repeated measures ANOVA, and logistic regression.
  
  
  RESULTS
  Missing data decreased from 13.1% using daily assessments to 8.8% utilizing an MSF process, p = .032. High internal consistency measures were demonstrated for overall ICAR scores (α = .981) and individual assessment domains within the ICAR (α = .881 to .963). There were no significant differences between scores of physician, nurse, and allied health raters on collaborator competencies (F2,5 = 1.225, p = .297, η2 = .016). Rater gender was the only significant factor influencing scores with female raters scoring residents significantly lower than male raters (6.12 v. 6.82; F1,5 = 7.184, p = .008, η 2 = .045).
  
  
  CONCLUSIONS
  The study findings suggest that the use of the modified ICAR in a MSF assessment process could be a feasible and reliable assessment approach to providing formative feedback to post-graduate medical residents on collaborator competencies.
authors.forename: Mark F
authors.initials: MF
authors.lastname: Hayward
authors.forename: Vernon
authors.initials: V
authors.lastname: Curran
authors.forename: Bryan
authors.initials: B
authors.lastname: Curtis
authors.forename: Henry
authors.initials: H
authors.lastname: Schulz
authors.forename: Sean
authors.initials: S
authors.lastname: Murphy
mesh_terms: D002983:Clinical Competence; D003299:Cooperative Behavior; D004503:Education, Medical, Graduate; D004521:Educational Measurement / Q000379:methods*; D005246:Feedback; D005260:Female; D006801:Humans; D007396:Internship and Residency; D007400:Interprofessional Relations; D008297:Male; D015203:Reproducibility of Results