title: Content validity of workplace-based portfolios: A multi-centre study.
abstract: BACKGROUND
  Portfolios are used as tools to coach and assess students in the workplace. This study sought to evaluate the content validity of portfolios as reflected in their capacity to adequately assess achieved competences of medical students during clerkships.
  
  
  METHODS
  We reviewed 120 workplace portfolios at three medical universities (Belgium and the Netherlands). To validate their content, we developed a Validity Inventory for Portfolio Assessment (VIPA) based on the CanMEDS roles. Two raters evaluated each portfolio and indicated for each VIPA item whether the portfolio provided sufficient information to enable satisfactory assessment of the item. We ran a descriptive analysis on the validation data and computed Cohen's Kappa to investigate interrater agreement.
  
  
  RESULTS
  The portfolios adequately covered the items pertaining to the communicator (90%) and professional (87%) roles. Coverage of the medical expert, collaborator, scholar and manager roles ranged between 75% and 85%. The health advocate role, covering 59%, was clearly less well represented. This role also exhibited little interrater agreement (Kappa < 0.4).
  
  
  CONCLUSIONS
  This study lends further credence to the evidence that portfolios can indeed adequately assess the different CanMEDS roles during clerkships, the health advocate role, which was less well represented in the portfolio content, excepted.
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Nele R M
authors.initials: NR
authors.lastname: Michels
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Marijke
authors.initials: M
authors.lastname: Avonts
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Griet
authors.initials: G
authors.lastname: Peeraer
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Kris
authors.initials: K
authors.lastname: Ulenaers
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Luc F
authors.initials: LF
authors.lastname: Van Gaal
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Leo L
authors.initials: LL
authors.lastname: Bossaert
authors.affiliation: b University of Maastricht , the Netherlands.
authors.forename: Erik W
authors.initials: EW
authors.lastname: Driessen
authors.affiliation: b University of Maastricht , the Netherlands.
authors.forename: Arno M M
authors.initials: AM
authors.lastname: Muijtjens
authors.affiliation: a University of Antwerp , Belgium .
authors.forename: Benedicte Y
authors.initials: BY
authors.lastname: De Winter
mesh_terms: D001530:Belgium; D002982:Clinical Clerkship; D002983:Clinical Competence / Q000592:standards*; D004504:Education, Medical, Undergraduate; D004521:Educational Measurement; D006801:Humans; D009426:Netherlands; D013337:Students, Medical; D017132:Workplace