title: Origin bias of test items compromises the validity and fairness of curriculum comparisons.
abstract: OBJECTIVE
  To determine whether items of progress tests used for inter-curriculum comparison favour students from the medical school where the items were produced (i.e. whether the origin bias of test items is a potential confounder in comparisons between curricula).
  
  
  METHODS
  We investigated scores of students from different schools on subtests consisting of progress test items constructed by authors from the different schools. In a cross-institutional collaboration between 3 medical schools, progress tests are jointly constructed and simultaneously administered to all students at the 3 schools. Test score data for 6 consecutive progress tests were investigated. Participants consisted of approximately 5000 undergraduate medical students from 3 medical schools. The main outcome measure was the difference between the scores on subtests of items constructed by authors from 2 of the collaborating schools (subtest difference score).
  
  
  RESULTS
  The subtest difference scores showed that students obtained better results on items produced at their own schools. This effect was more pronounced in Years 2-5 of the curriculum than in Year 1, and diminished in Year 6.
  
  
  CONCLUSIONS
  Progress test items were subject to origin bias. As a consequence, all participating schools should contribute equal numbers of test items if tests are to be used for valid and fair inter-curriculum comparisons.
authors.affiliation: Department of Educational Development and Research, Faculty of Medicine, Maastricht University, Maastricht, The Netherlands. a.muijtjens@educ.unimaas.nl
authors.forename: Arno M M
authors.initials: AM
authors.lastname: Muijtjens
authors.forename: Lambert W T
authors.initials: LW
authors.lastname: Schuwirth
authors.forename: Janke
authors.initials: J
authors.lastname: Cohen-Schotanus
authors.forename: Cees P M
authors.initials: CP
authors.lastname: van der Vleuten
mesh_terms: D002983:Clinical Competence / Q000592:standards*; D003479:Curriculum / Q000592:standards*; D004504:Education, Medical, Undergraduate; D009426:Netherlands; D015983:Selection Bias