title: Examiners are most lenient at the start of a two-day OSCE.
abstract: BACKGROUND
  OSCEs can be both reliable and valid but are subject to sources of error. Examiners become more hawkish as their experience grows, and recent research suggests that in clinical contexts, examiners are influenced by the ability of recently observed candidates. In OSCEs, where examiners test many candidates over a short space of time, this may introduce bias that does not reflect a candidate's true ability.
  
  
  OBJECTIVE
  Test whether examiners marked more or less stringently as time elapsed in a summative OSCE, and evaluate the practical impact of this bias.
  
  
  METHODS
  We measured changes in examiner stringency in a 13 station OSCE sat by 278 third year MBChB students over the course of two days.
  
  
  RESULTS
  Examiners were most lenient at the start of the OSCE in the clinical section (β = -0.14, p = 0.018) but not in the online section where student answers were machine marked (β = -0.003, p = 0.965).
  
  
  CONCLUSIONS
  The change in marks was likely caused by increased examiner stringency over time derived from a combination of growing experience and exposure to an increasing number of successful candidates. The need for better training and for reviewing standards during the OSCE is discussed.
authors.affiliation: The University of Edinburgh , UK.
authors.forename: David
authors.initials: D
authors.lastname: Hope
authors.forename: Helen
authors.initials: H
authors.lastname: Cameron
mesh_terms: D002983:Clinical Competence; D004503:Education, Medical, Graduate / Q000592:standards*; D004521:Educational Measurement / Q000592:standards*; D006801:Humans; D015588:Observer Variation; D013995:Time