title: Who should rate candidates in an objective structured clinical examination?
abstract: OBJECTIVE
  To determine who is the better rater of history taking in an objective structured clinical examination (OSCE): a physician or a standardized patient (SP).
  
  
  METHODS
  During the 1991 pilot administration of an OSCE for the Medical Council of Canada's qualifying examination, five history-taking stations were videotaped. Candidates at these stations were scored by three raters: a physician (MD), an SP observer (SPO), and an SP rating from recall (SPR). To determine the validity of each rater's scores, these scores were compared with a "gold standard", which was the average of videotape ratings by three physicians, each scoring independently. Analysis included both correlations with the standard and a repeated-measures analysis of variance (ANOVA) comparing raters' mean scores on each station with mean scores of the gold standard.
  
  
  RESULTS
  Ninety-one videotapes were scored by the "gold-standard" physicians. Correlations with the standard showed no clear preference for MD, SPO, or SPR raters. ANOVAs revealed significant differences from the standard on three stations for the SPR, two stations for the SPO, and one stations for the MD.
  
  
  CONCLUSIONS
  An MD rater is less likely to differ from a standard established by a consensus of MD ratings than are SP raters rating from recall. If an MD cannot be used, an SP observer is preferable to an SP rating from recall.
authors.affiliation: Department of Surgery, University of Toronto Faculty of Medicine, Ontario, Canada.
authors.forename: J A
authors.initials: JA
authors.lastname: Martin
authors.forename: R K
authors.initials: RK
authors.lastname: Reznick
authors.forename: A
authors.initials: A
authors.lastname: Rothman
authors.forename: R M
authors.initials: RM
authors.lastname: Tamblyn
authors.forename: G
authors.initials: G
authors.lastname: Regehr
mesh_terms: D000704:Analysis of Variance; D002170:Canada; D015510:Clinical Medicine / Q000193:education* / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D018961:Educational Technology; D006801:Humans; D008487:Medical History Taking; D011939:Mental Recall; D016544:Patient Simulation; D010820:Physicians; D010865:Pilot Projects; D015203:Reproducibility of Results; D014743:Videotape Recording