title: Evaluation using simulated students for reliability of multiple standardized-patients scoring in clinical performance examinations.
abstract: BACKGROUND
  The consistency of rating among different standardized patients (SPs) is very important in clinical performance examinations (CPX).
  
  
  OBJECTIVE
  We evaluated the usefulness of simulated students to assess the reliability of a group of standardized patients in a CPX.
  
  
  METHODS
  Five SPs in each case were trained to simulate the same patient in a CPX. Ten fourth-year medical student volunteers were selected to act as simulated students. After the simulated students encountered the first SP, they reviewed a video of their performance and sequentially repeated the performance with the other 4 SPs.
  
  
  RESULTS
  The average maximum difference (Deltamax +/- SD) of multiple SPs' percent scores on a simulated student was 18 +/- 7. In 10 pairs of SPs who gave largest Deltamax on a given student, the median Deltamax was 30 (range, 26-38) while median difference of percent score in the faculty scoring on the same simulated student was 3 (range, 0-7). Five problematic SPs whose ratings were significantly different from 3 or more other SPs' ratings in each case were identified.
  
  
  CONCLUSIONS
  Simulated students may be a useful means to check the consistency of rating among different SPs in a CPX.
authors.affiliation: Office of Medical Education, Seoul National University College of Medicine, Republic of Korea.
authors.forename: Wan Beom
authors.initials: WB
authors.lastname: Park
authors.forename: Sung A
authors.initials: SA
authors.lastname: Lee
authors.forename: Eun A
authors.initials: EA
authors.lastname: Kim
authors.forename: Jin
authors.initials: J
authors.lastname: Gwack
authors.forename: Keun-Young
authors.initials: KY
authors.lastname: Yoo
authors.forename: Jwa-Seop
authors.initials: JS
authors.lastname: Shin
authors.forename: Yoon Sung
authors.initials: YS
authors.lastname: Lee
mesh_terms: D004504:Education, Medical, Undergraduate / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007723:Korea; D017145:Models, Educational; D016544:Patient Simulation; D012044:Regression Analysis; D015203:Reproducibility of Results; D013337:Students, Medical; D014741:Video Recording