title: The effect of task exposure on repeat candidate scores in a high-stakes standardized patient assessment.
abstract: BACKGROUND
  Failing candidates often make multiple attempts on licensure and certification examinations. For performance-based assessments, where available test material is often limited, overlap in examination content is frequently inevitable.
  
  
  OBJECTIVE
  The purpose of this study was to investigate the performance of repeat candidates, both on new and exposed material, on a standardized patient clinical skills assessment.
  
  
  METHODS
  Analysis of variance techniques were used to investigate the longitudinal performance of repeat candidates. Score differences for the second test session were analyzed as function of prior exposure to assessment materials.
  
  
  RESULTS
  Although the performance of candidates improved between the first and second assessment, score increases could not be attributed to the random exposure of examination material.
  
  
  CONCLUSIONS
  The exposure of case content on clinical skills examinations does not appear to provide any advantage, or disadvantage, to repeat test takers. This finding, although based on average scores for repeat examinees, suggests that valid assessment scores can be obtained even if there is some overlap in assessment content.
authors: Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104, USA. jboulet@ecfmg.org
authors: John R
authors: JR
authors: Boulet
authors: Danette W
authors: DW
authors: McKinley
authors: Gerald P
authors: GP
authors: Whelan
authors: Ronald K
authors: RK
authors: Hambleton
mesh_terms: D000328:Adult; D000704:Analysis of Variance; D002983:Clinical Competence / Q000592:standards*; D004501:Education, Medical / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D008004:Licensure; D008297:Male; D016544:Patient Simulation; D010808:Physical Examination / Q000592:standards*; D014481:United States