The effect of task exposure on repeat candidate scores in a high-stakes standardized patient assessment.
BACKGROUND
Failing candidates often make multiple attempts on licensure and certification examinations. For performance-based assessments, where available test material is often limited, overlap in examination content is frequently inevitable.


OBJECTIVE
The purpose of this study was to investigate the performance of repeat candidates, both on new and exposed material, on a standardized patient clinical skills assessment.


METHODS
Analysis of variance techniques were used to investigate the longitudinal performance of repeat candidates. Score differences for the second test session were analyzed as function of prior exposure to assessment materials.


RESULTS
Although the performance of candidates improved between the first and second assessment, score increases could not be attributed to the random exposure of examination material.


CONCLUSIONS
The exposure of case content on clinical skills examinations does not appear to provide any advantage, or disadvantage, to repeat test takers. This finding, although based on average scores for repeat examinees, suggests that valid assessment scores can be obtained even if there is some overlap in assessment content.
Boulet
John R
JR
Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104, USA. jboulet@ecfmg.org
McKinley
Danette W
DW
Whelan
Gerald P
GP
Hambleton
Ronald K
RK
D000328:Adult; D000704:Analysis of Variance; D002983:Clinical Competence / Q000592:standards*; D004501:Education, Medical / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D008004:Licensure; D008297:Male; D016544:Patient Simulation; D010808:Physical Examination / Q000592:standards*; D014481:United States