A model for setting performance standards for standardized patient examinations.
Setting standards for complex performance assessments is difficult. This report describes and evaluates a model for setting performance standards for standardized patient examinations. A variation of a modified Angoff standard-setting procedure was used to set cutoffs for a standardized patient exercise. Analysis of the procedure was based on evaluation of the impact of the iterative process, the ability of the final standards to accurately classify trainees and the judges' confidence in the procedure and final standards. The practicality of the process also was assessed. The iterative steps in this procedure led to a reduction in the variance between the judges' ratings. All seven judges reported confidence in the final standards. The mean time commitment for each judge was 4.7 work hours. This model for setting performance standards successfully set useful standards for this exam, was practical, and can be utilized to set performance standards for other standardized patient examinations.
Talente
Gregg
G
Brody School of Medicine, East Carolina University, USA.
Haist
Steven A
SA
Wilson
John F
JF
D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000592:standards; D005069:Evaluation Studies as Topic; D006302:Health Services Research; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D016544:Patient Simulation; D010808:Physical Examination / Q000592:standards*; D017064:Process Assessment, Health Care / Q000379:methods; D012015:Reference Standards; D013647:Task Performance and Analysis; D014481:United States