Clinical Assessment of Medical Students in Emergency Medicine Clerkships: A Survey of Current Practice.
BACKGROUND
Assessment practices in emergency medicine (EM) clerkships have not been previously described. Clinical assessment frequently relies on global ratings of clinical performance, or "shift cards," although these tools have not been standardized or studied.


OBJECTIVE
We sought to characterize assessment practices in EM clerkships, with particular attention to shift cards.


METHODS
A survey regarding assessment practices was administered to a national sample of EM clerkship directors (CDs). Descriptive statistics were compiled and regression analyses were performed.


RESULTS
One hundred seventy-two CDs were contacted, and 100 (58%) agreed to participate. The most heavily weighted assessment methods in final grades were shift cards (66%) and written examinations (21-26%), but there was considerable variability in grading algorithms. EM faculty (100%) and senior residents (69%) were most commonly responsible for assessment, and assessors were often preassigned (71%). Forty-four percent of CDs reported immediate completion of shift cards, 27% within 1 to 2 days, and 20% within a week. Only 40% reported return rates >75%. Thirty percent of CDs do not permit students to review individual evaluations, and 54% of the remainder deidentify evaluations before student review. Eighty-six percent had never performed psychometric analysis on their assessment tools. Sixty-five percent of CDs were satisfied with their shift cards, but 90% supported the development of a national tool.


CONCLUSIONS
There is substantial variability in assessment practices between EM clerkships, raising concern regarding the comparability of grades between institutions. CDs rely on shift cards in grading despite the lack of evidence of validity and inconsistent process variables. Standardization of assessment practices may improve the assessment of EM students.
Department of Emergency Medicine, East Carolina University Brody School of Medicine, Greenville, North Carolina.
Luan
L
Lawson
Department of Emergency Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland.
Julianna
J
Jung
Division of Emergency Medicine, University of Washington School of Medicine, Seattle, Washington.
Douglas
D
Franzen
Department of Emergency Medicine, University of Arizona College of Medicine, Tucson, Arizona.
Katherine
K
Hiller
D002982:Clinical Clerkship / Q000379:methods; D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D004635:Emergency Medicine / Q000193:education*; D006801:Humans; D011446:Prospective Studies; D013337:Students, Medical; D011795:Surveys and Questionnaires
assessment; clerkship; education; medical student