Medical Student Performance Evaluations in 2005: an improvement over the former dean's letter?
OBJECTIVE
To collect information regarding preparation, content, and format of Medical Student Performance Evaluations (MSPEs) and evaluate a sample of 2005 MSPEs to assess compliance with the 2002 Association of American Medical Colleges-issued MSPE guidelines.


METHODS
Cross-sectional survey with all 126 U.S. allopathic medical schools. Associate deans of students affairs were sent an eight-item questionnaire in June 2006 and asked to submit a sample of redacted MSPEs for 2005 graduates, choosing one from each tertile of the class. Survey data are summarized. MSPEs were abstracted, and results are presented descriptively.


RESULTS
The survey response rate was 84%. Most associate deans (71%) reported having primary responsibility for composing MSPEs; 78% adhered to the format and content guidelines three fourths of the time. The abstraction of 293 MSPEs (78%) showed that more than 80% adhered to format recommendations. However, only 70% to 80% stated grades clearly, avoided the word recommendation, and stated whether the student had completed remediation. Fewer than 70% indicated whether the student had had any adverse actions or provided adequate comparative data. Strikingly, only 17% provide comparative data in the summary paragraph. Overall, 75% of the MSPEs were judged to be "adequate."


CONCLUSIONS
MSPEs are somewhat variable in terms of which specific items are included. There has been steady quality improvement since prior surveys, primarily in formatting and labeling. However, a sizable minority of writers are still using the MSPE as a recommendation, and too few are providing helpful comparative data.
Shea
Judy A
JA
Department of Medicine, University of Pennsylvania, 1223 Blockley Hall, 423 Guardian Drive, Philadelphia, PA 19104-6021, USA. sheaja@mail.med.upenn.edu
O'Grady
Elizabeth
E
Morrison
Gail
G
Wagner
Barbara R
BR
Morris
Jon B
JB
D002983:Clinical Competence / Q000592:standards*; D003430:Cross-Sectional Studies; D003625:Data Collection; D004504:Education, Medical, Undergraduate / Q000379:methods* / Q000592:standards; D004521:Educational Measurement; D004522:Educational Status; D005069:Evaluation Studies as Topic; D005180:Faculty, Medical; D017408:Guidelines as Topic; D006801:Humans; D012577:Schools, Medical / Q000592:standards*; D013337:Students, Medical; D011795:Surveys and Questionnaires; D014481:United States