Pilot study of a 360-degree assessment instrument for physical medicine & rehabilitation residency programs.
OBJECTIVE
To perform a pilot test on a new format for multidisciplinary assessment of resident physicians' professionalism and clinical performance in acute inpatient rehabilitation settings.


METHODS
In this pilot study, a 26-item ratings instrument was developed for use by therapists, nurses, social workers, case managers, and psychologists to rate inpatient residents.


RESULTS
A total of 421 ratings forms were returned over four academic years. Alpha reliability coefficient for instrumentation sample was 0.99. chi2 and analysis of variance procedures examined item mean differences. Significant differences (P <or= 0.05) were found based on resident sex (17 items) and rotation setting (20 items). No significant differences were found based on rater profession; mean ratings by profession ranged from 6.67 (physical therapists) to 7.46 (case managers).


CONCLUSIONS
Psychometric properties of this new ratings format are encouraging. The tool was a useful way to provide formative feedback to residents regarding professionalism and performance. Residency program directors can use this approach to fulfill Accreditation Council for Graduate Medical Education mandates to use a variety of assessment methods regarding resident education. However, potential sex bias and other issues affecting performance ratings should be considered in interpreting results and warrant further study.
Musick
David W
DW
Department of Rehabilitation Medicine, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania 19104, USA.
McDowell
Susan M
SM
Clark
Nedra
N
Salcido
Richard
R
D000704:Analysis of Variance; D002983:Clinical Competence / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D006757:Hospital Units; D006784:Hospitals, Teaching; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D010810:Physical and Rehabilitation Medicine / Q000193:education*; D010865:Pilot Projects; D015397:Program Evaluation; D015203:Reproducibility of Results; D012737:Sex Factors