title: Pilot study of a 360-degree assessment instrument for physical medicine & rehabilitation residency programs.
abstract: OBJECTIVE
  To perform a pilot test on a new format for multidisciplinary assessment of resident physicians' professionalism and clinical performance in acute inpatient rehabilitation settings.
  
  
  METHODS
  In this pilot study, a 26-item ratings instrument was developed for use by therapists, nurses, social workers, case managers, and psychologists to rate inpatient residents.
  
  
  RESULTS
  A total of 421 ratings forms were returned over four academic years. Alpha reliability coefficient for instrumentation sample was 0.99. chi2 and analysis of variance procedures examined item mean differences. Significant differences (P <or= 0.05) were found based on resident sex (17 items) and rotation setting (20 items). No significant differences were found based on rater profession; mean ratings by profession ranged from 6.67 (physical therapists) to 7.46 (case managers).
  
  
  CONCLUSIONS
  Psychometric properties of this new ratings format are encouraging. The tool was a useful way to provide formative feedback to residents regarding professionalism and performance. Residency program directors can use this approach to fulfill Accreditation Council for Graduate Medical Education mandates to use a variety of assessment methods regarding resident education. However, potential sex bias and other issues affecting performance ratings should be considered in interpreting results and warrant further study.
authors.affiliation: Department of Rehabilitation Medicine, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania 19104, USA.
authors.forename: David W
authors.initials: DW
authors.lastname: Musick
authors.forename: Susan M
authors.initials: SM
authors.lastname: McDowell
authors.forename: Nedra
authors.initials: N
authors.lastname: Clark
authors.forename: Richard
authors.initials: R
authors.lastname: Salcido
mesh_terms: D000704:Analysis of Variance; D002983:Clinical Competence / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D006757:Hospital Units; D006784:Hospitals, Teaching; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D010810:Physical and Rehabilitation Medicine / Q000193:education*; D010865:Pilot Projects; D015397:Program Evaluation; D015203:Reproducibility of Results; D012737:Sex Factors