title: Reliability of performance-based clinical skill assessment of emergency medicine residents.
abstract: OBJECTIVE
  To test the overall reliability of a performance-based clinical skill assessment for entering emergency medicine (EM) residents. Also, to investigate the reliability of separate reporting of diagnostic and management scores for a standardized patient case, subjective scoring of patient notes, and interstation exercise scores.
  
  
  METHODS
  Thirty-four first-year EM residents were tested using a 10-station standardized patient (SP) examination. Following each 10-minute encounter, the residents completed a patient note that included differential diagnosis and management. The residents also were asked to read an ECG or chest x-ray (CXR) associated with each case. History, physical examination, and interpersonal skills were scored by the SPs. The patient note, CXR, and ECG readings were scored by faculty emergency physicians. Intercase reliability was determined for the residents.
  
  
  RESULTS
  Global score reliability, Cronbach's alpha = 0.85. Reliabilities for the other components were: history, 0.77; physical examination, 0.83; and interpersonal skills, 0.80. Differential diagnosis and management reliabilities were 0.61 and 0.66, respectively. Subjective scoring of the patient note resulted in acceptable reliability for legibility (0.80), history completeness (0.80), and history organization (0.81). Physical examination completeness and organization reliabilities were 0.74 and 0.73. For ECG and CXR readings, alpha = 0.74 and 0.34, respectively.
  
  
  CONCLUSIONS
  SPs can be used to reliably assess bedside clinical skills of EM residents. While component reliability levels are slightly lower than the global clinical skill reliability coefficient, they are still high enough to use for identification of individual strengths and weaknesses.
authors.affiliation: Medical College of Pennsylavania, Department of Emergency Medicine, Philadelphia 19129, USA. burdick@allegheny.edu
authors.forename: W P
authors.initials: WP
authors.lastname: Burdick
authors.forename: M F
authors.initials: MF
authors.lastname: Ben-David
authors.forename: L
authors.initials: L
authors.lastname: Swisher
authors.forename: J
authors.initials: J
authors.lastname: Becher
authors.forename: D
authors.initials: D
authors.lastname: Magee
authors.forename: R
authors.initials: R
authors.lastname: McNamara
authors.forename: M
authors.initials: M
authors.lastname: Zwanger
mesh_terms: D002983:Clinical Competence / Q000592:standards*; D003937:Diagnosis, Differential; D004503:Education, Medical, Graduate / Q000592:standards; D004562:Electrocardiography; D004635:Emergency Medicine / Q000193:education* / Q000592:standards*; D004636:Emergency Service, Hospital; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D008487:Medical History Taking / Q000592:standards; D015143:Philadelphia; D010808:Physical Examination / Q000592:standards; D010817:Physician-Patient Relations; D013902:Radiography, Thoracic; D015203:Reproducibility of Results