title: The reliability of six faculty members in identifying important OSCE items.
abstract: OBJECTIVE
  To measure the agreement among faculty members about the importance of items on a checklist used to grade an objective structured clinical examination (OSCE) station.
  
  
  METHODS
  Six faculty members rated the importance of 47 items for an OSCE station in which students took the history of a patient with sore throat and hoarseness.
  
  
  RESULTS
  Of the 47 items, the raters independently identified 15 items as very important. The reliability of each individual rater was fair (averaged value of alpha = .63.) The reliability of the mean rating of the six raters was high (alpha = .91).
  
  
  CONCLUSIONS
  The results strongly suggest that when a group of faculty members cooperatively identifies the important items to be included in an OSCE checklist, the reliability of the checklist is superior to one created by a single author.
authors.affiliation: Department of Surgery, University of Kentucky College of Medicine, Lexington, USA. jvale00@pop.uky.edu
authors.forename: J
authors.initials: J
authors.lastname: Valentino
authors.forename: M B
authors.initials: MB
authors.lastname: Donnelly
authors.forename: D A
authors.initials: DA
authors.lastname: Sloan
authors.forename: R W
authors.initials: RW
authors.lastname: Schwartz
authors.forename: R C
authors.initials: RC
authors.lastname: Haydon
mesh_terms: D000465:Algorithms; D002983:Clinical Competence; D004501:Education, Medical; D004521:Educational Measurement / Q000379:methods*; D005180:Faculty, Medical / Q000706:statistics & numerical data; D006685:Hoarseness / Q000175:diagnosis; D006801:Humans; D008487:Medical History Taking; D015588:Observer Variation; D010612:Pharyngitis / Q000175:diagnosis; D015203:Reproducibility of Results