title: Scoring objective structured clinical examinations using video monitors or video recordings.
abstract: To compare scoring methods for objective structured clinical examinations (OSCEs) using real-time observations via video monitors and observation of videotapes.
  
  
  
  Second- (P2) and third-year (P3) doctor of pharmacy (PharmD) students completed 3-station OSCEs. Sixty encounters, 30 from each PharmD class, were selected at random, and scored by faculty investigators observing video monitors in real-time. One month later, the encounters were scored by investigators using videotapes.
  
  
  
  Intra-rater reliability between real-time and videotaped observation was excellent (ICC 3,1 of 0.951 for P2 students and 0.868 for P3 students). However, 13.3% of students' performance in both P2 and P3 cohorts changed in pass/fail determination from passing based on real-time observation to failing based on video observation, and 3.3% of students changed from failing real-time to passing on video.
  
  
  
  Despite excellent overall reliability, important differences in OSCE pass/fail determinations were found between real-time and video observations. These observation methods for scoring OSCEs are not interchangeable.
authors.affiliation: University of Maryland School of Pharmacy, Baltimore, MD, USA. dsturpe@rx.umaryland.edu
authors.forename: Deborah A
authors.initials: DA
authors.lastname: Sturpe
authors.forename: Donna
authors.initials: D
authors.lastname: Huynh
authors.forename: Stuart T
authors.initials: ST
authors.lastname: Haines
mesh_terms: D002983:Clinical Competence; D003479:Curriculum; D004512:Education, Pharmacy / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D015588:Observer Variation; D010593:Pharmaceutical Services; D010808:Physical Examination / Q000592:standards; D015203:Reproducibility of Results; D013339:Students, Pharmacy; D014741:Video Recording; D014743:Videotape Recording