Scoring objective structured clinical examinations using video monitors or video recordings.
To compare scoring methods for objective structured clinical examinations (OSCEs) using real-time observations via video monitors and observation of videotapes.



Second- (P2) and third-year (P3) doctor of pharmacy (PharmD) students completed 3-station OSCEs. Sixty encounters, 30 from each PharmD class, were selected at random, and scored by faculty investigators observing video monitors in real-time. One month later, the encounters were scored by investigators using videotapes.



Intra-rater reliability between real-time and videotaped observation was excellent (ICC 3,1 of 0.951 for P2 students and 0.868 for P3 students). However, 13.3% of students' performance in both P2 and P3 cohorts changed in pass/fail determination from passing based on real-time observation to failing based on video observation, and 3.3% of students changed from failing real-time to passing on video.



Despite excellent overall reliability, important differences in OSCE pass/fail determinations were found between real-time and video observations. These observation methods for scoring OSCEs are not interchangeable.
Sturpe
Deborah A
DA
University of Maryland School of Pharmacy, Baltimore, MD, USA. dsturpe@rx.umaryland.edu
Huynh
Donna
D
Haines
Stuart T
ST
D002983:Clinical Competence; D003479:Curriculum; D004512:Education, Pharmacy / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D015588:Observer Variation; D010593:Pharmaceutical Services; D010808:Physical Examination / Q000592:standards; D015203:Reproducibility of Results; D013339:Students, Pharmacy; D014741:Video Recording; D014743:Videotape Recording