Is a resident's score on a videotaped objective structured assessment of technical skills affected by revealing the resident's identity?
OBJECTIVE
The purpose of this study was to determine whether knowledge of resident's identity affects the evaluation of surgical skills.


METHODS
During an objective structured assessment of technical skills, 33 residents in obstetrics and gynecology who performed 10 surgical skills were videotaped with two digital cameras simultaneously. One camera videotaped "hands only," concealing resident identity; the other camera videotaped from the "waist up," revealing identity. Residents wore opaque gowns and gloves. Four faculty reviewers with previous clinical experience with the residents scored the "hands only" videos first. The scoring was based on the total of a global rating scale and a task-specific checklist.


RESULTS
The combined scores for all reviewers was significantly different between the two views (P=.03). When the video tapes were analyzed individually, two reviewers scored the views differently; one reviewer scored higher, whereas the other reviewer scored lower.


CONCLUSIONS
Bias can occur in evaluation of surgical skills but is dependent on the individual reviewer. Resident identification can alter the score, depending on the evaluator.
Vogt
Val Y
VY
Department of Obstetrics and Gynecology, University of Tennessee, Memphis 38163, USA.
Givens
Vanessa M
VM
Keathley
Craig A
CA
Lipscomb
Gary H
GH
Summitt
Robert L
RL
D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D013502:General Surgery / Q000193:education*; D013509:Gynecologic Surgical Procedures; D006176:Gynecology / Q000193:education; D006801:Humans; D007396:Internship and Residency; D008297:Male; D013513:Obstetric Surgical Procedures; D009774:Obstetrics / Q000193:education; D011287:Prejudice; D013337:Students, Medical; D014743:Videotape Recording