The value of videotape in mock oral board examinations.
OBJECTIVE
To determine the impact on self-perception, of having residents view their own performance (taped) on mock oral board examinations.


METHODS
Self-evaluation-intervention-self-evaluation design. Third-, fourth-, and fifth-year residents evaluated themselves after each examination(room) during mock oral examinations. Residents reviewed the examination on videotape and re-evaluated themselves.


METHODS
University Medical Center.


METHODS
Twenty surgical residents from the third, fourth, and fifth years of training.


METHODS
Mean scores in 6 categories based on a 5-point Likert scale. Scores by examiners plus pre- and post-video viewing self-scores were compared.


RESULTS
We found that residents consistently underestimated their performance on the examination. Viewing their videotapes resulted in revised self-scores, which were more consistent with scores of the examiners. All scores will be presented in sequence as follows: Mean score by examiners, mean self-score pre-tape viewing and mean self-score post-tape viewing. For professionalism, scores were 4.63, 4.15, and 4.43, p = 0.047. For organization, 3.91, 3.27, and 3.63, p = 0.007. For decision making, 4.02, 3.42, and 3.72, p = 0.033. P-values reflect the comparison of resident self-scores pre- and post-tape viewing. Analysis of variance comparison of scores in various rooms (different examiners) revealed no significant difference in scores based on rooms (different examiners). Evaluations according to rooms (different examiners) were not statistically different, supporting inter-rater reliability. There was consistent improvement in knowledge and decision making with advanced years of training, supporting internal validity of the examination.


CONCLUSIONS
Videotape viewing results in revised resident self-scores, which are more consistent with scores given by the examiners. Tape viewing significantly affected resident self-scores in professionalism, organization, and decision-making.
Department of Surgery, University of Connecticut Health Center, Farmington, Connecticut 06030, USA. kozol@nso.uchc.edu
Robert
R
Kozol
Matthew
M
Giles
Anthony
A
Voytovich
D000704:Analysis of Variance; D003657:Decision Making; D004521:Educational Measurement; D013502:General Surgery / Q000193:education*; D007396:Internship and Residency; D015588:Observer Variation; D012655:Self-Evaluation Programs; D014743:Videotape Recording