Predictors of educational outcome: factors impacting performance on a standardized clinical evaluation.
BACKGROUND
To improve student skills specific to the evaluation of radiology studies during a required clerkship in surgery for 4th-year medical students, we initiated a self-study CD-ROM educational module midway through 2000-2001. We hypothesized that student performance would improve after implementation of this module and identified factors that predicted student performance.


METHODS
Students (n = 98) chose one of two hospital sites for a clerkship that focuses on the care of acutely ill surgical patients. A standardized clinical final evaluation (Objective Structured Clinical Evaluation) contained two components: radiology (R score) and ICU clinical "flow sheet" interpretation (C score). We evaluated the effect of the CD-ROM educational module and other factors on student exam performance using univariate and multivariate analysis.


RESULTS
The site of the clerkship and use of the CD-ROM educational module were significant factors affecting the C score identified by ANOVA; P < 0.05. With the R scores from both sites combined, performance improved by 22% from a mean of 29.2 +/- 1.1 to 35.7 +/- 1.1 with use of the module. A stepwise multiple regression analysis testing the effect of site, time of year, educational module, and a prior radiology clerkship on the R score identified that the site and CD-ROM educational module modeled performance; R(2) = 0.30, P < 0.01. The C score was affected by site (A: 72.5 +/- 1.6 vs B: 67.3 +/- 1.9, P < 0.05 by ANOVA). Regression analysis identified that time of year (later associated with increased score) and prior performance on the 3rd-year standardized exams (OSCE and NBME) modeled 4th-year C score; R(2) = 0.20, P < 0.01.


CONCLUSIONS
In a clerkship that already emphasized faculty-facilitated case-based learning, including evaluation of radiological studies, the addition of a self-study CD-ROM radiology module significantly improved test score. This study supports the efficacy of directed self-study to improve student skills.
Nackman
Gary B
GB
Department of Surgery, UMDNJ-Robert Wood Johnson Medical School, New Brunswick 08903, USA.
Sutyak
John
J
Lowry
Stephen F
SF
Rettie
Candice
C
D016251:CD-ROM; D002982:Clinical Clerkship / Q000379:methods*; D004501:Education, Medical / Q000379:methods*; D004521:Educational Measurement; D004522:Educational Status; D005544:Forecasting; D006801:Humans; D007362:Intensive Care Units; D011871:Radiology / Q000193:education*