Knowledge retention after an online tutorial: a randomized educational experiment among resident physicians.
BACKGROUND
The time course of physicians' knowledge retention after learning activities has not been well characterized. Understanding the time course of retention is critical to optimizing the reinforcement of knowledge.


METHODS
Educational follow-up experiment with knowledge retention measured at 1 of 6 randomly assigned time intervals (0-55 days) after an online tutorial covering 2 American Diabetes Association guidelines.


METHODS
Internal and family medicine residents.


METHODS
Multiple-choice knowledge tests, subject characteristics including critical appraisal skills, and learner satisfaction.


RESULTS
Of 197 residents invited, 91 (46%) completed the tutorial and were randomized; of these, 87 (96%) provided complete follow-up data. Ninety-two percent of the subjects rated the tutorial as "very good" or "excellent." Mean knowledge scores increased from 50% before the tutorial to 76% among those tested immediately afterward. Score gains were only half as great at 3-8 days and no significant retention was measurable at 55 days. The shape of the retention curve corresponded with a 1/4-power transformation of the delay interval. In multivariate analyses, critical appraisal skills and participant age were associated with greater initial learning, but no participant characteristic significantly modified the rate of decline in retention.


CONCLUSIONS
Education that appears successful from immediate posttests and learner evaluations can result in knowledge that is mostly lost to recall over the ensuing days and weeks. To achieve longer-term retention, physicians should review or otherwise reinforce new learning after as little as 1 week.
Bell
Douglas S
DS
Division of General Internal Medicine and Health Services Research, Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, CA 90024, USA. dbell@mednet.ucla.edu
Harless
Charles E
CE
Higa
Jerilyn K
JK
Bjork
Elizabeth L
EL
Bjork
Robert A
RA
Bazargan
Mohsen
M
Mangione
Carol M
CM
D000328:Adult; D000704:Analysis of Variance; D016009:Chi-Square Distribution; D003194:Computer-Assisted Instruction; D003920:Diabetes Mellitus / Q000517:prevention & control; D004521:Educational Measurement; D005194:Family Practice / Q000193:education*; D005260:Female; D006801:Humans; D007388:Internal Medicine / Q000193:education*; D020407:Internet; D007396:Internship and Residency; D007858:Learning; D016014:Linear Models; D008297:Male; D017410:Practice Guidelines as Topic; D012153:Retention, Psychology