title: Knowledge retention after an online tutorial: a randomized educational experiment among resident physicians.
abstract: BACKGROUND
  The time course of physicians' knowledge retention after learning activities has not been well characterized. Understanding the time course of retention is critical to optimizing the reinforcement of knowledge.
  
  
  METHODS
  Educational follow-up experiment with knowledge retention measured at 1 of 6 randomly assigned time intervals (0-55 days) after an online tutorial covering 2 American Diabetes Association guidelines.
  
  
  METHODS
  Internal and family medicine residents.
  
  
  METHODS
  Multiple-choice knowledge tests, subject characteristics including critical appraisal skills, and learner satisfaction.
  
  
  RESULTS
  Of 197 residents invited, 91 (46%) completed the tutorial and were randomized; of these, 87 (96%) provided complete follow-up data. Ninety-two percent of the subjects rated the tutorial as "very good" or "excellent." Mean knowledge scores increased from 50% before the tutorial to 76% among those tested immediately afterward. Score gains were only half as great at 3-8 days and no significant retention was measurable at 55 days. The shape of the retention curve corresponded with a 1/4-power transformation of the delay interval. In multivariate analyses, critical appraisal skills and participant age were associated with greater initial learning, but no participant characteristic significantly modified the rate of decline in retention.
  
  
  CONCLUSIONS
  Education that appears successful from immediate posttests and learner evaluations can result in knowledge that is mostly lost to recall over the ensuing days and weeks. To achieve longer-term retention, physicians should review or otherwise reinforce new learning after as little as 1 week.
authors.affiliation: Division of General Internal Medicine and Health Services Research, Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, CA 90024, USA. dbell@mednet.ucla.edu
authors.forename: Douglas S
authors.initials: DS
authors.lastname: Bell
authors.forename: Charles E
authors.initials: CE
authors.lastname: Harless
authors.forename: Jerilyn K
authors.initials: JK
authors.lastname: Higa
authors.forename: Elizabeth L
authors.initials: EL
authors.lastname: Bjork
authors.forename: Robert A
authors.initials: RA
authors.lastname: Bjork
authors.forename: Mohsen
authors.initials: M
authors.lastname: Bazargan
authors.forename: Carol M
authors.initials: CM
authors.lastname: Mangione
mesh_terms: D000328:Adult; D000704:Analysis of Variance; D016009:Chi-Square Distribution; D003194:Computer-Assisted Instruction; D003920:Diabetes Mellitus / Q000517:prevention & control; D004521:Educational Measurement; D005194:Family Practice / Q000193:education*; D005260:Female; D006801:Humans; D007388:Internal Medicine / Q000193:education*; D020407:Internet; D007396:Internship and Residency; D007858:Learning; D016014:Linear Models; D008297:Male; D017410:Practice Guidelines as Topic; D012153:Retention, Psychology