title: Internet-based learning in the health professions: a meta-analysis.
abstract: BACKGROUND
  The increasing use of Internet-based learning in health professions education may be informed by a timely, comprehensive synthesis of evidence of effectiveness.
  
  
  OBJECTIVE
  To summarize the effect of Internet-based instruction for health professions learners compared with no intervention and with non-Internet interventions.
  
  
  METHODS
  Systematic search of MEDLINE, Scopus, CINAHL, EMBASE, ERIC, TimeLit, Web of Science, Dissertation Abstracts, and the University of Toronto Research and Development Resource Base from 1990 through 2007.
  
  
  METHODS
  Studies in any language quantifying the association of Internet-based instruction and educational outcomes for practicing and student physicians, nurses, pharmacists, dentists, and other health care professionals compared with a no-intervention or non-Internet control group or a preintervention assessment.
  
  
  METHODS
  Two reviewers independently evaluated study quality and abstracted information including characteristics of learners, learning setting, and intervention (including level of interactivity, practice exercises, online discussion, and duration).
  
  
  RESULTS
  There were 201 eligible studies. Heterogeneity in results across studies was large (I(2) > or = 79%) in all analyses. Effect sizes were pooled using a random effects model. The pooled effect size in comparison to no intervention favored Internet-based interventions and was 1.00 (95% confidence interval [CI], 0.90-1.10; P < .001; n = 126 studies) for knowledge outcomes, 0.85 (95% CI, 0.49-1.20; P < .001; n = 16) for skills, and 0.82 (95% CI, 0.63-1.02; P < .001; n = 32) for learner behaviors and patient effects. Compared with non-Internet formats, the pooled effect sizes (positive numbers favoring Internet) were 0.10 (95% CI, -0.12 to 0.32; P = .37; n = 43) for satisfaction, 0.12 (95% CI, 0.003 to 0.24; P = .045; n = 63) for knowledge, 0.09 (95% CI, -0.26 to 0.44; P = .61; n = 12) for skills, and 0.51 (95% CI, -0.24 to 1.25; P = .18; n = 6) for behaviors or patient effects. No important treatment-subgroup interactions were identified.
  
  
  CONCLUSIONS
  Internet-based learning is associated with large positive effects compared with no intervention. In contrast, effects compared with non-Internet instructional methods are heterogeneous and generally small, suggesting effectiveness similar to traditional methods. Future research should directly compare different Internet-based interventions.
authors.affiliation: Division of General Internal Medicine, Mayo Clinic College of Medicine, Baldwin 4-A, 200 First St SW, Rochester, MN 55905, USA. cook.david33@mayo.edu
authors.forename: David A
authors.initials: DA
authors.lastname: Cook
authors.forename: Anthony J
authors.initials: AJ
authors.lastname: Levinson
authors.forename: Sarah
authors.initials: S
authors.lastname: Garside
authors.forename: Denise M
authors.initials: DM
authors.lastname: Dupras
authors.forename: Patricia J
authors.initials: PJ
authors.lastname: Erwin
authors.forename: Victor M
authors.initials: VM
authors.lastname: Montori
mesh_terms: D003194:Computer-Assisted Instruction; D006282:Health Personnel / Q000193:education*; D006801:Humans; D020407:Internet