title: Effect of point-of-care computer reminders on physician behaviour: a systematic review.
abstract: BACKGROUND
  The opportunity to improve care using computer reminders is one of the main incentives for implementing sophisticated clinical information systems. We conducted a systematic review to quantify the expected magnitude of improvements in processes of care from computer reminders delivered to clinicians during their routine activities.
  
  
  METHODS
  We searched the MEDLINE, Embase and CINAHL databases (to July 2008) and scanned the bibliographies of retrieved articles. We included studies in our review if they used a randomized or quasi-randomized design to evaluate improvements in processes or outcomes of care from computer reminders delivered to physicians during routine electronic ordering or charting activities.
  
  
  RESULTS
  Among the 28 trials (reporting 32 comparisons) included in our study, we found that computer reminders improved adherence to processes of care by a median of 4.2% (interquartile range [IQR] 0.8%-18.8%). Using the best outcome from each study, we found that the median improvement was 5.6% (IQR 2.0%-19.2%). A minority of studies reported larger effects; however, no study characteristic or reminder feature significantly predicted the magnitude of effect except in one institution, where a well-developed, "homegrown" clinical information system achieved larger improvements than in all other studies (median 16.8% [IQR 8.7%-26.0%] v. 3.0% [IQR 0.5%-11.5%]; p = 0.04). A trend toward larger improvements was seen for reminders that required users to enter a response (median 12.9% [IQR 2.7%-22.8%] v. 2.7% [IQR 0.6%-5.6%]; p = 0.09).
  
  
  CONCLUSIONS
  Computer reminders produced much smaller improvements than those generally expected from the implementation of computerized order entry and electronic medical record systems. Further research is required to identify features of reminder systems consistently associated with clinically worthwhile improvements.
authors.affiliation: Department of Medicine, Sunnybrook Health Sciences Centre and University of Toronto Centre for Patient Safety, Toronto, Ont. kaveh.shojania@utoronto.ca
authors.forename: Kaveh G
authors.initials: KG
authors.lastname: Shojania
authors.forename: Alison
authors.initials: A
authors.lastname: Jennings
authors.forename: Alain
authors.initials: A
authors.lastname: Mayhew
authors.forename: Craig
authors.initials: C
authors.lastname: Ramsay
authors.forename: Martin
authors.initials: M
authors.lastname: Eccles
authors.forename: Jeremy
authors.initials: J
authors.lastname: Grimshaw
mesh_terms: D006801:Humans; D017063:Outcome Assessment, Health Care; D019095:Point-of-Care Systems; D010818:Practice Patterns, Physicians'; D011785:Quality Assurance, Health Care; D016032:Randomized Controlled Trials as Topic; D017010:Reminder Systems