title: Analysis of clinical decision support system malfunctions: a case series and survey.
abstract: To illustrate ways in which clinical decision support systems (CDSSs) malfunction and identify patterns of such malfunctions.
  
  
  
  We identified and investigated several CDSS malfunctions at Brigham and Women's Hospital and present them as a case series. We also conducted a preliminary survey of Chief Medical Information Officers to assess the frequency of such malfunctions.
  
  
  
  We identified four CDSS malfunctions at Brigham and Women's Hospital: (1) an alert for monitoring thyroid function in patients receiving amiodarone stopped working when an internal identifier for amiodarone was changed in another system; (2) an alert for lead screening for children stopped working when the rule was inadvertently edited; (3) a software upgrade of the electronic health record software caused numerous spurious alerts to fire; and (4) a malfunction in an external drug classification system caused an alert to inappropriately suggest antiplatelet drugs, such as aspirin, for patients already taking one. We found that 93% of the Chief Medical Information Officers who responded to our survey had experienced at least one CDSS malfunction, and two-thirds experienced malfunctions at least annually.
  
  
  
  CDSS malfunctions are widespread and often persist for long periods. The failure of alerts to fire is particularly difficult to detect. A range of causes, including changes in codes and fields, software upgrades, inadvertent disabling or editing of rules, and malfunctions of external systems commonly contribute to CDSS malfunctions, and current approaches for preventing and detecting such malfunctions are inadequate.
  
  
  
  CDSS malfunctions occur commonly and often go undetected. Better methods are needed to prevent and detect these malfunctions.
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA awright@bwh.harvard.edu.|Harvard Medical School, Boston, MA, USA.|Partners HealthCare, Boston, MA, USA.
authors.forename: Adam
authors.initials: A
authors.lastname: Wright
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.
authors.forename: Thu-Trang T
authors.initials: TT
authors.lastname: Hickman
authors.affiliation: Partners HealthCare, Boston, MA, USA.
authors.forename: Dustin
authors.initials: D
authors.lastname: McEvoy
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.
authors.forename: Skye
authors.initials: S
authors.lastname: Aaron
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.
authors.forename: Angela
authors.initials: A
authors.lastname: Ai
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.
authors.forename: Jan Marie
authors.initials: JM
authors.lastname: Andersen
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.|The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH, USA.
authors.forename: Salman
authors.initials: S
authors.lastname: Hussain
authors.affiliation: Harvard Medical School, Boston, MA, USA.|Harvard School of Dental Medicine, Boston, MA, USA.
authors.forename: Rachel
authors.initials: R
authors.lastname: Ramoni
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.
authors.forename: Julie
authors.initials: J
authors.lastname: Fiskio
authors.affiliation: University of Texas Health Science Center, Houston, TX, USA.
authors.forename: Dean F
authors.initials: DF
authors.lastname: Sittig
authors.affiliation: Brigham & Women's Hospital, Boston, MA, USA.|Harvard Medical School, Boston, MA, USA.|Partners HealthCare, Boston, MA, USA.
authors.forename: David W
authors.initials: DW
authors.lastname: Bates
mesh_terms: D000638:Amiodarone / Q000627:therapeutic use; D001900:Boston; D002675:Child, Preschool; D020000:Decision Support Systems, Clinical; D057286:Electronic Health Records; D004868:Equipment Failure; D006782:Hospitals, Special; D006801:Humans; D007855:Lead Poisoning / Q000175:diagnosis; D019300:Medical Errors; D050316:Medical Order Entry Systems; D008991:Monitoring, Physiologic; D019982:Organizational Case Studies; D012984:Software
chemical_list: D000638:Amiodarone
keywords: anomaly detection; clinical decision support; electronic health records; machine learning; safety