title: Methods uncovering usability issues in medication-related alerting functions: results from a systematic review.
abstract: This paper aims at listing the methods used to evaluate the usability of medication-related alerting functions and at knowing what type of usability issues those methods allow to detect. A sub-analysis of data from this systematic review has been performed. Methods applied in the included papers were collected. Then, included papers were sorted in four types of evaluation: "expert evaluation", "user- testing/simulation", "on site observation" and "impact studies". The types of usability issues (usability flaws, usage problems and negative outcomes) uncovered by those evaluations were analyzed. Results show that a large set of methods are used. The largest proportion of papers uses "on site observation" evaluation. This is the only evaluation type for which every kind of usability flaws, usage problems and outcomes are detected. It is somehow surprising that, in a usability systematic review, most of the papers included use a method that is not often presented as a usability method. Results are discussed about the opportunity to provide usability information collected after the implementation of the technology during their design process, i.e. before their implementation.
authors.affiliation: INSERM CIC-IT, Lille ; Univ Lille Nord de France ; CHU Lille ; UDSL EA 2694 ; F-59000 Lille, France.
authors.forename: Romaric
authors.initials: R
authors.lastname: Marcilly
authors.affiliation: Université Lille Nord de France ; Pôle de Santé Publique, CHRU Lille ; UDSL EA2694 ; F-59000 Lille, France.
authors.forename: Francis
authors.initials: F
authors.lastname: Vasseur
authors.affiliation: Institute of Health Informatics, UMIT, 6060 Hall in Tyrol, Austria.
authors.forename: Elske
authors.initials: E
authors.lastname: Ammenwerth
authors.affiliation: INSERM CIC-IT, Lille ; Univ Lille Nord de France ; CHU Lille ; UDSL EA 2694 ; F-59000 Lille, France.
authors.forename: Marie-Catherine
authors.initials: MC
authors.lastname: Beuscart-Zephir
mesh_terms: D016907:Adverse Drug Reaction Reporting Systems; D020000:Decision Support Systems, Clinical; D055695:Electronic Prescribing; D005602:France; D006747:Hospital Communication Systems; D062527:Meaningful Use; D050316:Medical Order Entry Systems; D020380:Needs Assessment