title: Analyzing search behavior of healthcare professionals for drug safety surveillance.
abstract: Post-market drug safety surveillance is hugely important and is a significant challenge despite the existence of adverse event (AE) reporting systems. Here we describe a preliminary analysis of search logs from healthcare professionals as a source for detecting adverse drug events. We annotate search log query terms with biomedical terminologies for drugs and events, and then perform a statistical analysis to identify associations among drugs and events within search sessions. We evaluate our approach using two different types of reference standards consisting of known adverse drug events (ADEs) and negative controls. Our approach achieves a discrimination accuracy of 0.85 in terms of the area under the receiver operator curve (AUC) for the reference set of well-established ADEs and an AUC of 0.68 for the reference set of recently labeled ADEs. We also find that the majority of associations in the reference sets have support in the search log data. Despite these promising results additional research is required to better understand users' search behavior, biasing factors, and the overall utility of analyzing healthcare professional search logs for drug safety surveillance.
authors.affiliation: Center for Biomedical Informatics, Stanford University, 1265 Welch Road, Stanford, CA 94305-5479, USA. djodgers@stanford.edu.
authors.forename: David J
authors.initials: DJ
authors.lastname: Odgers
authors.forename: Rave
authors.initials: R
authors.lastname: Harpaz
authors.forename: Alison
authors.initials: A
authors.lastname: Callahan
authors.forename: Gregor
authors.initials: G
authors.lastname: Stiglic
authors.forename: Nigam H
authors.initials: NH
authors.lastname: Shah
mesh_terms: D016907:Adverse Drug Reaction Reporting Systems / Q000592:standards / Q000706:statistics & numerical data*; D019295:Computational Biology; D066289:Data Curation; D062313:Databases, Pharmaceutical; D064420:Drug-Related Side Effects and Adverse Reactions; D006282:Health Personnel; D006801:Humans; D015233:Models, Statistical; D012372:ROC Curve; D012015:Reference Standards; D057386:Search Engine