Automatic identification of comparative effectiveness research from medline citations to support clinicians' treatment information needs.
Online knowledge resources such as Medline can address most clinicians' patient care information needs. Yet, significant barriers, notably lack of time, limit the use of these sources at the point of care. The most common information needs raised by clinicians are treatment-related. Comparative effectiveness studies allow clinicians to consider multiple treatment alternatives for a particular problem. Still, solutions are needed to enable efficient and effective consumption of comparative effectiveness research at the point of care.


OBJECTIVE
Design and assess an algorithm for automatically identifying comparative effectiveness studies and extracting the interventions investigated in these studies.


METHODS
The algorithm combines semantic natural language processing, Medline citation metadata, and machine learning techniques. We assessed the algorithm in a case study of treatment alternatives for depression.


RESULTS
Both precision and recall for identifying comparative studies was 0.83. A total of 86% of the interventions extracted perfectly or partially matched the gold standard.


CONCLUSIONS
Overall, the algorithm achieved reasonable performance. The method provides building blocks for the automatic summarization of comparative effectiveness research to inform point of care decision-making.
Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA.
Mingyuan
M
Zhang
Guilherme
G
Del Fiol
Randall W
RW
Grout
Siddhartha
S
Jonnalagadda
Richard
R
Medlin
Rashmi
R
Mishra
Charlene
C
Weir
Hongfang
H
Liu
Javed
J
Mostafa
Marcelo
M
Fiszman
D000465:Algorithms; D001185:Artificial Intelligence; D015706:Bibliometrics; D020000:Decision Support Systems, Clinical; D003863:Depression / Q000628:therapy*; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods; D016239:MEDLINE; D009323:Natural Language Processing; D017063:Outcome Assessment, Health Care / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods; D010506:Periodicals as Topic