title: Lessons learnt from the DDIExtraction-2013 Shared Task.
abstract: The DDIExtraction Shared Task 2013 is the second edition of the DDIExtraction Shared Task series, a community-wide effort to promote the implementation and comparative assessment of natural language processing (NLP) techniques in the field of the pharmacovigilance domain, in particular, to address the extraction of drug-drug interactions (DDI) from biomedical texts. This edition has been the first attempt to compare the performance of Information Extraction (IE) techniques specific for each of the basic steps of the DDI extraction pipeline. To attain this aim, two main tasks were proposed: the recognition and classification of pharmacological substances and the detection and classification of drug-drug interactions. DDIExtraction 2013 was held from January to June 2013 and attracted wide attention with a total of 14 teams (6 of the teams participated in the drug name recognition task, while 8 participated in the DDI extraction task) from 7 different countries. For the task of the recognition and classification of pharmacological names, the best system achieved an F1 of 71.5%, while, for the detection and classification of DDIs, the best result was an F1 of 65.1%. The results show advances in the state of the art and demonstrate that significant challenges remain to be resolved. This paper focuses on the second task (extraction of DDIs) and examines its main challenges, which have yet to be resolved.
authors.affiliation: Dpto. de Informática, Universidad Carlos III de Madrid, Leganés 28911, Madrid, Spain. Electronic address: isegura@inf.uc3m.es.
authors.forename: Isabel
authors.initials: I
authors.lastname: Segura-Bedmar
authors.affiliation: Dpto. de Informática, Universidad Carlos III de Madrid, Leganés 28911, Madrid, Spain. Electronic address: pmf@inf.uc3m.es.
authors.forename: Paloma
authors.initials: P
authors.lastname: Martínez
authors.affiliation: Dpto. de Informática, Universidad Carlos III de Madrid, Leganés 28911, Madrid, Spain. Electronic address: mhzazo@pa.uc3m.es.
authors.forename: María
authors.initials: M
authors.lastname: Herrero-Zazo
mesh_terms: D057225:Data Mining / Q000379:methods; D003628:Database Management Systems; D062313:Databases, Pharmaceutical; D004347:Drug Interactions; D016239:MEDLINE; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated / Q000379:methods*; D010506:Periodicals as Topic; D060735:Pharmacovigilance; D012660:Semantics; D012984:Software; D018875:Vocabulary, Controlled
keywords: Drug interaction; Information extraction; Relation extraction