title: All-paths graph kernel for protein-protein interaction extraction with evaluation of cross-corpus learning.
abstract: BACKGROUND
  Automated extraction of protein-protein interactions (PPI) is an important and widely studied task in biomedical text mining. We propose a graph kernel based approach for this task. In contrast to earlier approaches to PPI extraction, the introduced all-paths graph kernel has the capability to make use of full, general dependency graphs representing the sentence structure.
  
  
  RESULTS
  We evaluate the proposed method on five publicly available PPI corpora, providing the most comprehensive evaluation done for a machine learning based PPI-extraction system. We additionally perform a detailed evaluation of the effects of training and testing on different resources, providing insight into the challenges involved in applying a system beyond the data it was trained on. Our method is shown to achieve state-of-the-art performance with respect to comparable evaluations, with 56.4 F-score and 84.8 AUC on the AImed corpus.
  
  
  CONCLUSIONS
  We show that the graph kernel approach performs on state-of-the-art level in PPI extraction, and note the possible extension to the task of extracting complex interactions. Cross-corpus results provide further insight into how the learning generalizes beyond individual corpora. Further, we identify several pitfalls that can make evaluations of PPI-extraction systems incomparable, or even invalid. These include incorrect cross-validation strategies and problems related to comparing F-score results achieved on different evaluation resources. Recommendations for avoiding these pitfalls are provided.
authors.affiliation: Turku Centre for Computer Science (TUCS) and the Department of IT, University of Turku, Joukahaisenkatu 3-5, 20520 Turku, Finland. antti.airola@utu.fi
authors.forename: Antti
authors.initials: A
authors.lastname: Airola
authors.forename: Sampo
authors.initials: S
authors.lastname: Pyysalo
authors.forename: Jari
authors.initials: J
authors.lastname: Björne
authors.forename: Tapio
authors.initials: T
authors.lastname: Pahikkala
authors.forename: Filip
authors.initials: F
authors.lastname: Ginter
authors.forename: Tapio
authors.initials: T
authors.lastname: Salakoski
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D019295:Computational Biology / Q000379:methods*; D019992:Databases as Topic; D009323:Natural Language Processing; D025941:Protein Interaction Mapping / Q000379:methods*