title: More challenges for machine-learning protein interactions.
abstract: BACKGROUND
  Machine learning may be the most popular computational tool in molecular biology. Providing sustained performance estimates is challenging. The standard cross-validation protocols usually fail in biology. Park and Marcotte found that even refined protocols fail for protein-protein interactions (PPIs).
  
  
  RESULTS
  Here, we sketch additional problems for the prediction of PPIs from sequence alone. First, it not only matters whether proteins A or B of a target interaction A-B are similar to proteins of training interactions (positives), but also whether A or B are similar to proteins of non-interactions (negatives). Second, training on multiple interaction partners per protein did not improve performance for new proteins (not used to train). In contrary, a strictly non-redundant training that ignored good data slightly improved the prediction of difficult cases. Third, which prediction method appears to be best crucially depends on the sequence similarity between the test and the training set, how many true interactions should be found and the expected ratio of negatives to positives. The correct assessment of performance is the most complicated task in the development of prediction methods. Our analyses suggest that PPIs square the challenge for this task.
authors.affiliation: Department of Informatics, Bioinformatics and Computational Biology I12, Technische Universität München, 85748 Garching/Munich, Germany.
authors.forename: Tobias
authors.initials: T
authors.lastname: Hamp
authors.affiliation: Department of Informatics, Bioinformatics and Computational Biology I12, Technische Universität München, 85748 Garching/Munich, Germany.
authors.forename: Burkhard
authors.initials: B
authors.lastname: Rost
mesh_terms: D001185:Artificial Intelligence; D019295:Computational Biology / Q000379:methods*; D006801:Humans; D025941:Protein Interaction Mapping / Q000379:methods*; D011506:Proteins / Q000378:metabolism*; D029701:Saccharomyces cerevisiae Proteins / Q000378:metabolism; D020539:Sequence Analysis, Protein
chemical_list: D011506:Proteins; D029701:Saccharomyces cerevisiae Proteins