title: Assisted curation: does text mining really help?
abstract: Although text mining shows considerable promise as a tool for supporting the curation of biomedical text, there is little concrete evidence as to its effectiveness. We report on three experiments measuring the extent to which curation can be speeded up with assistance from Natural Language Processing (NLP), together with subjective feedback from curators on the usability of a curation tool that integrates NLP hypotheses for protein-protein interactions (PPIs). In our curation scenario, we found that a maximum speed-up of 1/3 in curation time can be expected if NLP output is perfectly accurate. The preference of one curator for consistent NLP output and output with high recall needs to be confirmed in a larger study with several curators.
authors.affiliation: School of Informatics, University of Edinburgh, EH8 9LW, UK. balex@inf.ed.ac.uk
authors.forename: Beatrice
authors.initials: B
authors.lastname: Alex
authors.forename: Claire
authors.initials: C
authors.lastname: Grover
authors.forename: Barry
authors.initials: B
authors.lastname: Haddow
authors.forename: Mijail
authors.initials: M
authors.lastname: Kabadjov
authors.forename: Ewan
authors.initials: E
authors.lastname: Klein
authors.forename: Michael
authors.initials: M
authors.lastname: Matthews
authors.forename: Stuart
authors.initials: S
authors.lastname: Roebuck
authors.forename: Richard
authors.initials: R
authors.lastname: Tobin
authors.forename: Xinglong
authors.initials: X
authors.lastname: Wang
mesh_terms: D001185:Artificial Intelligence; D019295:Computational Biology; D016208:Databases, Factual; D016247:Information Storage and Retrieval; D009323:Natural Language Processing; D025941:Protein Interaction Mapping / Q000706:statistics & numerical data