title: Evaluation of biomedical text-mining systems: lessons learned from information retrieval.
abstract: Biomedical text-mining systems have great promise for improving the efficiency and productivity of biomedical researchers. However, such systems are still not in routine use. One impediment to their development is the lack of systematic and rigorous evaluation, comparable to the approaches developed for information retrieval systems. The developers of text-mining systems need to improve both test collections for system-oriented evaluation and undertake user-oriented evaluations to determine the most effective use of their systems for their intended audience.
authors.affiliation: Department of Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, 3181 SW Sam Jackson Park Rd, BICC, Portland, 97239, USA. hersh@ohsu.edu
authors.forename: William
authors.initials: W
authors.lastname: Hersh
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D035843:Biomedical Research / Q000145:classification*; D003628:Database Management Systems; D016208:Databases, Factual; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D010506:Periodicals as Topic