Figure text extraction in biomedical literature.
BACKGROUND
Figures are ubiquitous in biomedical full-text articles, and they represent important biomedical knowledge. However, the sheer volume of biomedical publications has made it necessary to develop computational approaches for accessing figures. Therefore, we are developing the Biomedical Figure Search engine (http://figuresearch.askHERMES.org) to allow bioscientists to access figures efficiently. Since text frequently appears in figures, automatically extracting such text may assist the task of mining information from figures. Little research, however, has been conducted exploring text extraction from biomedical figures.


METHODS
We first evaluated an off-the-shelf Optical Character Recognition (OCR) tool on its ability to extract text from figures appearing in biomedical full-text articles. We then developed a Figure Text Extraction Tool (FigTExT) to improve the performance of the OCR tool for figure text extraction through the use of three innovative components: image preprocessing, character recognition, and text correction. We first developed image preprocessing to enhance image quality and to improve text localization. Then we adapted the off-the-shelf OCR tool on the improved text localization for character recognition. Finally, we developed and evaluated a novel text correction framework by taking advantage of figure-specific lexicons.


CONCLUSIONS
The evaluation on 382 figures (9,643 figure texts in total) randomly selected from PubMed Central full-text articles shows that FigTExT performed with 84% precision, 98% recall, and 90% F1-score for text localization and with 62.5% precision, 51.0% recall and 56.2% F1-score for figure text extraction. When limiting figure texts to those judged by domain experts to be important content, FigTExT performed with 87.3% precision, 68.8% recall, and 77% F1-score. FigTExT significantly improved the performance of the off-the-shelf OCR tool we used, which on its own performed with 36.6% precision, 19.3% recall, and 25.3% F1-score for text extraction. In addition, our results show that FigTExT can extract texts that do not appear in figure captions or other associated text, further suggesting the potential utility of FigTExT for improving figure search.
Department of Health Science, University of Wisconsin-Milwaukee, Milwaukee, Wisconsin, United States of America. kim48@uwm.edu
Daehyun
D
Kim
Hong
H
Yu
D019295:Computational Biology; D003196:Computer Graphics; D057225:Data Mining; D016247:Information Storage and Retrieval / Q000379:methods* / Q000592:standards; D020407:Internet; D010363:Pattern Recognition, Automated / Q000379:methods* / Q000592:standards; D010506:Periodicals as Topic; D039781:PubMed; D012984:Software
Bioinformatics. 2008 Sep 1;24(17):1968-70
18614584
AJR Am J Roentgenol. 2007 Jun;188(6):1475-8
17515364
IEEE Trans Image Process. 2004 Jan;13(1):87-99
15376960
Bioinformatics. 2006 Jul 15;22(14):e446-53
16873506
IEEE Trans Pattern Anal Mach Intell. 2009 Oct;31(10):1733-46
19696446
Bioinformatics. 2007 Aug 15;23(16):2196-7
17545178
Bioinformatics. 2006 Jul 15;22(14):e547-56
16873519
AMIA Annu Symp Proc. 2009 Nov 14;2009:6-10
20351812
Bioinformatics. 2008 Feb 15;24(4):569-76
18033795
AMIA Annu Symp Proc. 2009 Nov 14;2009:327-31
20351874
Nucleic Acids Res. 1994 Nov 11;22(22):4673-80
7984417
KDD. 2009;2009:39-48
25485170
PLoS One. 2010 Oct 07;5(10):e12983
20949102
Bioinformatics. 2009 Dec 1;25(23):3174-80
19783830
J Biomed Discov Collab. 2009 Jan 06;4:1
19126221
Bioinformatics. 2008 Sep 15;24(18):2086-93
18718948