title: Literature-based biomedical image classification and retrieval.
abstract: Literature-based image informatics techniques are essential for managing the rapidly increasing volume of information in the biomedical domain. Compound figure separation, modality classification, and image retrieval are three related tasks useful for enabling efficient access to the most relevant images contained in the literature. In this article, we describe approaches to these tasks and the evaluation of our methods as part of the 2013 medical track of ImageCLEF. In performing each of these tasks, the textual and visual features used to represent images are an important consideration often left unaddressed. Therefore, we also describe a gradient-based optimization strategy for determining meaningful combinations of features and apply the method to the image retrieval task. An evaluation of our optimization strategy indicates the method is capable of producing statistically significant improvements in retrieval performance. Furthermore, the results of the 2013 ImageCLEF evaluation demonstrate the effectiveness of our techniques. In particular, our text-based and mixed image retrieval methods ranked first among all the participating groups.
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
authors.forename: Matthew S
authors.initials: MS
authors.lastname: Simpson
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
authors.forename: Daekeun
authors.initials: D
authors.lastname: You
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
authors.forename: Md Mahmudur
authors.initials: MM
authors.lastname: Rahman
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
authors.forename: Zhiyun
authors.initials: Z
authors.lastname: Xue
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA. Electronic address: ddemner@mail.nih.gov.
authors.forename: Dina
authors.initials: D
authors.lastname: Demner-Fushman
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
authors.forename: Sameer
authors.initials: S
authors.lastname: Antani
authors.affiliation: Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
authors.forename: George
authors.initials: G
authors.lastname: Thoma
mesh_terms: D001185:Artificial Intelligence; D004282:Documentation / Q000592:standards*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated / Q000379:methods*; D010506:Periodicals as Topic; D012660:Semantics; D009626:Terminology as Topic
keywords: Case-based retrieval; Compound figure separation; Image-based retrieval; Modality classification