title: Evaluating performance of biomedical image retrieval systems--an overview of the medical image retrieval task at ImageCLEF 2004-2013.
abstract: Medical image retrieval and classification have been extremely active research topics over the past 15 years. Within the ImageCLEF benchmark in medical image retrieval and classification, a standard test bed was created that allows researchers to compare their approaches and ideas on increasingly large and varied data sets including generated ground truth. This article describes the lessons learned in ten evaluation campaigns. A detailed analysis of the data also highlights the value of the resources created.
authors.affiliation: Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA. Electronic address: kalpathy@nmr.mgh.harvard.edu.
authors.forename: Jayashree
authors.initials: J
authors.lastname: Kalpathy-Cramer
authors.affiliation: University of Applied Sciences Western Switzerland (HES-SO), Sierre, Switzerland.
authors.forename: Alba García Seco
authors.initials: AG
authors.lastname: de Herrera
authors.affiliation: National Library of Medicine/National Institutes of Health (NLM/NIH), Bethesda, MD, USA.
authors.forename: Dina
authors.initials: D
authors.lastname: Demner-Fushman
authors.affiliation: National Library of Medicine/National Institutes of Health (NLM/NIH), Bethesda, MD, USA.
authors.forename: Sameer
authors.initials: S
authors.lastname: Antani
authors.affiliation: Oregon Health & Science University, Portland, OR, USA.
authors.forename: Steven
authors.initials: S
authors.lastname: Bedrick
authors.affiliation: University of Applied Sciences Western Switzerland (HES-SO), Sierre, Switzerland.
authors.forename: Henning
authors.initials: H
authors.lastname: Müller
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D004282:Documentation / Q000379:methods; D016247:Information Storage and Retrieval / Q000379:methods*; D064847:Multimodal Imaging / Q000379:methods*; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated / Q000379:methods; D011873:Radiology Information Systems / Q000458:organization & administration*; D013382:Subtraction Technique; D009626:Terminology as Topic; D014584:User-Computer Interface; D018875:Vocabulary, Controlled
keywords: Biomedical literature; Content-based retrieval; Image retrieval; Multimodal medical retrieval; Text-based image retrieval
references.citation: AJR Am J Roentgenol. 2007 Jun;188(6):1475-8
references.pmid: 17515364
references.citation: Brief Bioinform. 2005 Mar;6(1):57-71
references.pmid: 15826357
references.citation: Stud Health Technol Inform. 2008;136:523-8
references.pmid: 18487784
references.citation: Comput Med Imaging Graph. 2004 Sep;28(6):295-305
references.pmid: 15294308
references.citation: IEEE Trans Inf Technol Biomed. 2010 Sep;14(5):1227-35
references.pmid: 20813626
references.citation: Stud Health Technol Inform. 2007;129(Pt 2):1319-23
references.pmid: 17911928
references.citation: J Am Med Inform Assoc. 2007 May-Jun;14(3):253-63
references.pmid: 17329729
references.citation: Methods Inf Med. 2012;51(6):539-48
references.pmid: 22935760
references.citation: J Digit Imaging. 2009 Dec;22(6):648-55
references.pmid: 18769965
references.citation: Stud Health Technol Inform. 2012;180:1020-4
references.pmid: 22874348
references.citation: Int J Med Inform. 2006 Mar-Apr;75(3-4):268-81
references.pmid: 16169771