Dictionary Pruning with Visual Word Significance for Medical Image Retrieval.
Content-based medical image retrieval (CBMIR) is an active research area for disease diagnosis and treatment but it can be problematic given the small visual variations between anatomical structures. We propose a retrieval method based on a bag-of-visual-words (BoVW) to identify discriminative characteristics between different medical images with Pruned Dictionary based on Latent Semantic Topic description. We refer to this as the PD-LST retrieval. Our method has two main components. First, we calculate a topic-word significance value for each visual word given a certain latent topic to evaluate how the word is connected to this latent topic. The latent topics are learnt, based on the relationship between the images and words, and are employed to bridge the gap between low-level visual features and high-level semantics. These latent topics describe the images and words semantically and can thus facilitate more meaningful comparisons between the words. Second, we compute an overall-word significance value to evaluate the significance of a visual word within the entire dictionary. We designed an iterative ranking method to measure overall-word significance by considering the relationship between all latent topics and words. The words with higher values are considered meaningful with more significant discriminative power in differentiating medical images. We evaluated our method on two public medical imaging datasets and it showed improved retrieval accuracy and efficiency.
School of Information Technologies, University of Sydney, Australia; Dept of Radiology, Brigham & Womens Hospital, Harvard Medical School, United States.
Fan
F
Zhang
School of Information Technologies, University of Sydney, Australia.
Yang
Y
Song
School of Information Technologies, University of Sydney, Australia.
Weidong
W
Cai
School of Computer Science, Carnegie Mellon University, United States.
Alexander G
AG
Hauptmann
School of Information Technologies, University of Sydney, Australia.
Sidong
S
Liu
Dept of Radiology, Brigham & Womens Hospital, Harvard Medical School, United States.
Sonia
S
Pujol
Dept of Radiology, Brigham & Womens Hospital, Harvard Medical School, United States.
Ron
R
Kikinis
Dept of PET and Nuclear Medicine, Royal Prince Alfred Hospital, Australia; Sydney Medical School, University of Sydney, Australia.
Michael J
MJ
Fulham
School of Information Technologies, University of Sydney, Australia; Med-X Research Institute, Shanghai Jiaotong University, China.
David Dagan
DD
Feng
Dept of Informatics, University of Albany State University of New York, United States; Robotics Institute, Carnegie Mellon University, United States.
Mei
M
Chen
BoVW; Dictionary pruning; Medical image retrieval
J Digit Imaging. 2012 Dec;25(6):708-19
22692772
Med Image Comput Comput Assist Interv. 2012;15(Pt 1):157-64
23285547
IEEE Trans Med Imaging. 2011 Mar;30(3):733-46
21118769
IEEE Trans Inf Technol Biomed. 2008 Jan;12 (1):7-19
18270032
IEEE Trans Med Imaging. 2013 Apr;32(4):797-808
23340591
IEEE Trans Pattern Anal Mach Intell. 2012 Sep;34(9):1704-16
22156101
Neuroimage. 2011 Jun 15;56(4):2024-37
21397703
IEEE Trans Biomed Eng. 2014 Apr;61(4):1155-66
24658240
Med Image Anal. 2010 Apr;14(2):227-41
20007020
Neuroimage. 2010 Feb 1;49(3):2318-27
19853047
J Digit Imaging. 2011 Apr;24(2):208-22
20376525
IEEE Trans Med Imaging. 2002 Aug;21(8):953-65
12472268
Methods Inf Med. 2004;43(4):354-61
15472746
J Biomed Inform. 2011 Feb;44(1):118-25
20837160
J Digit Imaging. 2012 Feb;25(1):121-8
21547518
Radiology. 2010 Jul;256(1):243-52
20505065
J Biomed Inform. 2014 Jun;49:227-44
24632078
Med Image Comput Comput Assist Interv. 2010;13(Pt 2):177-84
20879313
IEEE Trans Pattern Anal Mach Intell. 2008 Apr;30(4):712-27
18276975
IEEE Trans Med Imaging. 2014 Aug;33(8):1669-76
24808406
Med Image Anal. 2014 Jul;18(5):808-18
24858570
IEEE Trans Inf Technol Biomed. 2012 May;16(3):348-55
22389157
Med Image Comput Comput Assist Interv. 2010;13(Pt 3):626-33
20879453
Conf Proc IEEE Eng Med Biol Soc. 2011;2011:7009-12
22255952
Med Image Anal. 2012 Oct;16(7):1415-22
22717411
J Digit Imaging. 2013 Dec;26(6):1025-39
23846532
Magn Reson Imaging. 2012 Nov;30(9):1323-41
22770690
Med Image Anal. 2013 Jan;17(1):78-100
23085199
Int J Med Inform. 2004 Feb;73(1):1-23
15036075
Med Image Comput Comput Assist Interv. 2013;16(Pt 2):303-10
24579154
IEEE Trans Med Imaging. 2004 Oct;23 (10 ):1233-44
15493691
J Magn Reson Imaging. 2008 Apr;27(4):685-91
18302232
Med Image Anal. 2014 Oct;18(7):1082-100
25036769
Med Image Anal. 2011 Aug;15(4):460-76
21414833
IEEE Trans Pattern Anal Mach Intell. 2015 Apr;37(4):803-15
26353295
IEEE Trans Med Imaging. 2012 Jun;31(6):1276-88
22353403
IEEE Trans Biomed Eng. 2015 Feb;62(2):783-92
25361497
IEEE Trans Med Imaging. 2015 Feb;34(2):496-506
25314696