title: Robust multimodal dictionary learning.
abstract: We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and refinements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration.
authors: University of North Carolina at Chapel Hill, NC, USA. tiancao@cs.unc.edu
authors: Tian
authors: T
authors: Cao
authors: University of North Carolina at Chapel Hill, NC, USA.
authors: Vladimir
authors: V
authors: Jojic
authors: University of Delaware, DE, USA.
authors: Shannon
authors: S
authors: Modla
authors: University of Delaware, DE, USA.
authors: Debbie
authors: D
authors: Powell
authors: Carl Zeiss Microscopy, LLC, USA.
authors: Kirk
authors: K
authors: Czymmek
authors: University of North Carolina at Chapel Hill, NC, USA.
authors: Marc
authors: M
authors: Niethammer
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D016208:Databases, Factual; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D064847:Multimodal Imaging / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D011873:Radiology Information Systems; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique