title: Modality propagation: coherent synthesis of subject-specific scans with data-driven regularization.
abstract: We propose a general database-driven framework for coherent synthesis of subject-specific scans of desired modality, which adopts and generalizes the patch-based label propagation (LP) strategy. While modality synthesis has received increased attention lately, current methods are mainly tailored to specific applications. On the other hand, the LP framework has been extremely successful for certain segmentation tasks, however, so far it has not been used for estimation of entities other than categorical segmentation labels. We approach the synthesis task as a modality propagation, and demonstrate that with certain modifications the LP framework can be generalized to continuous settings providing coherent synthesis of different modalities, beyond segmentation labels. To achieve high-quality estimates we introduce a new data-driven regularization scheme, in which we integrate intermediate estimates within an iterative search-and-synthesis strategy. To efficiently leverage population data and ensure coherent synthesis, we employ a spatio-population search space restriction. In experiments, we demonstrate the quality of synthesis of different MRI signals (T2 and DTI-FA) from a T1 input, and show a novel application of modality synthesis for abnormality detection in multi-channel MRI of brain tumor patients.
authors: Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA.
authors: Dong Hye
authors: DH
authors: Ye
authors: Microsoft Research, Cambridge, UK.
authors: Darko
authors: D
authors: Zikic
authors: Microsoft Research, Cambridge, UK.
authors: Ben
authors: B
authors: Glocker
authors: Microsoft Research, Cambridge, UK.
authors: Antonio
authors: A
authors: Criminisi
authors: Martinos Center for Biomedical Imaging, MGH, Harvard Medical School, MA, USA.
authors: Ender
authors: E
authors: Konukoglu
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D001932:Brain Neoplasms / Q000473:pathology*; D006801:Humans; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008279:Magnetic Resonance Imaging / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity