title: Template-Based Multimodal Joint Generative Model of Brain Data.
abstract: The advent of large of multi-modal imaging databases opens up the opportunity to learn how local intensity patterns covariate between multiple modalities. These models can then be used to describe expected intensities in an unseen image modalities given one or multiple observations, or to detect deviations (e.g. pathology) from the expected intensity patterns. In this work, we propose a template-based multi-modal generative mixture-model of imaging data and apply it to the problems of inlier/outlier pattern classification and image synthesis. Results on synthetic and patient data demonstrate that the proposed method is able to synthesise unseen data and accurately localise pathological regions, even in the presence of large abnormalities. It also demonstrates that the proposed model can provide accurate and uncertainty-aware intensity estimates of expected imaging patterns.
authors.forename: M Jorge
authors.initials: MJ
authors.lastname: Cardoso
authors.forename: Carole H
authors.initials: CH
authors.lastname: Sudre
authors.forename: Marc
authors.initials: M
authors.lastname: Modat
authors.forename: Sebastien
authors.initials: S
authors.lastname: Ourselin
mesh_terms: D000465:Algorithms; D001921:Brain / Q000033:anatomy & histology*; D003198:Computer Simulation; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008279:Magnetic Resonance Imaging / Q000379:methods*; D008953:Models, Anatomic; D008959:Models, Neurological; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013382:Subtraction Technique