3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients.
High-grade glioma is the most aggressive and severe brain tumor that leads to death of almost 50% patients in 1-2 years. Thus, accurate prognosis for glioma patients would provide essential guidelines for their treatment planning. Conventional survival prediction generally utilizes clinical information and limited handcrafted features from magnetic resonance images (MRI), which is often time consuming, laborious and subjective. In this paper, we propose using deep learning frameworks to automatically extract features from multi-modal preoperative brain images (i.e., T1 MRI, fMRI and DTI) of high-grade glioma patients. Specifically, we adopt 3D convolutional neural networks (CNNs) and also propose a new network architecture for using multi-channel data and learning supervised features. Along with the pivotal clinical features, we finally train a support vector machine to predict if the patient has a long or short overall survival (OS) time. Experimental results demonstrate that our methods can achieve an accuracy as high as 89.9% We also find that the learned features from fMRI and DTI play more important roles in accurately predicting the OS time, which provides valuable insights into functional neuro-oncological applications.
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA; Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, USA.
Dong
D
Nie
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA.
Han
H
Zhang
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA.
Ehsan
E
Adeli
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA.
Luyan
L
Liu
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA.
Dinggang
D
Shen
D000465:Algorithms; D001921:Brain / Q000000981:diagnostic imaging; D001932:Brain Neoplasms / Q000000981:diagnostic imaging* / Q000401:mortality / Q000473:pathology; D000077321:Deep Learning; D005910:Glioma / Q000000981:diagnostic imaging* / Q000401:mortality / Q000473:pathology; D006801:Humans; D008017:Life Expectancy; D008279:Magnetic Resonance Imaging / Q000379:methods*; D064847:Multimodal Imaging / Q000379:methods*; D060787:Neoplasm Grading; D016571:Neural Networks, Computer; D011379:Prognosis; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity