Multi-Stream Multi-Scale Deep Convolutional Networks for Alzheimer's Disease Detection using MR Images

Journal article, 2019

This paper addresses the issue of Alzheimer's disease (AD) detection from Magnetic Resonance Images (MRIs). Existing AD detection methods rely
on global feature learning from the whole brain scans, while depending on the tissue types, AD related features in dierent tissue regions, e.g. grey
matter (GM), white matter (WM), and cerebrospinal  uid (CSF), show different characteristics. In this paper, we propose a deep learning method for multi-scale feature learning based on segmented tissue areas. A novel deep 3D multi-scale convolutional network scheme is proposed to generate multi-resolution features for AD detection. The proposed scheme employs several parallel 3D multi-scale convolutional networks, each applying to individual
tissue regions (GM, WM and CSF) followed by feature fusions. The proposed fusion is applied in two separate levels: the rst level fusion is applied on different scales within the same tissue region, and the second level is on dierent tissue regions. To further reduce the dimensions of features and mitigate overtting, a feature boosting and dimension reduction method, XGBoost, is utilized before the classication. The proposed deep learning scheme has been tested on a moderate open dataset of ADNI (1198 scans from 337 subjects), with excellent test performance on randomly partitioned datasets (best 99.67%, average 98.29%), and good test performance on subject-separated partitioned datasets (best 94.74%, average 89.51%). Comparisons with state-of-the-art methods are also included.