Multi-Stream Multi-Scale Deep Convolutional Networks for Alzheimer's Disease Detection using MR Images
Journal article, 2019

This paper addresses the issue of Alzheimer's disease (AD) detection from Magnetic Resonance Images (MRIs). Existing AD detection methods rely
on global feature learning from the whole brain scans, while depending on the tissue types, AD related features in di erent tissue regions, e.g. grey
matter (GM), white matter (WM), and cerebrospinal  uid (CSF), show different characteristics. In this paper, we propose a deep learning method for multi-scale feature learning based on segmented tissue areas. A novel deep 3D multi-scale convolutional network scheme is proposed to generate multi-resolution features for AD detection. The proposed scheme employs several parallel 3D multi-scale convolutional networks, each applying to individual
tissue regions (GM, WM and CSF) followed by feature fusions. The proposed fusion is applied in two separate levels: the rst level fusion is applied on different scales within the same tissue region, and the second level is on di erent tissue regions. To further reduce the dimensions of features and mitigate over tting, a feature boosting and dimension reduction method, XGBoost, is utilized before the classi cation. The proposed deep learning scheme has been tested on a moderate open dataset of ADNI (1198 scans from 337 subjects), with excellent test performance on randomly partitioned datasets (best 99.67%, average 98.29%), and good test performance on subject-separated partitioned datasets (best 94.74%, average 89.51%). Comparisons with state-of-the-art methods are also included.

deep learning

deep convolutional networks

tissue region

multi-scale feature learning

feature boosting and dimension reduction

Alzheimer's disease detection

MR images

feature fusion


Chenjie Ge

Chalmers, Electrical Engineering, Signalbehandling och medicinsk teknik, Signal Processing

Qixun Qu

Chalmers, Electrical Engineering

Irene Yu-Hua Gu

Chalmers, Electrical Engineering

Asgeir Store Jakola

University of Gothenburg


0925-2312 (ISSN)

Vol. 350 60-69

Areas of Advance

Life Science Engineering (2010-2018)

Subject Categories

Information Science


Radiology, Nuclear Medicine and Medical Imaging

Computer Vision and Robotics (Autonomous Systems)

Medical Image Processing



More information

Latest update

7/8/2019 1