Machine Learning Methods for Image Analysis in Medical Applications, from Alzheimer's Disease, Brain Tumors, to Assisted Living
Doktorsavhandling, 2020

Healthcare has progressed greatly nowadays owing to technological advances, where machine learning plays an important role in processing and analyzing a large amount of medical data. This thesis investigates four healthcare-related issues (Alzheimer's disease detection, glioma classification, human fall detection, and obstacle avoidance in prosthetic vision), where the underlying methodologies are associated with machine learning and computer vision. For Alzheimer’s disease (AD) diagnosis, apart from symptoms of patients, Magnetic Resonance Images (MRIs) also play an important role. Inspired by the success of deep learning, a new multi-stream multi-scale Convolutional Neural Network (CNN) architecture is proposed for AD detection from MRIs, where AD features are characterized in both the tissue level and the scale level for improved feature learning. Good classification performance is obtained for AD/NC (normal control) classification with test accuracy 94.74%. In glioma subtype classification, biopsies are usually needed for determining different molecular-based glioma subtypes. We investigate non-invasive glioma subtype prediction from MRIs by using deep learning. A 2D multi-stream CNN architecture is used to learn the features of gliomas from multi-modal MRIs, where the training dataset is enlarged with synthetic brain MRIs generated by pairwise Generative Adversarial Networks (GANs). Test accuracy 88.82% has been achieved for IDH mutation (a molecular-based subtype) prediction. A new deep semi-supervised learning method is also proposed to tackle the problem of missing molecular-related labels in training datasets for improving the performance of glioma classification. In other two applications, we also address video-based human fall detection by using co-saliency-enhanced Recurrent Convolutional Networks (RCNs), as well as obstacle avoidance in prosthetic vision by characterizing obstacle-related video features using a Spiking Neural Network (SNN). These investigations can benefit future research, where artificial intelligence/deep learning may open a new way for real medical applications.

convolutional neural networks

Alzheimer's disease detection

machine learning

deep learning

fall detection

glioma subtype classification

generative adversarial networks

recurrent convolutional networks

spiking neural networks

visual prosthesis

semi-supervised learning

"Femman" 5430, floor 5, EDIT building, Hörsalsvägen 11
Opponent: Prof. Danica Kragic Jensfelt, Royal Institute of Technology (KTH), Sweden


Chenjie Ge

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

Multi-Stream Multi-Scale Deep Convolutional Networks for Alzheimer's Disease Detection using MR Images

Neurocomputing,; Vol. 350(2019)p. 60-69

Artikel i vetenskaplig tidskrift

Enlarged Training Dataset by Pairwise GANs for Molecular-Based Brain Tumor Classification

IEEE Access,; Vol. 8(2020)p. 22560-22570

Artikel i vetenskaplig tidskrift

Deep Learning and Multi-Sensor Fusion for Glioma Classification Using Multistream 2D Convolutional Networks

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS,; (2018)p. 5894-5897

Paper i proceeding

Deep semi-supervised learning for brain tumor classification

BMC Medical Imaging,; Vol. 20(2020)

Artikel i vetenskaplig tidskrift

Human fall detection using segment-level CNN features and sparse dictionary learning

IEEE International Workshop on Machine Learning for Signal Processing, MLSP,; (2017)p. 6-

Paper i proceeding

Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolutional Neural Networks

Internationa Research Journal of Engineering and Technology (IRJET),; Vol. 6(2019)p. 993-1000

Artikel i vetenskaplig tidskrift

Co-saliency detection via inter and intra saliency propagation

Signal Processing: Image Communication,; Vol. 44(2016)p. 69-83

Artikel i vetenskaplig tidskrift

A spiking neural network model for obstacle avoidance in simulated prosthetic vision

Information Sciences,; Vol. 399(2017)p. 30-42

Artikel i vetenskaplig tidskrift

This thesis investigates artificial intelligence and computer vision techniques with several healthcare-related applications. Among these applications, two most important ones are Alzheimer's disease detection and brain tumor classification.

Alzheimer's disease (AD) is a neural disease that happens mostly in the elderly, and memory loss is its main symptom. We address AD detection since early treatment of AD patients can slow down the progression of AD and reduce the symptoms. An effective method for diagnosing AD has been developed using Magnetic Resonance Images (MRIs). To learn the “features” from normal subjects and AD patients, we have proposed a new “deep learning” method, which automatically learns the changes caused by AD in grey matter (GM), white matter (WM) and cerebrospinal fluid (CSF) regions. These changes in MRIs are used as the features to distinguish AD patients from normal subjects. Our test results from a trained machine system has reached the state-of-the-art performance with more than 90% of AD patients detected. More tests should be conducted in the near future on larger datasets for possible clinical usage.

Another important application is to predict molecular-level types of brain tumor, glioma. Glioma is one of the most common types of original brain tumors. Prediction of glioma subtypes in the molecular level can lead to better treatment strategies. Usually a biopsy is taken from the brain of a patient for determining the tumor subtypes. It is a rather risky step as extracting tissues might lead to the loss of some brain functions such as hearing and vision. Hence, the process is usually performed while a patient is kept fully awake. By exploring deep learning methods to learn the molecular-level glioma subtype information from patients using their MRIs and biopsy information, our proposed method is shown promising to predict the glioma subtype by purely using MRIs from a new patient, without requiring a biopsy. The performance is rather encouraging, and it has reached the state-of-the-art (accuracy over 85% for one subtype, IDH mutation/wild-type prediction) though far from ideal. Further improvement of prediction performance is needed by improving the methods and by using a much larger number of MRIs to train the machine. We hope some improved deep learning methods can, in the near future, provide medical doctors with better semi-automatic ways for diagnosing brain tumors non-invasively.

Research on key Methods on Semi-Supervised Machine Learning of Big Data, with Applications to Assisted-Living in Elderly, Traffic Safety and Medical Diagnosis

STINT (CH2015-6193), 2016-01-01 -- 2018-12-31.


Informations- och kommunikationsteknik




Datavetenskap (datalogi)

Radiologi och bildbehandling

Datorseende och robotik (autonoma system)


Innovation och entreprenörskap



Doktorsavhandlingar vid Chalmers tekniska högskola. Ny serie: 4789



"Femman" 5430, floor 5, EDIT building, Hörsalsvägen 11


Opponent: Prof. Danica Kragic Jensfelt, Royal Institute of Technology (KTH), Sweden

Mer information

Senast uppdaterat