Diffusion MRI microstructure models with in vivo human brain Connectome data: results from a multi-group comparison
Journal article, 2017

A large number of mathematical models have been proposed to describe the measured signal in diffusion-weighted (DW) magnetic resonance imaging (MRI). However, model comparison to date focuses only on specific subclasses, e.g. compartment models or signal models, and little or no information is available in the literature on how performance varies among the different types of models. To address this deficiency, we organized the White Matter Modeling Challenge' during the International Symposium on Biomedical Imaging (ISBI) 2015 conference. This competition aimed to compare a range of different kinds of models in their ability to explain a large range of measurable in vivo DW human brain data. Specifically, we assessed the ability of models to predict the DW signal accurately for new diffusion gradients and b values. We did not evaluate the accuracy of estimated model parameters, as a ground truth is hard to obtain. We used the Connectome scanner at the Massachusetts General Hospital, using gradient strengths of up to 300mT/m and a broad set of diffusion times. We focused on assessing the DW signal prediction in two regions: the genu in the corpus callosum, where the fibres are relatively straight and parallel, and the fornix, where the configuration of fibres is more complex. The challenge participants had access to three-quarters of the dataset and their models were ranked on their ability to predict the remaining unseen quarter of the data. The challenge provided a unique opportunity for a quantitative comparison of diverse methods from multiple groups worldwide. The comparison of the challenge entries reveals interesting trends that could potentially influence the next generation of diffusion-based quantitative MRI techniques. The first is that signal models do not necessarily outperform tissue models; in fact, of those tested, tissue models rank highest on average. The second is that assuming a non-Gaussian (rather than purely Gaussian) noise model provides little improvement in prediction of unseen data, although it is possible that this may still have a beneficial effect on estimated parameter values. The third is that preprocessing the training data, here by omitting signal outliers, and using signal-predicting strategies, such as bootstrapping or cross-validation, could benefit the model fitting. The analysis in this study provides a benchmark for other models and the data remain available to build up a more complete comparison in the future.

diffusion MRI


brain microstructure


model selection



U. Ferizi

University College London (UCL)

New York University

B. Scherrer

Harvard University

T. Schneider

University College London (UCL)

Philips Medical Systems Nederland

Mohammad Alipoor

Chalmers, Signals and Systems, Signal Processing and Biomedical Engineering, Signal Processing

O. Eufracio

National Council for Science and Technology Mexico

R. H. J. Fick

INRIA Sophia Antipolis

R. Deriche

INRIA Sophia Antipolis

M. Nilsson

Lund University

A. K. Loya-Olivas

National Council for Science and Technology Mexico

M. Rivera

National Council for Science and Technology Mexico

D. H. J. Poot

Delft University of Technology

A. Ramirez-Manzanares

National Council for Science and Technology Mexico

J. L. Marroquin

National Council for Science and Technology Mexico

A. Rokem

University of Washington

Stanford University

C. Potter

Stanford University

R. F. Dougherty

Stanford University

K. Sakaie

Cleveland Clinic Foundation

C. Wheeler-Kingshott

University College London (UCL)

S. K. Warfield

Harvard University

T. Witzel

Harvard University

L. L. Wald

Harvard University

J. G. Raya

New York University

D. C. Alexander

University College London (UCL)

NMR in Biomedicine

0952-3480 (ISSN) 1099-1492 (eISSN)

Vol. 30 9 Article no e3734 -

Subject Categories

Medical Engineering



More information

Latest update