MRBrainS challenge online evaluation framework for brain image segmentation in 3T MRI scans

A.M. Mendrik, K.L. Vincken, H.J. Kuijf, M. Breeuwer, W.H. Bouvy, J. de Bresser, A. Alansary, M. de Bruijne, Aaron Carass, A. El-Baz, A. Jog, R. Katyal, A.R. Khan, F. van der Lijn, Q. Mahmood, R. Mukherjee, A. van Opbroek, S. Paneri, S. Pereira, M. PerssonM. Rajchl, D. Sarikaya, Ö. Smedby, C.A. Silva, H.A. Vrooman, S. Vyas, C. Wang, L. Zhao, G.J. Biessels, M.A. Viergever

Research output: Contribution to journalArticleAcademicpeer-review

173 Citations (Scopus)
227 Downloads (Pure)


Many methods have been proposed for tissue segmentation in brain MRI scans. The multitude of methods proposed complicates the choice of one method above others. We have therefore established the MRBrainS online evaluation framework for evaluating (semi)automatic algorithms that segment gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) on 3T brain MRI scans of elderly subjects (65-80 y). Participants apply their algorithms to the provided data, after which their results are evaluated and ranked. Full manual segmentations of GM, WM, and CSF are available for all scans and used as the reference standard. Five datasets are provided for training and fifteen for testing. The evaluated methods are ranked based on their overall performance to segment GM, WM, and CSF and evaluated using three evaluation metrics (Dice, H95, and AVD) and the results are published on the MRBrainS13 website. We present the results of eleven segmentation algorithms that participated in the MRBrainS13 challenge workshop at MICCAI, where the framework was launched, and three commonly used freeware packages: FreeSurfer, FSL, and SPM. The MRBrainS evaluation framework provides an objective and direct comparison of all evaluated algorithms and can aid in selecting the best performing method for the segmentation goal at hand.

Original languageEnglish
Article number813696
Pages (from-to)1-16
JournalComputational Intelligence and Neuroscience
Publication statusPublished - 2015


Dive into the research topics of 'MRBrainS challenge online evaluation framework for brain image segmentation in 3T MRI scans'. Together they form a unique fingerprint.

Cite this