Late Fusion U-Net with GAN-Based Augmentation for Generalizable Cardiac MRI Segmentation

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

6 Citations (Scopus)
5 Downloads (Pure)

Abstract

Accurate segmentation of the right ventricle (RV) in cardiac magnetic resonance (CMR) images is crucial for ventricular structure and function assessment. However, due to its variable anatomy and ill-defined borders, RV segmentation remains an open problem. While recent advances in deep learning show great promise in tackling these challenges, such methods are typically developed on homogeneous data-sets, not reflecting realistic clinical variation in image acquisition and pathology. In this work, we develop a model, aimed at segmenting all three cardiac structures in a multi-center, multi-disease and multi-view setting, using data provided by the M&Ms-2 challenge. We propose a pipeline addressing various aspects of segmenting heterogeneous data, consisting of heart region detection, augmentation through image synthesis and multi-fusion segmentation. Our extensive experiments demonstrate the importance of different elements of the pipeline, achieving competitive results for RV segmentation in both short-axis and long-axis MR images.

Original languageEnglish
Title of host publicationStatistical Atlases and Computational Models of the Heart. Multi-Disease, Multi-View, and Multi-Center Right Ventricular Segmentation in Cardiac MRI Challenge
Subtitle of host publication12th International Workshop, STACOM 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Revised Selected Papers
EditorsEsther Puyol Antón, Mihaela Pop, Carlos Martín-Isla, Maxime Sermesant, Avan Suinesiaputra, Oscar Camara, Karim Lekadir, Alistair Young
Place of PublicationCham
PublisherSpringer
Chapter39
Pages360-373
Number of pages14
ISBN (Electronic)978-3-030-93722-5
ISBN (Print)978-3-030-93721-8
DOIs
Publication statusPublished - 2022
Event12th International Workshop on Statistical Atlases and Computational Models of the Heart, STACOM 2021 held in conjunction with MICCAI 2021 - Strasbourg, France
Duration: 27 Sept 202127 Sept 2021

Publication series

NameLecture Notes in Computer Science (LNCS)
PublisherSpringer
Volume13131
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349
NameImage Processing, Computer Vision, Pattern Recognition, and Graphics (LNIP)
Volume13131

Conference

Conference12th International Workshop on Statistical Atlases and Computational Models of the Heart, STACOM 2021 held in conjunction with MICCAI 2021
Country/TerritoryFrance
CityStrasbourg
Period27/09/2127/09/21

Funding

Acknowledgments. This research is a part of the openGTN project, supported by the European Union in the Marie Curie Innovative Training Networks (ITN) fellowship program under project No. 764465.

FundersFunder number
European Union's Horizon 2020 - Research and Innovation Framework Programme764465
European Commission

Keywords

  • Cardiac MR segmentation
  • Domain generalization
  • Late-fusion network
  • Medical image synthesis

Fingerprint

Dive into the research topics of 'Late Fusion U-Net with GAN-Based Augmentation for Generalizable Cardiac MRI Segmentation'. Together they form a unique fingerprint.

Cite this