Tissue segmentation in volumetric laser endomicroscopy data using FusionNet and a domain-specific loss function

Joost van der Putten, Fons van der Sommen, Maarten Struyvenberg, Jeroen de Groof, Wouter Curvers, Erik Schoon, Jacques J.G.H.M. Bergman, Peter H.N. de With

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

8 Citations (Scopus)


Volumetric Laser Endomicroscopy (VLE) is a promising balloon-based imaging technique for detecting early neoplasia in Barretts Esophagus. Especially Computer Aided Detection (CAD) techniques show great promise compared to medical doctors, who cannot reliably find disease patterns in the noisy VLE signal. However, an essential pre-processing step for the CAD system is tissue segmentation. At present, tissue is segmented manually but is not scalable for the entire VLE scan consisting of 1,200 frames of 4,096 × 2,048 pixels. Furthermore, the current CAD methods cannot use the VLE scans to their full potential, as only a small segment of the esophagus is selected for further processing, while an automated segmentation system results in significantly more available data. This paper explores the possibility of automatically segmenting relevant tissue for VLE scans using FusionNet and a domain-specific loss function. The contribution of this work is threefold. First, we propose a tissue segmentation algorithm for VLE scans. Second, we introduce a weighted ground truth that exploits the signal-to-noise ratio characteristics of the VLE data. Third, we compare our algorithm segmentation against two additional VLE experts. The results show that our algorithm annotations are indistinguishable from the expert annotations and therefore the algorithm can be used as a preprocessing step for further classification of the tissue.

Original languageEnglish
Title of host publicationProgress in Biomedical Optics and Imaging
EditorsElsa D. Angelini, Elsa D. Angelini, Elsa D. Angelini, Bennett A. Landman
Number of pages7
ISBN (Electronic)9781510625457
Publication statusPublished - 2019
EventSPIE Medical Imaging 2019 - San Diego, United States
Duration: 16 Feb 201921 Feb 2019

Publication series

NameProceedings of SPIE
ISSN (Print)0277-786X


ConferenceSPIE Medical Imaging 2019
Country/TerritoryUnited States
CitySan Diego


  • Barrett's Esophagus
  • CAD
  • Cancer detection
  • Deep learning
  • VLE


Dive into the research topics of 'Tissue segmentation in volumetric laser endomicroscopy data using FusionNet and a domain-specific loss function'. Together they form a unique fingerprint.

Cite this