Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Francesca Manni, Chuchen Cai, Fons van der Sommen, Sveta Zinger, Caifeng Shan, Erik Edström, Adrian Elmi-Terander, Himar Fabelo, Samuel Ortega, Gustavo Marrero Callicó , Peter H.N. de With

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Surgery is a crucial treatment for malignant brain tumors where gross total resection improves the prognosis. Tissue samples taken during surgery are either subject to a preliminary intraoperative histological analysis, or sent for a full pathological evaluation which can take days or weeks. Whereas a lengthy complete pathological analysis includes an array of techniques to be executed, a preliminary tissue analysis on frozen tissue is performed as quickly as possible (30-45 minutes on average) to provide fast feedback to the surgeon during the surgery. The surgeon uses the information to confirm that the resected tissue is indeed tumor and may, at least in theory, initiate repeated biopsies to help achieve gross total resection. However, due to the total turn-around time of the tissue inspection for repeated analyses, this approach may not be feasible during a single surgery. In this context, intraoperative image-guided techniques can improve the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the potential to extract combined spectral-spatial information. By exploiting HSI for human brain-tissue classification in 13 in-vivo hyperspectral images from 9 patients, a brain-tissue classifier is developed. The framework consists of a hybrid 3D-2D CNN-based approach and a band-selection step to enhance the capability of extracting both spectral and spatial information from the hyperspectral images. An overall accuracy of 77% was found when tumor, normal and hyper-vascularized tissue are classified, which clearly outperforms the state-of-the-art approaches (SVM, 2D-CNN). These results may open an attractive future perspective for intraoperative brain-tumor classification using HSI.
Original languageEnglish
Title of host publicationMedical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling; (2021)
PublisherSPIE
Number of pages9
DOIs
Publication statusPublished - 15 Feb 2021
Event2021 SPIE Medical Imaging: Image-Guided Procedures, Robotic Interventions, and Modeling -
Duration: 15 Feb 202119 Feb 2021

Publication series

NameProceedings of SPIE
Volume11598

Conference

Conference2021 SPIE Medical Imaging
Period15/02/2119/02/21

Keywords

  • Hyperspectral imaging
  • 3D-2D convolutional neural network (CNN)
  • ant colony optimization
  • malignant brain tumor

Fingerprint Dive into the research topics of 'Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach'. Together they form a unique fingerprint.

Cite this