Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Francesca Manni, Chuchen Cai, Fons van der Sommen, Sveta Zinger, Caifeng Shan, Erik Edström, Adrian Elmi-Terander, Himar Fabelo, Samuel Ortega, Gustavo Marrero Callicó , Peter H.N. de With

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review


Surgery is a crucial treatment for malignant brain tumors where gross total resection improves the prognosis. Tissue samples taken during surgery are either subject to a preliminary intraoperative histological analysis, or sent for a full pathological evaluation which can take days or weeks. Whereas a lengthy complete pathological analysis includes an array of techniques to be executed, a preliminary tissue analysis on frozen tissue is performed as quickly as possible (30-45 minutes on average) to provide fast feedback to the surgeon during the surgery. The surgeon uses the information to confirm that the resected tissue is indeed tumor and may, at least in theory, initiate repeated biopsies to help achieve gross total resection. However, due to the total turn-around time of the tissue inspection for repeated analyses, this approach may not be feasible during a single surgery. In this context, intraoperative image-guided techniques can improve the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the potential to extract combined spectral-spatial information. By exploiting HSI for human brain-tissue classification in 13 in-vivo hyperspectral images from 9 patients, a brain-tissue classifier is developed. The framework consists of a hybrid 3D-2D CNN-based approach and a band-selection step to enhance the capability of extracting both spectral and spatial information from the hyperspectral images. An overall accuracy of 77% was found when tumor, normal and hyper-vascularized tissue are classified, which clearly outperforms the state-of-the-art approaches (SVM, 2D-CNN). These results may open an attractive future perspective for intraoperative brain-tumor classification using HSI.
Original languageEnglish
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage-Guided Procedures, Robotic Interventions, and Modeling
EditorsCristian A. Linte, Jeffrey H. Siewerdsen
Number of pages9
ISBN (Electronic)9781510640252
Publication statusPublished - 15 Feb 2021
EventSPIE Medical Imaging 2021 - Online, United States
Duration: 15 Feb 202119 Feb 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceSPIE Medical Imaging 2021
Country/TerritoryUnited States


  • 3D-2D convolutional neural network (CNN)
  • Ant colony optimization
  • Hyperspectral imaging
  • Malignant brain tumor


Dive into the research topics of 'Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach'. Together they form a unique fingerprint.

Cite this