Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Francesca Manni, Chuchen Cai, Fons van der Sommen, Sveta Zinger, Caifeng Shan, Erik Edström, Adrian Elmi-Terander, Himar Fabelo, Samuel Ortega, Gustavo Marrero Callicó , Peter H.N. de With

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review


Surgery is a crucial treatment for malignant brain tumors where gross total resection improves the prognosis. Tissue samples taken during surgery are either subject to a preliminary intraoperative histological analysis, or sent for a full pathological evaluation which can take days or weeks. Whereas a lengthy complete pathological analysis includes an array of techniques to be executed, a preliminary tissue analysis on frozen tissue is performed as quickly as possible (30-45 minutes on average) to provide fast feedback to the surgeon during the surgery. The surgeon uses the information to confirm that the resected tissue is indeed tumor and may, at least in theory, initiate repeated biopsies to help achieve gross total resection. However, due to the total turn-around time of the tissue inspection for repeated analyses, this approach may not be feasible during a single surgery. In this context, intraoperative image-guided techniques can improve the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the potential to extract combined spectral-spatial information. By exploiting HSI for human brain-tissue classification in 13 in-vivo hyperspectral images from 9 patients, a brain-tissue classifier is developed. The framework consists of a hybrid 3D-2D CNN-based approach and a band-selection step to enhance the capability of extracting both spectral and spatial information from the hyperspectral images. An overall accuracy of 77% was found when tumor, normal and hyper-vascularized tissue are classified, which clearly outperforms the state-of-the-art approaches (SVM, 2D-CNN). These results may open an attractive future perspective for intraoperative brain-tumor classification using HSI.
Originele taal-2Engels
TitelMedical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling; (2021)
Aantal pagina's9
StatusGepubliceerd - 15 feb 2021
Evenement2021 SPIE Medical Imaging: Image-Guided Procedures, Robotic Interventions, and Modeling -
Duur: 15 feb 202119 feb 2021

Publicatie series

NaamProceedings of SPIE


Congres2021 SPIE Medical Imaging

Vingerafdruk Duik in de onderzoeksthema's van 'Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach'. Samen vormen ze een unieke vingerafdruk.

Citeer dit