Multispectral image analysis for patient tissue tracking during complex interventions

F. Manni; M. Mamprin; S. Zinger; C. Shan; R. Holthuizen; P.H.N. de With

doi:10.1109/ICIP.2018.8451263

Multispectral image analysis for patient tissue tracking during complex interventions

F. Manni, M. Mamprin, S. Zinger, C. Shan, R. Holthuizen, P.H.N. de With

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

5 Citations (Scopus)

Abstract

During complex interventions, patient tracking is needed for optimal motion compensation, in order to guide the physician in a minimally invasive way. Nowadays, optical tracking systems are used for tracking of markers. Despite the unobtrusiveness of this technology, the approach is cumbersome because it requires manual placement of markers, which can alter during the operations due to the presence of liquids. To improve the clinical workflow, a new feature tracking algorithm is designed, involving feature detection and tracking without optical markers. The new markers are created with the multispectral imaging. Maximally stable extremal regions (MSER) and Speeded Up Robust Feature (SURF) methods are applied to design features and track natural landmarks, e.g. moles and veins. Both methods are tested and compared in accuracy with the mean shift tracking method. SURF reaches the highest accuracy of 0.257 pixels for images at 430 nm and 0.562 pixels for images at 970 nm. This study shows that incorporating multispectral imaging in the surgical scenario leads to an attractive benefit minimizing the risk of marker obstruction and displacement.

Original language	English
Title of host publication	2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings
Place of Publication	Piscataway
Publisher	Institute of Electrical and Electronics Engineers
Pages	3149-3153
Number of pages	5
ISBN (Electronic)	9781479970612
ISBN (Print)	978-1-4799-7061-2
DOIs	https://doi.org/10.1109/ICIP.2018.8451263
Publication status	Published - 11 Oct 2018
Event	25th IEEE International Conference on Image Processing, ICIP 2018 - Megaron Athens International Conference Centre, Athens, Greece Duration: 7 Oct 2018 → 10 Oct 2018 Conference number: 25 http://athenscvb.gr/en/content/25-international-conference-image-processing-icip-2018

Conference

Conference	25th IEEE International Conference on Image Processing, ICIP 2018
Abbreviated title	ICIP 2018
Country/Territory	Greece
City	Athens
Period	7/10/18 → 10/10/18
Internet address	http://athenscvb.gr/en/content/25-international-conference-image-processing-icip-2018

Keywords

Multispectral imaging
tissue tracking
biomedical optical imaging
minimally invasive surgery
Biomedical optical imaging
Minimally invasive surgery
Tissue tracking

Access to Document

10.1109/ICIP.2018.8451263

Cite this

Manni, F., Mamprin, M., Zinger, S., Shan, C., Holthuizen, R., & de With, P. H. N. (2018). Multispectral image analysis for patient tissue tracking during complex interventions. In 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings (pp. 3149-3153). Article 8451263 Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICIP.2018.8451263

@inproceedings{eee400ba5c45496180bbd6cc37a94444,

title = "Multispectral image analysis for patient tissue tracking during complex interventions",

abstract = "During complex interventions, patient tracking is needed for optimal motion compensation, in order to guide the physician in a minimally invasive way. Nowadays, optical tracking systems are used for tracking of markers. Despite the unobtrusiveness of this technology, the approach is cumbersome because it requires manual placement of markers, which can alter during the operations due to the presence of liquids. To improve the clinical workflow, a new feature tracking algorithm is designed, involving feature detection and tracking without optical markers. The new markers are created with the multispectral imaging. Maximally stable extremal regions (MSER) and Speeded Up Robust Feature (SURF) methods are applied to design features and track natural landmarks, e.g. moles and veins. Both methods are tested and compared in accuracy with the mean shift tracking method. SURF reaches the highest accuracy of 0.257 pixels for images at 430 nm and 0.562 pixels for images at 970 nm. This study shows that incorporating multispectral imaging in the surgical scenario leads to an attractive benefit minimizing the risk of marker obstruction and displacement.",

keywords = "Multispectral imaging, tissue tracking, biomedical optical imaging, minimally invasive surgery, Biomedical optical imaging, Minimally invasive surgery, Tissue tracking",

author = "F. Manni and M. Mamprin and S. Zinger and C. Shan and R. Holthuizen and {de With}, P.H.N.",

year = "2018",

month = oct,

day = "11",

doi = "10.1109/ICIP.2018.8451263",

language = "English",

isbn = "978-1-4799-7061-2",

pages = "3149--3153",

booktitle = "2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers",

address = "United States",

note = "25th IEEE International Conference on Image Processing, ICIP 2018, ICIP 2018 ; Conference date: 07-10-2018 Through 10-10-2018",

url = "http://athenscvb.gr/en/content/25-international-conference-image-processing-icip-2018",

}

Manni, F , Mamprin, M , Zinger, S, Shan, C, Holthuizen, R & de With, PHN 2018, Multispectral image analysis for patient tissue tracking during complex interventions. in 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings., 8451263, Institute of Electrical and Electronics Engineers, Piscataway, pp. 3149-3153, 25th IEEE International Conference on Image Processing, ICIP 2018, Athens, Greece, 7/10/18. https://doi.org/10.1109/ICIP.2018.8451263

Multispectral image analysis for patient tissue tracking during complex interventions. / Manni, F.; Mamprin, M.; Zinger, S. et al.
2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings. Piscataway: Institute of Electrical and Electronics Engineers, 2018. p. 3149-3153 8451263.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Multispectral image analysis for patient tissue tracking during complex interventions

AU - Manni, F.

AU - Mamprin, M.

AU - Zinger, S.

AU - Shan, C.

AU - Holthuizen, R.

AU - de With, P.H.N.

N1 - Conference code: 25

PY - 2018/10/11

Y1 - 2018/10/11

N2 - During complex interventions, patient tracking is needed for optimal motion compensation, in order to guide the physician in a minimally invasive way. Nowadays, optical tracking systems are used for tracking of markers. Despite the unobtrusiveness of this technology, the approach is cumbersome because it requires manual placement of markers, which can alter during the operations due to the presence of liquids. To improve the clinical workflow, a new feature tracking algorithm is designed, involving feature detection and tracking without optical markers. The new markers are created with the multispectral imaging. Maximally stable extremal regions (MSER) and Speeded Up Robust Feature (SURF) methods are applied to design features and track natural landmarks, e.g. moles and veins. Both methods are tested and compared in accuracy with the mean shift tracking method. SURF reaches the highest accuracy of 0.257 pixels for images at 430 nm and 0.562 pixels for images at 970 nm. This study shows that incorporating multispectral imaging in the surgical scenario leads to an attractive benefit minimizing the risk of marker obstruction and displacement.

AB - During complex interventions, patient tracking is needed for optimal motion compensation, in order to guide the physician in a minimally invasive way. Nowadays, optical tracking systems are used for tracking of markers. Despite the unobtrusiveness of this technology, the approach is cumbersome because it requires manual placement of markers, which can alter during the operations due to the presence of liquids. To improve the clinical workflow, a new feature tracking algorithm is designed, involving feature detection and tracking without optical markers. The new markers are created with the multispectral imaging. Maximally stable extremal regions (MSER) and Speeded Up Robust Feature (SURF) methods are applied to design features and track natural landmarks, e.g. moles and veins. Both methods are tested and compared in accuracy with the mean shift tracking method. SURF reaches the highest accuracy of 0.257 pixels for images at 430 nm and 0.562 pixels for images at 970 nm. This study shows that incorporating multispectral imaging in the surgical scenario leads to an attractive benefit minimizing the risk of marker obstruction and displacement.

KW - Multispectral imaging

KW - tissue tracking

KW - biomedical optical imaging

KW - minimally invasive surgery

KW - Biomedical optical imaging

KW - Minimally invasive surgery

KW - Tissue tracking

UR - http://www.scopus.com/inward/record.url?scp=85062919141&partnerID=8YFLogxK

U2 - 10.1109/ICIP.2018.8451263

DO - 10.1109/ICIP.2018.8451263

M3 - Conference contribution

SN - 978-1-4799-7061-2

SP - 3149

EP - 3153

BT - 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings

PB - Institute of Electrical and Electronics Engineers

CY - Piscataway

T2 - 25th IEEE International Conference on Image Processing, ICIP 2018

Y2 - 7 October 2018 through 10 October 2018

ER -

Multispectral image analysis for patient tissue tracking during complex interventions

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this