Automatic cardiac landmark localization by a recurrent neural network

Mike van Zon, Mitko Veta, Shuo Li

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

4 Citaten (Scopus)
2 Downloads (Pure)


Localization of cardiac anatomical landmarks is an important step towards a more robust and accurate analysis of the heart. A fully automatic hybrid framework is proposed that detects key landmark locations in cardiac magnetic resonance (MR) images. Our method is trained and evaluated for the detection of mitral valve points on long-axis MRI and RV insert points in short-axis MRI. The framework incorporates four key modules for the localization of the landmark points. The first module crops the MR image around the heart using a convolutional neural network (CNN). The second module employs a U-Net to obtain an efficient feature representation of the cardiac image, as well as detect a preliminary location of the landmark points. In the third module, the feature representation of a cardiac image is processed with a Recurrent Neural Network (RNN). The RNN leverages either spatial or temporal dynamics from neighboring slides in time or space and obtains a second prediction for the landmark locations. In the last module the two predictions from the U-Net and RNN are combined and final locations for the landmarks are extracted. The framework is separately trained and evaluated for the localization of each landmark, it achieves a final average error of 2.87 mm for the mitral valve points and an average error of 3.64 mm for the right ventricular insert points. Our method shows that the use of a recurrent neural network for the modeling of additional temporal or spatial dependencies improves localization accuracy and achieves promising results.

Originele taal-2Engels
TitelMedical Imaging 2019
SubtitelImage Processing
RedacteurenBennett A. Landman, Elsa D. Angelini
Plaats van productieBellingham
Aantal pagina's13
ISBN van elektronische versie9781510625457
StatusGepubliceerd - 1 jan. 2019
EvenementSPIE Medical Imaging 2019 - San Diego, Verenigde Staten van Amerika
Duur: 16 feb. 201921 feb. 2019

Publicatie series

NaamProceedings of SPIE


CongresSPIE Medical Imaging 2019
Land/RegioVerenigde Staten van Amerika
StadSan Diego


Duik in de onderzoeksthema's van 'Automatic cardiac landmark localization by a recurrent neural network'. Samen vormen ze een unieke vingerafdruk.

Citeer dit