Aircraft Marshaling Signals Dataset of FMCW Radar and Event-Based Camera for Sensor Fusion

Leon Müller, Manolis Sifalakis, Sherif Eissa, Amirreza Yousefzadeh, Paul Detterer, Sander Stuijk, Federico Corradi

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

2 Citaten (Scopus)


The advent of neural networks capable of learning salient features from radar data has expanded the breadth of radar applications, often as an alternative sensor or a complementary modality to camera vision. Gesture recognition for command control is the most commonly explored application. Nevertheless, more suitable benchmarking datasets are needed to assess and compare the merits of the different proposed solutions. Furthermore, most current publicly available radar datasets used in gesture recognition provide little diversity, do not provide access to raw ADC data, and are not significantly challenging. To address these shortcomings, we created and made available a new dataset that combines two synchronized modalities: radar and dynamic vision camera of 10 aircraft marshaling signals at several distances and angles, recorded from 13 people. Moreover, we propose a sparse encoding of the time domain (ADC) signals that achieve a dramatic data rate reduction (>76%) while retaining the efficacy of the downstream FFT processing (<2% accuracy loss on recognition tasks). Finally, we demonstrate early sensor fusion results based on compressed radar data encoding in range-Doppler maps with dynamic vision data. This approach achieves higher accuracy than either modality alone.
Originele taal-2Engels
TitelRadarConf23 - 2023 IEEE Radar Conference, Proceedings
UitgeverijInstitute of Electrical and Electronics Engineers
Aantal pagina's6
ISBN van elektronische versie978-1-6654-3669-4
StatusGepubliceerd - 21 jun. 2023
Evenement2023 IEEE Radar Conference (RadarConf23) - San Antonio, TX, USA
Duur: 1 mei 20235 mei 2023


Congres2023 IEEE Radar Conference (RadarConf23)


Duik in de onderzoeksthema's van 'Aircraft Marshaling Signals Dataset of FMCW Radar and Event-Based Camera for Sensor Fusion'. Samen vormen ze een unieke vingerafdruk.

Citeer dit