Learn from IoT: pedestrian detection and intention prediction for autonomous driving

Gürkan Solmaz, Everton Luís Berz, Marzieh Farahani Dolatabadi, Samet Aytaç, Jonathan Fürst, Bin Cheng, Jos den Ouden

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

Samenvatting

This paper explores the potential of machine learning (ML) systems which use data from in-vehicle sensors as well as external IoT data sources to enhance autonomous driving for efficiency and safety in urban environments. We propose a system which combines sensor data from autonomous vehicles and IoT data collected from pedestrians' mobile devices. Our approach includes two methods for vulnerable road user (VRU) detection and pedestrian movement intention prediction, and a model to combine the two outputs for potentially improving the autonomous decision-making. The first method creates a world model (WM) and accurately localizes VRUs using in-vehicle cameras and external mobile device data. The second method is a deep learning model to predict pedestrian's next movement steps using real-time trajectory and training with historical mobile device data. To test the system, we conduct three pilot tests at a university campus with a custom-built autonomous car and mobile devices carried by pedestrians. The results from our controlled experiments show that VRU detection can more accurately distinguish locations of pedestrians using IoT data. Furthermore, up to five future steps of pedestrians can be predicted within 2 m.
Originele taal-2Engels
TitelSMAS 2019 - Proceedings of the 1st ACM Workshop on Emerging Smart Technologies and Infrastructures for Smart Mobility and Sustainability, co-located with MobiCom 2019
Plaats van productieNew York
UitgeverijACM/IEEE
Pagina's27-32
Aantal pagina's6
ISBN van elektronische versie978-1-4503-6930-5
DOI's
StatusGepubliceerd - 4 okt 2019
EvenementSMAS '19 1st ACM Workshop on Emerging Smart Technologies and Infrastructures for Smart Mobility and Sustainability - Los Cabos, Mexico
Duur: 21 okt 201921 okt 2019

Congres

CongresSMAS '19 1st ACM Workshop on Emerging Smart Technologies and Infrastructures for Smart Mobility and Sustainability
LandMexico
StadLos Cabos
Periode21/10/1921/10/19

    Vingerafdruk

Citeer dit

Solmaz, G., Berz, E. L., Dolatabadi, M. F., Aytaç, S., Fürst, J., Cheng, B., & Ouden, J. D. (2019). Learn from IoT: pedestrian detection and intention prediction for autonomous driving. In SMAS 2019 - Proceedings of the 1st ACM Workshop on Emerging Smart Technologies and Infrastructures for Smart Mobility and Sustainability, co-located with MobiCom 2019 (blz. 27-32). New York: ACM/IEEE. https://doi.org/10.1145/3349622.3355446