Multi-Task Deep Learning for Pedestrian Detection, Action Recognition and Time to Cross Prediction - Institut National des Sciences Appliquées de Rouen Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2019

Multi-Task Deep Learning for Pedestrian Detection, Action Recognition and Time to Cross Prediction

Résumé

A pedestrian detection system is a crucial component of advanced driver assistance systems since it contributes to road flow safety. The safety of traffic participants could be significantly improved if these systems could also predict and recognize pedestrian’s actions, or even estimate the time, for each pedestrian, to cross the street. In this paper, we focus not only on pedestrian detection and pedestrian action recognition but also on estimating if the pedestrian’s action presents a risky situation according to time to cross the street. We propose 1) a pedestrian detection and action recognition component based, on RetinaNet; 2) an estimation of the time to cross the street for multiple pedestrians using a recurrent neural network. For each pedestrian, the recurrent network estimates the pedestrian’s action intention in order to predict the time to cross the street. We based our experiments on the JAAD dataset, and show that integrating multiple pedestrian action tags for the detection part when merge with a recurrent neural network (LSTM) allows a significant performance improvement.
Fichier principal
Vignette du fichier
Multi-Task_Deep_Learning_for_Pedestrian_Detection_Action_Recognition_and_Time_to_Cross_Prediction.pdf (1.86 Mo) Télécharger le fichier
Origine Publication financée par une institution
licence

Dates et versions

hal-02352800 , version 1 (23-05-2024)

Licence

Identifiants

Citer

Danut Ovidiu Pop, Alexandrina Rogozan, Clément Chatelain, Fawzi Nashashibi, Abdelaziz Bensrhair. Multi-Task Deep Learning for Pedestrian Detection, Action Recognition and Time to Cross Prediction. IEEE Access, 2019, 7, pp.149318-149327. ⟨10.1109/ACCESS.2019.2944792⟩. ⟨hal-02352800⟩
234 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More