M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving

arXiv:2403.12552v1 Announce Type: new
Abstract: End-to-end autonomous driving has witnessed remarkable progress. However, the extensive deployment of autonomous vehicles has yet to be realized, primarily due to 1) inefficient multi-modal environment perception: how to integrate data from multi-modal sensors more efficiently; 2) non-human-like scene understanding: how to effectively locate and predict critical risky agents in traffic scenarios like an experienced driver. To overcome these challenges, in this paper, we propose a Multi-Modal fusion transformer incorporating Driver Attention (M2DA) for autonomous …

arxiv attention autonomous autonomous driving cs.ai cs.cv cs.ro driver driving fusion modal multi-modal transformer type