CLFT: Camera-LiDAR Fusion Transformer for Semantic Segmentation in Autonomous Driving

arXiv:2404.17793v1 Announce Type: new
Abstract: Critical research about camera-and-LiDAR-based semantic object segmentation for autonomous driving significantly benefited from the recent development of deep learning. Specifically, the vision transformer is the novel ground-breaker that successfully brought the multi-head-attention mechanism to computer vision applications. Therefore, we propose a vision-transformer-based network to carry out camera-LiDAR fusion for semantic segmentation applied to autonomous driving. Our proposal uses the novel progressive-assemble strategy of vision transformers on a double-direction network and then integrates the results in …

abstract applications arxiv attention autonomous autonomous driving breaker computer computer vision cs.cv cs.ro deep learning development driving fusion head lidar multi-head network novel object research segmentation semantic transformer type vision vision-transformer