Learning Optical Flow and Scene Flow with Bidirectional Camera-LiDAR Fusion

arXiv:2303.12017v2 Announce Type: replace
Abstract: In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and 3D information in an ``early-fusion'' or ``late-fusion'' manner. Such one-size-fits-all approaches suffer from a dilemma of failing to fully utilize the characteristic of each modality or to maximize the inter-modality complementarity. To address the …

arxiv cs.cv flow fusion lidar optical optical flow type