OccFiner: Offboard Occupancy Refinement with Hybrid Propagation

arXiv:2403.08504v1 Announce Type: new
Abstract: Vision-based occupancy prediction, also known as 3D Semantic Scene Completion (SSC), presents a significant challenge in computer vision. Previous methods, confined to onboard processing, struggle with simultaneous geometric and semantic estimation, continuity across varying viewpoints, and single-view occlusion. Our paper introduces OccFiner, a novel offboard framework designed to enhance the accuracy of vision-based occupancy predictions. OccFiner operates in two hybrid phases: 1) a multi-to-multi local propagation network that implicitly aligns and processes multiple local frames …

abstract arxiv challenge computer computer vision continuity cs.cv cs.ro eess.iv framework hybrid novel paper prediction processing propagation semantic struggle type view vision