GenNBV: Generalizable Next-Best-View Policy for Active 3D Reconstruction

arXiv:2402.16174v1 Announce Type: new
Abstract: While recent advances in neural radiance field enable realistic digitization for large-scale scenes, the image-capturing process is still time-consuming and labor-intensive. Previous works attempt to automate this process using the Next-Best-View (NBV) policy for active 3D reconstruction. However, the existing NBV policies heavily rely on hand-crafted criteria, limited action space, or per-scene optimized representations. These constraints limit their cross-dataset generalizability. To overcome them, we propose GenNBV, an end-to-end generalizable NBV policy. Our policy adopts a …

3d reconstruction abstract advances arxiv automate cs.ai cs.cv cs.ro digitization image labor neural radiance field next policy process scale type view