VisFusion: Visibility-aware Online 3D Scene Reconstruction from Videos. (arXiv:2304.10687v1 [cs.CV])

We propose VisFusion, a visibility-aware online 3D scene reconstruction
approach from posed monocular videos. In particular, we aim to reconstruct the
scene from volumetric features. Unlike previous reconstruction methods which
aggregate features for each voxel from input views without considering its
visibility, we aim to improve the feature fusion by explicitly inferring its
visibility from a similarity matrix, computed from its projected features in
each image pair. Following previous works, our model is a coarse-to-fine
pipeline including a volume sparsification …

aim arxiv feature features fusion image matrix pipeline process videos visibility voxel