Semantic Is Enough: Only Semantic Information For NeRF Reconstruction

arXiv:2403.16043v1 Announce Type: new
Abstract: Recent research that combines implicit 3D representation with semantic information, like Semantic-NeRF, has proven that NeRF model could perform excellently in rendering 3D structures with semantic labels. This research aims to extend the Semantic Neural Radiance Fields (Semantic-NeRF) model by focusing solely on semantic output and removing the RGB output component. We reformulate the model and its training procedure to leverage only the cross-entropy loss between the model semantic output and the ground truth semantic …

abstract arxiv cs.ai cs.cv fields information labels nerf neural radiance fields rendering representation research semantic type