Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting

arXiv:2310.10642v3 Announce Type: replace
Abstract: Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene Structure: Existing methods struggle to reveal the spatial and temporal structure of dynamic scenes from directly learning the complex 6D plenoptic function. (ii) Scaling Deformation Modeling: Explicitly modeling scene element deformation becomes impractical for complex dynamics. To address these issues, we consider …

3d scenes abstract arxiv complexity cs.cv diverse dynamic dynamics images limitations photorealistic real-time rendering representation spatial struggle temporal type