A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signals

arXiv:2404.04890v1 Announce Type: new
Abstract: Estimating full-body human motion via sparse tracking signals from head-mounted displays and hand controllers in 3D scenes is crucial to applications in AR/VR. One of the biggest challenges to this task is the one-to-many mapping from sparse observations to dense full-body motions, which endowed inherent ambiguities. To help resolve this ambiguous problem, we introduce a new framework to combine rich contextual information provided by scenes to benefit full-body motion tracking from sparse observations. To estimate …

3d scenes abstract applications arxiv challenges cs.cv diffusion framework head human mapping tracking type via