OmniControl: Control Any Joint at Any Time for Human Motion Generation

arXiv:2310.08580v2 Announce Type: replace
Abstract: We present a novel approach named OmniControl for incorporating flexible spatial control signals into a text-conditioned human motion generation model based on the diffusion process. Unlike previous methods that can only control the pelvis trajectory, OmniControl can incorporate flexible spatial control signals over different joints at different times with only one model. Specifically, we propose analytic spatial guidance that ensures the generated motion can tightly conform to the input control signals. At the same time, …

abstract arxiv control cs.cv cs.gr diffusion human novel process spatial text trajectory type