Optimizing Diffusion Noise Can Serve As Universal Motion Priors

arXiv:2312.11994v2 Announce Type: replace
Abstract: We propose Diffusion Noise Optimization (DNO), a new method that effectively leverages existing motion diffusion models as motion priors for a wide range of motion-related tasks. Instead of training a task-specific diffusion model for each new task, DNO operates by optimizing the diffusion latent noise of an existing pre-trained text-to-motion model. Given the corresponding latent noise of a human motion, it propagates the gradient from the target criteria defined on the motion space through the …

abstract arxiv cs.cv diffusion diffusion model diffusion models noise optimization serve tasks training type universal