Intention-driven Ego-to-Exo Video Generation

arXiv:2403.09194v1 Announce Type: new
Abstract: Ego-to-exo video generation refers to generating the corresponding exocentric video according to the egocentric video, providing valuable applications in AR/VR and embodied AI. Benefiting from advancements in diffusion model techniques, notable progress has been achieved in video generation. However, existing methods build upon the spatiotemporal consistency assumptions between adjacent frames, which cannot be satisfied in the ego-to-exo scenarios due to drastic changes in views. To this end, this paper proposes an Intention-Driven Ego-to-exo video generation …

abstract applications arxiv assumptions build cs.cv diffusion diffusion model embodied embodied ai however progress type video video generation