Beyond Skeletons: Integrative Latent Mapping for Coherent 4D Sequence Generation

arXiv:2403.13238v1 Announce Type: new
Abstract: Directly learning to model 4D content, including shape, color and motion, is challenging. Existing methods depend on skeleton-based motion control and offer limited continuity in detail. To address this, we propose a novel framework that generates coherent 4D sequences with animation of 3D shapes under given conditions with dynamic evolution of shape and color over time through integrative latent mapping. We first employ an integrative latent unified representation to encode shape and color information of …

abstract animation arxiv beyond color continuity control cs.cv framework mapping novel type