Holodeck: Language Guided Generation of 3D Embodied AI Environments

arXiv:2312.09067v2 Announce Type: replace
Abstract: 3D simulated environments play a critical role in Embodied AI, but their creation requires expertise and extensive manual effort, restricting their diversity and scope. To mitigate this limitation, we present Holodeck, a system that generates 3D environments to match a user-supplied prompt fully automatedly. Holodeck can generate diverse scenes, e.g., arcades, spas, and museums, adjust the designs for styles, and can capture the semantics of complex queries such as "apartment for a researcher with a …

abstract arxiv cs.ai cs.cl cs.cv cs.ro diversity embodied embodied ai environments expertise language match prompt role type