SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code

arXiv:2403.01248v1 Announce Type: cross
Abstract: This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial planning and arrangement. We tackle these challenges through a combination of advanced abstraction, strategic planning, and library learning. SceneCraft first models a scene graph as a blueprint, detailing the spatial relationships among assets in the scene. SceneCraft then writes Python scripts based …

abstract agent arxiv blender challenges code combination cs.ai cs.cl cs.cv cs.lg language language model large language large language model llm paper planning process python scripts spatial text through type