Agent3D-Zero: An Agent for Zero-shot 3D Understanding

arXiv:2403.11835v1 Announce Type: new
Abstract: The ability to understand and reason the 3D real world is a crucial milestone towards artificial general intelligence. The current common practice is to finetune Large Language Models (LLMs) with 3D data and texts to enable 3D understanding. Despite their effectiveness, these approaches are inherently limited by the scale and diversity of the available 3D data. Alternatively, in this work, we introduce Agent3D-Zero, an innovative 3D-aware agent framework addressing the 3D scene understanding in a …

abstract agent artificial artificial general intelligence arxiv cs.cv current data general intelligence language language models large language large language models llms practice reason type understanding world zero-shot