3D-LLM: Integrate 3D World Into Language Models

In a new paper 3D-LLM: Injecting the 3D World into Large Language Models, a research team inject the 3D world into large language models and presents 3D-LLMs, a whole new family of models that can capture 3D spatial information to perform 3D-related tasks.

ai artificial intelligence deep-neural-networks family information language language models large language large language model large language models llm llms machine learning machine learning & data science ml paper research research team team technology visual language model world