3DBench: A Scalable 3D Benchmark and Instruction-Tuning Dataset

arXiv:2404.14678v1 Announce Type: new
Abstract: Evaluating the performance of Multi-modal Large Language Models (MLLMs), integrating both point cloud and language, presents significant challenges. The lack of a comprehensive assessment hampers determining whether these models truly represent advancements, thereby impeding further progress in the field. Current evaluations heavily rely on classification and caption tasks, falling short in providing a thorough assessment of MLLMs. A pressing need exists for a more sophisticated evaluation method capable of thoroughly analyzing the spatial understanding and …

abstract arxiv assessment benchmark challenges classification cloud cs.cv current dataset language language models large language large language models mllms modal multi-modal performance progress scalable type