Compositional Chain-of-Thought Prompting for Large Multimodal Models

arXiv:2311.17076v2 Announce Type: replace-cross
Abstract: The combination of strong visual backbones and Large Language Model (LLM) reasoning has led to Large Multimodal Models (LMMs) becoming the current standard for a wide range of vision and language (VL) tasks. However, recent research has shown that even the most advanced LMMs still struggle to capture aspects of compositional visual reasoning, such as attributes and relationships between objects. One solution is to utilize scene graphs (SGs)--a formalization of objects and their relations and …

arxiv cs.ai cs.cl cs.cv cs.lg large multimodal models multimodal multimodal models prompting thought type