Retrieval-augmented Multi-modal Chain-of-Thoughts Reasoning for Large Language Models

arXiv:2312.01714v2 Announce Type: replace
Abstract: The advancement of Large Language Models (LLMs) has brought substantial attention to the Chain of Thought (CoT) approach, primarily due to its ability to enhance the capability of LLMs on complex reasoning tasks. Moreover, the significance of CoT approaches extends to the application of LLMs for multi-modal tasks. However, the selection of optimal CoT demonstration examples in multi-modal reasoning remains less explored for LLMs due to the inherent complexity of multi-modal examples. In this paper, …

abstract advancement application arxiv attention capability chain of thought cs.cl language language models large language large language models llms modal multi-modal reasoning retrieval retrieval-augmented significance tasks thought thoughts type