all AI news
Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
March 27, 2024, 4:48 a.m. | Zhenyu Pan, Haozheng Luo, Manling Li, Han Liu
cs.CL updates on arXiv.org arxiv.org
Abstract: We present a Chain-of-Action (CoA) framework for multimodal and retrieval-augmented Question-Answering (QA). Compared to the literature, CoA overcomes two major challenges of current QA applications: (i) unfaithful hallucination that is inconsistent with real-time or domain facts and (ii) weak reasoning performance over compositional information. Our key contribution is a novel reasoning-retrieval mechanism that decomposes a complex question into a reasoning chain via systematic prompting and pre-designed actions. Methodologically, we propose three types of domain-adaptable `Plug-and-Play' …
abstract applications arxiv challenges cs.cl current domain facts framework hallucination information language language models large language large language models literature major multimodal performance question question answering real-time reasoning retrieval retrieval-augmented through type
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote