Retrieval-Augmented Thought Process as Sequential Decision Making

Large Language Models (LLMs) have demonstrated their strong ability to assist people and show "sparks of intelligence". However, several open challenges hinder their wider application: such as concerns over privacy, tendencies to produce hallucinations, and difficulties in handling long contexts. In this work, we address those challenges by introducing the Retrieval-Augmented Thought Process (RATP). Given access to external knowledge, RATP formulates the thought generation of LLMs as a multiple-step decision process. To optimize such a thought process, RATP leverages Monte-Carlo …

application challenges concerns cs.ai cs.cl cs.ir cs.lg decision decision making hallucinations hinder intelligence language language models large language large language models llms making people privacy process retrieval retrieval-augmented show thought work