Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization

arXiv:2308.02151v2 Announce Type: replace
Abstract: Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than merely responding to queries from human users. Most existing language agents, however, are not optimized using environment-specific rewards. Although some agents enable iterative refinement through verbal feedback, they do not reason and plan in ways that are compatible with …

abstract agents arxiv autonomous become cs.ai cs.cl emergence gradient human language language models large language large language models llms optimization policy queries retrospective tasks trend type