Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models

arXiv:2308.15022v2 Announce Type: replace
Abstract: Recently, large language models (LLMs), such as GPT-4, stand out remarkable conversational abilities, enabling them to engage in dynamic and contextually relevant dialogues across a wide range of topics. However, given a long conversation, these chatbots fail to recall past information and tend to generate inconsistent responses. To address this, we propose to recursively generate summaries/ memory using large language models (LLMs) to enhance long-term memory ability. Specifically, our method first stimulates LLMs to memorize …

abstract arxiv chatbots conversation conversational cs.ai cs.cl dialogue dynamic enabling generate gpt gpt-4 information language language models large language large language models llms long-term memory recall summarizing them topics type