Aspects of human memory and Large Language Models

arXiv:2311.03839v3 Announce Type: replace-cross
Abstract: Large Language Models (LLMs) are huge artificial neural networks which primarily serve to generate text, but also provide a very sophisticated probabilistic model of language use. Since generating a semantically consistent text requires a form of effective memory, we investigate the memory properties of LLMs and find surprising similarities with key characteristics of human memory. We argue that the human-like memory properties of the Large Language Model do not follow automatically from the LLM architecture …

abstract artificial artificial neural networks arxiv consistent cs.ai cs.cl cs.lg form generate human language language models large language large language models llms memory networks neural networks probabilistic model q-bio.nc serve text type