Can Language Models Act as Knowledge Bases at Scale?

arXiv:2402.14273v1 Announce Type: new
Abstract: Large language models (LLMs) have demonstrated remarkable proficiency in understanding and generating responses to complex queries through large-scale pre-training. However, the efficacy of these models in memorizing and reasoning among large-scale structured knowledge, especially world knowledge that explicitly covers abundant factual information remains questionable. Addressing this gap, our research investigates whether LLMs can effectively store, recall, and reason with knowledge on a large scale comparable to latest knowledge bases (KBs) such as Wikidata. Specifically, we …

abstract act arxiv complex queries cs.cl information knowledge language language models large language large language models llms pre-training queries reasoning responses scale through training type understanding world