Epistemology of Language Models: Do Language Models Have Holistic Knowledge?

arXiv:2403.12862v1 Announce Type: new
Abstract: This paper investigates the inherent knowledge in language models from the perspective of epistemological holism. The purpose of this paper is to explore whether LLMs exhibit characteristics consistent with epistemological holism. These characteristics suggest that core knowledge, such as general scientific knowledge, each plays a specific role, serving as the foundation of our knowledge system and being difficult to revise. To assess these traits related to holism, we created a scientific reasoning dataset and examined …

abstract arxiv consistent core cs.cl epistemology explore general knowledge language language models llms paper perspective scientific type