A Philosophical Introduction to Language Models - Part II: The Way Forward

arXiv:2405.03207v1 Announce Type: new
Abstract: In this paper, the second of two companion pieces, we explore novel philosophical questions raised by recent progress in large language models (LLMs) that go beyond the classical debates covered in the first part. We focus particularly on issues related to interpretability, examining evidence from causal intervention methods about the nature of LLMs' internal representations and computations. We also discuss the implications of multimodal and modular extensions of LLMs, recent debates about whether such systems …

abstract arxiv beyond companion cs.cl explore focus interpretability introduction language language models large language large language models llms novel paper part progress questions the way type