all AI news
A Question on the Explainability of Large Language Models and the Word-Level Univariate First-Order Plausibility Assumption
March 18, 2024, 4:47 a.m. | Jeremie Bogaert, Francois-Xavier Standaert
cs.CL updates on arXiv.org arxiv.org
Abstract: The explanations of large language models have recently been shown to be sensitive to the randomness used for their training, creating a need to characterize this sensitivity. In this paper, we propose a characterization that questions the possibility to provide simple and informative explanations for such models. To this end, we give statistical definitions for the explanations' signal, noise and signal-to-noise ratio. We highlight that, in a typical case study where word-level univariate explanations are …
abstract arxiv cs.ai cs.cl explainability language language models large language large language models paper possibility question questions randomness sensitivity training type word
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Senior Machine Learning Engineer
@ Samsara | Canada - Remote