When Not to Trust Language Models: Investigating Effectiveness of Parametric&Non-Parametric Memories

Presentation of ACL 2023 main conference long paper "When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories".

Alex Mallen*, Akari Asai*, Victor Zhong, Rajarshi Das, Daniel Khashabi, Hannaneh Hajishirzi

Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world knowledge. This paper aims to understand LMs' strengths and limitations in memorizing factual …

acl alex conference daniel diverse language language models large language models memories non-parametric paper parametric performance presentation trust