Knowledge Conflicts for LLMs: A Survey

arXiv:2403.08319v1 Announce Type: cross
Abstract: This survey provides an in-depth analysis of knowledge conflicts for large language models (LLMs), highlighting the complex challenges they encounter when blending contextual and parametric knowledge. Our focus is on three categories of knowledge conflicts: context-memory, inter-context, and intra-memory conflict. These conflicts can significantly impact the trustworthiness and performance of LLMs, especially in real-world applications where noise and misinformation are common. By categorizing these conflicts, exploring the causes, examining the behaviors of LLMs under such …

abstract analysis arxiv challenges conflict context cs.ai cs.cl cs.ir cs.lg focus highlighting impact knowledge language language models large language large language models llms memory parametric performance survey type