Can We Catch the Elephant? The Evolvement of Hallucination Evaluation on Natural Language Generation: A Survey

arXiv:2404.12041v1 Announce Type: new
Abstract: Hallucination in Natural Language Generation (NLG) is like the elephant in the room, obvious but often overlooked until recent achievements significantly improved the fluency and grammatical accuracy of generated text. For Large Language Models (LLMs), hallucinations can happen in various downstream tasks and casual conversations, which need accurate assessment to enhance reliability and safety. However, current studies on hallucination evaluation vary greatly, and people still find it difficult to sort out and select the most …

abstract accuracy arxiv cs.ai cs.cl evaluation generated hallucination hallucinations language language generation language models large language large language models llms natural natural language natural language generation nlg room survey text type