Evaluating Consistency and Reasoning Capabilities of Large Language Models

arXiv:2404.16478v1 Announce Type: new
Abstract: Large Language Models (LLMs) are extensively used today across various sectors, including academia, research, business, and finance, for tasks such as text generation, summarization, and translation. Despite their widespread adoption, these models often produce incorrect and misleading information, exhibiting a tendency to hallucinate. This behavior can be attributed to several factors, with consistency and reasoning capabilities being significant contributors. LLMs frequently lack the ability to generate explanations and engage in coherent reasoning, leading to inaccurate …

abstract academia adoption arxiv behavior business capabilities cs.ai cs.cl finance information language language models large language large language models llms reasoning research summarization tasks text text generation translation type