RAGged Edges: The Double-Edged Sword of Retrieval-Augmented Chatbots

arXiv:2403.01193v1 Announce Type: new
Abstract: Large language models (LLMs) like ChatGPT demonstrate the remarkable progress of artificial intelligence. However, their tendency to hallucinate -- generate plausible but false information -- poses a significant challenge. This issue is critical, as seen in recent court cases where ChatGPT's use led to citations of non-existent legal rulings. This paper explores how Retrieval-Augmented Generation (RAG) can counter hallucinations by integrating external knowledge with prompts. We empirically evaluate RAG against standard LLMs using prompts designed …

abstract artificial artificial intelligence arxiv cases challenge chatbots chatgpt citations court cs.ai cs.cl false generate information intelligence issue language language models large language large language models llms progress retrieval retrieval-augmented type