The Power of Noise: Redefining Retrieval for RAG Systems

Retrieval-Augmented Generation (RAG) systems represent a significant advancement over traditional Large Language Models (LLMs). RAG systems enhance their generation ability by incorporating external data retrieved through an Information Retrieval (IR) phase, overcoming the limitations of standard LLMs, which are restricted to their pre-trained knowledge and limited context window. Most research in this area has predominantly concentrated on the generative aspect of LLMs within RAG systems. Our study fills this gap by thoroughly and critically analyzing the influence of IR components …

advancement context context window cs.cl cs.ir data external data information knowledge language language models large language large language models limitations llms noise power rag research retrieval retrieval-augmented standard systems through