A Survey of Production RAG Pain Points and Solutions // Jerry Liu // AI in Production Conference

// Abstract
Large Language Models (LLMs) are revolutionizing how users can search for, interact with, and generate new content. There's been an explosion of interest around Retrieval Augmented Generation (RAG), enabling users to build applications such as chatbots, document search, workflow agents, and conversational assistants using LLMs on their private data. While setting up naive RAG is straightforward, building production RAG is very challenging. There are parameters and failure points along every stage of the stack that an AI engineer …

abstract agents applications build chatbots conference document enabling generate jerry jerry liu language language models large language large language models llms pain production rag retrieval retrieval augmented generation search solutions survey workflow