Building RAG-based LLM Applications for Production // Philipp Moritz & Yifei Feng // LLMs III Talk

// Abstract
In this talk, we will cover how to develop and deploy RAG-based LLM applications for production. We will cover how the major workloads (data loading and preprocessing, embedding, serving) can be scaled on a cluster, how different configurations can be evaluated and how the application can be deployed. We will also give an introduction to Anyscale Endpoints which offers a cost-effective solution for serving popular open-source models.

// Bio
Philipp Moritz
Philipp Moritz is one of the creators …

abstract applications building cluster data data loading deploy embedding iii llm llm applications llms loading major production rag talk workloads