LlamaIndex Webinar: Learn about Fine-tuning + RAG (w/ Victoria Lin, author of RA-DIT)

We're excited to talk about how to combine fine-tuning and RAG with Victoria Lin, author of the recent RA-DIT (Retrieval-Augmented Dual Instruction Tuning) paper.

​Paper Abstract:

​Retrieval-augmented language models (RALMs) improve performance by accessing long-tail and up-to-date knowledge from external data stores, but are challenging to build. Existing approaches require either expensive retrieval-specific modifications to LM pre-training or use post-hoc integration of the data store that leads to suboptimal performance. We introduce Retrieval-Augmented Dual Instruction Tuning (RA-DIT), a lightweight fine-tuning …

abstract author build data data stores external data fine-tuning knowledge language language models learn llamaindex paper performance rag retrieval talk victoria webinar