LlamaPack - RAFT: Adapting Language Model to Domain Specific RAG

In this video we will look into creating dataset for fine-tuning based on RAFT paper.

OUTLINE:

0:00 - Introduction to RAFT paper.
5:01 - RAFTDatasetPack Code Base.
08:32 - RAFTDatasetPack Notebook Walkthrough.

Notebook: https://github.com/run-llama/llama_index/blob/main/llama-index-packs/llama-index-packs-raft-dataset/examples/raft_dataset.ipynb

Paper: https://arxiv.org/abs/2403.10131

#llm #openai #finetuning #rag

code code base dataset domain fine-tuning finetuning introduction language language model llm look notebook openai paper raft rag video walkthrough will