Here is the largest collection of fine-tuning notebooks for Language Language Models (LLMs), which includes additions for both Direct Preference Optimization (DPO) fine-tuning and Knowledge Graph LLMs

1. Instruction based data prepare using OpenAI
2. Optimal Fine-Tuning using the Trainer API: From Training to Model Inference
3. Efficient Fine-tuning and inference LLMs with PEFT and LoRA
4. Efficient Fine-tuning and inference LLMs Accelerate
5. Efficient Fine-tuning with T5
6. Train Large Language Models with LoRA and Hugging Face
7. Fine-Tune Your Own Llama 2 Model in a Colab Notebook
8. Guanaco Chatbot Demo with LLaMA-7B Model
9. PEFT Finetune Bloom 560m tagger
10. Finetune Meta OPT-6-1b\_Model\_bnb\_peft
11. …

api collection data direct preference optimization fine-tuning graph inference knowledge knowledge graph language language models llms lora machinelearningnews notebooks openai optimization peft trainer training