Fine Tune Gemma Crash Course (w/ Example Colab Code)

In this crash course to fine-tune Google Gemma, Adithya SK teaches us the end-to-end process of model fine-tuning.

Steps involved:
1. Setting up the environment
2. Loading the Model & Setting up Chat Template (Prompts)
3. Loading the Dataset and formatting the datset
4. LoRA Config
5. Model Fine-tuning (Training) Gemma and Push to Hugging Face Hub

Finally Testing and Closure!

🔗 Links 🔗

A Beginner’s Guide to Fine-Tuning Gemma Blogpost - https://adithyask.medium.com/a-beginners-guide-to-fine-tuning-gemma-0444d46d821c
Colab used in the code - https://colab.research.google.com/github/adithya-s-k/LLM-Alchemy-Chamber/blob/main/LLMs/Gemma/finetune-gemma.ipynb …

chat code colab config course dataset environment example fine-tuning gemma google google gemma loading lora model fine-tuning process prompts template the environment training