[P] Llama-2 4bit fine-tune with dolly-15k on Colab (Free)

Simple walkthrough of fine-tuning [llama-2 instruct fine-tuned on guanaco](https://huggingface.co/guardrail/llama-2-7b-guanaco-instruct-sharded) model with 4bit QLoRA on a free Google Colab instance.

**Colab**: [https://colab.research.google.com/drive/134o\_cXcMe\_lsvl15ZE\_4Y75Kstepsntu?usp=sharing](https://colab.research.google.com/drive/134o_cXcMe_lsvl15ZE_4Y75Kstepsntu?usp=sharing)
**GitHub**: [https://github.com/kw2828/guardrail-ml/blob/main/examples](https://github.com/kw2828/guardrail-ml/blob/main/examples)
**YouTube Overview**: [https://www.youtube.com/watch?v=o5bU1H-6TqM&ab\_channel=GenerativeAIEntrepreneurs](https://www.youtube.com/watch?v=o5bU1H-6TqM&ab_channel=GenerativeAIEntrepreneurs)

Bonus colab in repo on generating your own JSON Q&A dataset from PDF in the repo above.

bonus colab dataset json machinelearning pdf