Llama 2: Fine-tuning Notebooks - QLoRA, DeepSpeed

Fine-tune Llama v2 with your company data, either apply DeepSpeed or 4bit QLoRA for Llama 2!

We will leverage PEFT library from Hugging Face ecosystem, as well as QLoRA for more memory efficient finetuning.

https://huggingface.co/meta-llama/Llama-2-7b
https://huggingface.co/meta-llama/Llama-2-13b
https://huggingface.co/meta-llama/Llama-2-13b-chat
https://huggingface.co/meta-llama/Llama-2-70b
https://huggingface.co/meta-llama/Llama-2-13b-chat-hf

#ai
#finetune
#llama2
#shorts

apply data deepspeed ecosystem face fine-tuning finetuning hugging face library llama llama 2 memory notebooks shorts