all AI news
Fine-tuning LLMs with PEFT and LoRa
April 24, 2023, 1:40 p.m. | Sam Witteveen
Sam Witteveen www.youtube.com
Blog Post: https://huggingface.co/blog/peft
LoRa Paper: https://arxiv.org/abs/2106.09685
In this video I look at how to use PEFT to fine tune any decoder style GPT model. This goes through the basics LoRa fine-tuning and how to upload it to HuggingFace Hub.
00:00 Intro
00:04 - Problems with fine-tuning
00:48 - Introducing PEFT
01:11 - PEFT other cool techniques
01:51 - Lora Diagram
03:25 - Hugging Face PEFT Library
04:06 - Code Walkthrough
basics code decoder face fine-tuning gpt hub hugging face huggingface library llms look lora through video
More from www.youtube.com / Sam Witteveen
Master CrewAI: Your Ultimate Beginner's Guide!
6 days, 1 hour ago |
www.youtube.com
Anthropic's Meta Prompt: A Must-try!
1 week, 6 days ago |
www.youtube.com
Cohere's Command-R a New Model for RAG
2 weeks, 2 days ago |
www.youtube.com
Claude 3 Vs Gemini Vs GPT-4: Who Can Make Amazing Powerpoints?
2 weeks, 4 days ago |
www.youtube.com
Claude 3 - 3 New models - Which one is best?
3 weeks, 2 days ago |
www.youtube.com
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Data Scientist
@ Motive | India - Remote
Senior Perception Engineer
@ NVIDIA | US, CA, Santa Clara
Business Data Analyst, Finance and Treasury Data Repositories, Senior Associate
@ State Street | Krakow, Poland
Junior AI Engineer (Internship)
@ Sony | SEU - Italy - Roma
Manager, Data Science 3
@ PayPal | USA - Pennsylvania - Virtual