Deploy (Tiny) LLM to Production: Merge Lora Adapter, Push to HF Hub, Rest API with FastAPI & Docker

Full text tutorial (requires MLExpert Pro): https://www.mlexpert.io/bootcamp/deploy-custom-llm-to-production

You have a fine-tuned model (with LoRA adapter) to deploy as a REST API? In this video, we'll merge a LoRA adapter with a base model and upload it (with a tokenizer) to HuggingFace Hub. We'll build a REST API with FastAPI and deploy it as a Docker container.

Model on HuggingFace Hub: https://huggingface.co/curiousily/tiny-crypto-sentiment-analysis
HuggingFace Space: https://huggingface.co/spaces/curiousily/tiny-crypto-sentiment
API Docs: https://curiousily-tiny-crypto-sentiment.hf.space/docs

AI Bootcamp (in preview): https://www.mlexpert.io/membership
Discord: https://discord.gg/UaNPxVD6tv
Subscribe: http://bit.ly/venelin-subscribe
GitHub repository: https://github.com/curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain

00:00 …

api build deploy docker docker container fastapi hub huggingface intro lora merge rest rest api text tutorial video