Creating an OpenAI compatible Llama2 API with Flask

In today's video I install Llama2 on AWS and create a simple Flask API for it, that is compatible with the OpenAI ChatGPT API.

GitHub: https://github.com/unconv/llama2-flask-api

Support: https://buymeacoffee.com/unconv
Consultations: https://www.buymeacoffee.com/unconv/e/146735
Memberships: https://www.buymeacoffee.com/unconv/membership

00:00 Downloading Llama2
01:01 Setting up EC2 instance
04:27 Installing Llama2
07:07 Running Llama2 example code
09:54 Making a Llama2 chatbot
16:25 Creating a Llama2 API
23:00 Testing Llama2 API with ChatHTMX
27:03 Integrating Llama2 with ChatWTF
35:50 Final thoughts

api aws chatbot chatgpt code ec2 example flask install instance llama2 making openai running simple testing video