How to Run Llama 2 on CPU | Installing on AWS and Locally

CPU-Llama: https://github.com/unconv/cpu-llama
Llama 2 Flask API: https://github.com/unconv/cpu-llama

In this video I show you how you can run the Llama 2 language model on CPU (without a GPU)

Support: https://buymeacoffee.com/unconv
Consultations: https://www.buymeacoffee.com/unconv/e/146735
Memberships: https://www.buymeacoffee.com/unconv/membership

00:00 Launching EC2 Instance
02:57 Installing Llama 2
03:49 Installing Llama 2 Flask API
04:21 Modify Llama 2 Repo for CPU
07:17 Running Llama 2 on CPU
08:00 Trying to run it locally

api cpu ec2 flask gpu instance language language model llama llama 2 running show video