How I Learned PyTorch Multiprocessing with ChatGPT (and built a Llama 2 API)

In this video I go over how I created an API for the Llama 2 language model, that support multiprocessing with PyTorch

GitHub: https://github.com/unconv/llama2-flask-api

Support: https://buymeacoffee.com/unconv
Consultations: https://www.buymeacoffee.com/unconv/e/146735
Memberships: https://www.buymeacoffee.com/unconv/membership

00:00 Intro
05:39 Asking ChatGPT for help
12:13 Multiprocessing Example
13:39 Communicating with Processes
15:50 Final Code
22:47 Demo
24:59 Fixing mock streaming issue

api chatgpt code demo example intro issue language language model llama llama 2 mock multiprocessing processes pytorch streaming support video