Building an Open Assistant API

Working with one of the Open Assistant models, a 12B parameter Pythia model (https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5)

Neural Networks from Scratch book: https://nnfs.io
Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join
Discord: https://discord.gg/sentdex
Reddit: https://www.reddit.com/r/sentdex/
Support the content: https://pythonprogramming.net/support-donate/
Twitter: https://twitter.com/sentdex
Instagram: https://instagram.com/sentdex
Facebook: https://www.facebook.com/pythonprogramming.net/
Twitch: https://www.twitch.tv/sentdex

Video Contents:

00:00 - Basics of using OpenAssistant Pythia 12B locally
16:37 - Creating an OpenAssistant API
22:22 - Interfacing with our new OpenAssistant API
31:32 - Handling for long contexts

api basics contents openassistant pythia video