Open Assistant Inference Backend Development (Hands-On Coding)

#ai #huggingface #coding

Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...

Original repo is here: https://github.com/huggingface/text-generation-inference

OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)

Check out https://www.wandb.courses/ for free MLOps courses!

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you …

assistant backend bitcoin coding cuda development ethereum events face grpc hugging face huggingface inference join open assistant people python rust server streaming support text text generation through websockets