OPT-175B: Open Pretrained Transformer | ML Coding Series

❤️ Become The AI Epiphany Patreon ❤️
https://www.patreon.com/theaiepiphany

👨‍👩‍👧‍👦 Join our Discord community 👨‍👩‍👧‍👦
https://discord.gg/peBrCpheKE

In this video I do a deep dive into the metaseq (Open Pretrained Transformer, OPT-175B) codebase.

I first show you how to set up the code on your machine, and then I walk you through the codebase behind Meta's large language model (LLM).

Along the way I cover key concepts behind mixed precision training such as loss scaling and unscaling, and much more.

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ …

coding opt-175b series transformer