all AI news
BigScience BLOOM | 3D Parallelism Explained | Large Language Models | ML Coding Series
Sept. 20, 2022, 8:15 a.m. | Aleksa Gordić - The AI Epiphany
Aleksa Gordić - The AI Epiphany www.youtube.com
https://www.patreon.com/theaiepiphany
👨👩👧👦 Join our Discord community 👨👩👧👦
https://discord.gg/peBrCpheKE
In this 4th video of the Large Language Model series I walk you through the BigScience's BLOOM model codebase!
The main focus is on understanding the 3D parallelism:
* Pipeline parallelism
* Model parallelism
* Data parallelism
A set of beautiful engineering ideas that are behind all of the recent scaling efforts and ML success stories!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ BLOOM code: https://github.com/bigscience-workshop/Megatron-DeepSpeed
✅ Ultimate Guide to …
bigscience bloom coding explained language language models large language models series
More from www.youtube.com / Aleksa Gordić - The AI Epiphany
Building Julius AI to 500.000 users w/ Rahul (founder)
3 weeks, 1 day ago |
www.youtube.com
Ishan Misra (Meta) - Emu Video Generation
2 months, 1 week ago |
www.youtube.com
InstructPix2Pix (w/ OpenAI's Tim Brooks)
2 months, 2 weeks ago |
www.youtube.com
GPT-Fast - blazingly fast inference with PyTorch (w/ Horace He)
2 months, 3 weeks ago |
www.youtube.com
Thomas Wolf (HuggingFace) - the case for open-source!
3 months, 1 week ago |
www.youtube.com
Jeremy Howard - answer.ai, what is wrong with the academia and industry
3 months, 2 weeks ago |
www.youtube.com
Jobs in AI, ML, Big Data
Senior Machine Learning Engineer
@ GPTZero | Toronto, Canada
ML/AI Engineer / NLP Expert - Custom LLM Development (x/f/m)
@ HelloBetter | Remote
Doctoral Researcher (m/f/div) in Automated Processing of Bioimages
@ Leibniz Institute for Natural Product Research and Infection Biology (Leibniz-HKI) | Jena
Seeking Developers and Engineers for AI T-Shirt Generator Project
@ Chevon Hicks | Remote
Senior Applied Data Scientist
@ dunnhumby | London
Principal Data Architect - Azure & Big Data
@ MGM Resorts International | Home Office - US, NV