[D] GPT-NeoX-20B - Interview w/ EleutherAI co-founder Connor Leahy (Video)

https://youtu.be/AJwnbSP_rq8

EleutherAI announces GPT-NeoX-20B, a 20 billion parameter open-source language model, inspired by GPT-3. Connor joins me to discuss the process of training, how the group got their hands on the necessary hardware, what the new model can do, and how anyone can try it out!

​

OUTLINE:

0:00 - Intro

1:00 - Start of interview

2:00 - How did you get all the hardware?

3:50 - What's the scale of this model?

6:00 - A look into the experimental …

co-founder eleutherai founder gpt interview machinelearning video