EleutherAI Pythia w/ Hailey Schoelkopf

Become a Patreon: https://www.patreon.com/theaiepiphany
👨‍👩‍👧‍👦 Join our Discord community: https://discord.gg/peBrCpheKE

Hailey from EleutherAI joined us to talk about her story, her work on the BLOOM project, Pythia, Llemma, lm harness, and beyond!

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Hailey's G Scholar: https://scholar.google.com/citations?user=XLahYIYAAAAJ&hl=en
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

⌚️ Timetable:
00:00 Hailey's story
10:50 Pythia
17:00 What can you do with open-(data, weights) LMs?
43:20 Research infra
46:00 Llemma: open-weights mathematics base models
51:00 LM-Eval-Harness
53:40 Q&A

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR

The AI Epiphany - https://www.patreon.com/theaiepiphany
One-time donation - https://www.paypal.com/paypalme/theaiepiphany

Huge …

beyond bloom data eleutherai harness her infra mathematics project pythia research story talk work