Jonathan Frankle: From Lottery Tickets to LLMs

In episode 96 of The Gradient Podcast, Daniel Bashir speaks to Jonathan Frankle.

Jonathan is the Chief Scientist at MosaicML and (as of release). Jonathan completed his PhD at MIT, where he investigated the properties of sparse neural networks that allow them to train effectively through his lottery ticket hypothesis. He also spends a portion of his time working on technology policy, and currently works with the OECD to implement the AI principles he helped develop in 2019.

Have …

daniel gradient hypothesis jonathan jonathan frankle llms lottery ticket hypothesis mit mosaicml networks neural networks phd podcast release them through tickets train