Beyond neural scaling laws – Paper Explained

„Beyond neural scaling laws: beating power law scaling via data pruning” paper explained with animations. You do not need to train your neural network on the entire dataset!
Sponsor: NVIDIA ❗ use this link to register for the GTC 👉 https://nvda.ws/3p4E5K8
Google Form to enter DLI credits giveaway: https://forms.gle/rkZS4u5rfyySr6iP9

ERRATUM: See pinned comment for what easy/hard examples are chosen.

📺 PaLM model explained: https://youtu.be/yi-A0kWXEO4

Check out our daily #MachineLearning Quiz Questions: https://www.youtube.com/c/AICoffeeBreak/community
Paper 📜: Sorscher, Ben, Robert Geirhos, Shashank Shekhar, …

explained laws paper scaling