RL Foundation Models Are Coming!

AdA is a new algorithm out from DeepMind that combines interesting ideas like curriculum learning, meta reinforcement learning (via RL^2), model-based reinforcement learning, attention, and memory models to develop a prototype for a reinforcement learning foundation model. The results look promising, and the future of this area looks bright!

Outline
0:00 - Intro
1:07 - Example Video
2:40 - ClearML
3:48 - How It Works Overview
4:20 - Meta-Learning & RL
8:20 - Attention & Memory
9:55 - Distillation
12:01 …

ada algorithm attention clearml curriculum curriculum learning deepmind distillation example foundation foundation model future ideas look media memory meta meta-learning overview reinforcement reinforcement learning social social media video work