#64 Prof. GARY MARCUS 3.0 [Unplugged]

Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/ESrGqhf5CB

We have a chat with Prof. Gary Marcus about everything which is currently top of mind for him, consciousness

[00:00:00] Gary intro
[00:01:25] Slightly conscious
[00:24:59] Abstract, compositional models
[00:32:46] Spline theory of NNs
[00:36:17] Self driving cars / algebraic reasoning
[00:39:43] Extrapolation
[00:44:15] Scaling laws
[00:49:50] Maximum likelihood estimation

Pod version:
https://anchor.fm/machinelearningstreettalk/episodes/64-Prof--Gary-Marcus-3-0-e1es2gc

References:
Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets
https://arxiv.org/abs/2201.02177

DEEP DOUBLE DESCENT: WHERE BIGGER MODELS AND MORE DATA HURT
https://arxiv.org/pdf/1912.02292.pdf

Bayesian Deep …

gary marcus