Compositional Generalization, Referential Grounding & LLMs [Ellie Pavlick and Raphaël Millière]

Ellie Pavlick, Assistant Professor at Brown University, and Raphaël Millière, Associate Professor of Philosophy at the University of Oxford, discuss compositional generalization, referential grounding, and the development of large language models like GPT-3 and GPT-4. They share their perspectives on artificial intelligence, neural networks, and human cognition, exploring the mechanistic understanding of language models and the debate between symbolic and associative approaches in human cognition.

The conversation covers the progress and challenges in compositional generalization benchmarks, the importance of understanding …

artificial artificial intelligence assistant cognition development discuss gpt gpt-3 gpt-4 human intelligence language language models large language models llms networks neural networks oxford perspectives philosophy professor university university of oxford