Seeing Like a Language Model // Linus Lee // AI in Production Conference Full Talk

// Abstract
What do language models see when they read and generate text? What are the terms by which they process the world? In this talk, I'll share some encouraging updates on my continuing exploration of how embeddings represent meaning enabled by recent breakthroughs in interpretability research, and how these insights might help us build better capabilities for retrieval-augmented LLM systems and imagine more natural interfaces for reading and writing.

// Bio
Linus is a Research Engineer at Notion prototyping …

abstract conference embeddings exploration generate language language model language models lee meaning process production talk terms text updates world