Large Language Model at Scale // Nils Reimers // MLOps Podcast #158

MLOps Coffee Sessions #158 with Nils Reimer, MLOps Build or Buy, Large Language Model at Scale co-hosted by Abi Aryan.

// Abstract
Large Language Models with billions of parameters have the possibility to change how we work with textual data. However, running them on scale at potentially hundred millions of texts a day is a massive challenge.

Nils talks about finding the right model size for respective tasks, model distillation, and promising new ways on transferring knowledge from large to …

abstract change coffee data language language model language models large language model large language models mlops podcast running scale work