LLMs vs LMs in Prod // Denys Linkov // LLMs in Production Conference Part 2

// Abstract
What are some of the key differences in using 100M vs 100B parameter models in production? In this talk, Denys from Voiceflow will cover how their MLOps processes have differed between smaller transformer models and LLMs. He'll walk through how the main 4 production models Voiceflow uses differ, and the processes plus product planning behind each one. The talk will cover prompt testing, automated training, real-time inference, and more!

// Bio
Denys is the ML lead at Voiceflow …

abstract conference differences llms mlops part processes prod production talk the key through transformer transformer models voiceflow