Real-time Model Inference in a Video Streaming Environment //Jacob Tsafatinos // MLOps Coffee Sessions #97

MLOps Coffee Sessions #97 with Jacob Tsafatinos, Real-time Model Inference in a Video Streaming Environment co-hosted by Adam Sroka.



// Abstract

A few years ago Uber set out to create an ads platform for the Uber Eats app that relied heavily on three pillars; Speed, Reliability, and Accuracy. Some of the technical challenges they were faced with included exactly-once semantics in real-time. To accomplish this goal, they created the architecture diagram above with lots of love from Flink, Kafka, Hive, …

coffee environment inference mlops real-time streaming time video