Real-Time Exactly-Once Event Processing with Apache Flink, Kafka, and Pinot //Jacob Tsafatinos // MLOps Coffee Sessions #97

Web: https://anchor.fm/mlops/episodes/Real-Time-Exactly-Once-Event-Processing-with-Apache-Flink--Kafka--and-Pinot-Jacob-Tsafatinos--MLOps-Coffee-Sessions-97-e1i20u1 Audio: https://anchor.fm/s/174cb1b8/podcast/play/51495297/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2022-4-4%2F263458349-44100-2-bdf290014b5e2.m4a

MLOps Coffee Sessions #97 with Jacob Tsafatinos, Real-Time Exactly-Once Event Processing with Apache Flink, Kafka, and Pinot co-hosted by Mihail Eric.



// Abstract

A few years ago Uber set out to create an ads platform for the Uber Eats app that relied heavily on three pillars; Speed, Reliability, and Accuracy. Some of the technical challenges they were faced with included exactly-once semantics in real-time. To accomplish this goal, they created the architecture diagram above with lots of love from Flink, …

apache apache flink coffee event kafka mlops processing real-time time