Instacart Creates a Self-Serve Apache Flink Platform on Kubernetes

Instacart moved their Apache Flink workloads from AWS EMR to Kubernetes to meet the high demand for data processing use cases using Flink within the organization, as using EMR became problematic for many teams with different requirements. As a result, they made the platform easier to use and reduced their operational and infrastructure costs.

ai apache apache flink architecture & design aws cases data data pipelines data processing demand development devops emr flink instacart kubernetes kubernetes operator machine learning ml & data engineering olap platform processing real-time requirements serve use cases workloads