Allegro Uses Control Theory for Workload Balancing in Its Apache Kafka PubSub Platform

Allegro, the largest eCommerce platform in Poland, implemented dynamic workload balancing in Hermes, its open-source publish-subscribe message broker, built on top of Apache Kafka. The new workload balancing algorithm achieves more uniform resource utilization and lower infrastructure costs.

ai algorithm apache apache kafka architecture & design control costs development dynamic ecommerce ecommerce platform event-driven-architecture event stream processing infrastructure kafka load-balancing ml & data engineering platform poland rest theory uniform