How we deprecated two successful projects and joined forces to create an even more successful one

We had two large clients requesting to integrate our ML pipelines with their backend using Apache Kafka. Our previous HTTP API was based on FastAPI and we thought no problem, let's search for something similar but for Kafka. It turns out the one available solution was Faust, a framework with the last release at the time more than two years old. There is a community-maintained fork of it, but it was not very active and we just couldn't use it …

apache apache kafka api backend fastapi http kafka ml pipelines opensource pipelines programming projects python search something thought webdev