Goldsky’s Streaming-First Architecture for Blockchain Data with Flink, Redpanda and Kubernetes

Goldsky created a platform for the real-time processing of blockchain data. The platform allows clients to extract data from blockchains into their own databases to support product features, but without running the data pipeline infrastructure. The event-driven architecture (EDA) of Goldsky leverages Apache Flink, Redpanda, Kubernetes, and cloud provider services.

ai apache apache flink apache kafka architecture architecture & design blockchain blockchains cloud cloud computing data databases data pipeline data pipelines development eda event event-driven-architecture event stream processing extract features flink infrastructure kubernetes kubernetes operator ml & data engineering pipeline platform postgres processing product provider real-time redpanda running s3 saas streaming support