The Stream Processing Model Behind Google Cloud Dataflow

Balancing correctness, latency, and cost in unbounded data processing

Table of contents

• Before we move on
• Introduction from the paper.
• The details of the Dataflow model.
• Implementation and designs of the model.

Intro

Google Dataflow is a fully managed data processing service that provides serverless unified stream and batch data processing. It is the first choice Google would recommend when dealing with a stream processing workload. The service promises to ensure correctness and latency regardless …

data analytics data engineering google cloud platform software engineering stream processing