What is Kafka Connect?

Kafka Connect is a framework and toolset for building and running data pipelines between Apache Kafka and other data systems. This article provides an overview of Kafka Connect and its key components, such as workers, connectors, tasks, transformations, and converters. It also includes code examples to demonstrate how to configure these components to build a data pipeline from a MySQL database into Kafka.

Kafka Connect workers

You can configure Kafka Connect as a standalone system with a single worker (server) …

apache apache kafka article build building code components connectors data dataengineering data pipelines examples framework kafka key overview pipelines running systems tasks workers