Data Pipelines explained with Airflow

In the following lines I am doing a write-up about everything I learned about data pipelines at the Udacity online class. It gives a general overview about data pipelines and provides also the core concepts of Airflow and some links to code examples on github.

WHAT - A series

A data pipeline is a series of steps in which data is processed, mostly ETL or ELT.

Data pipelines provide a set of logical guidelines and a common set …

airflow dag data data pipelines datascience explainlikeimfive pipelines productivity