Modern Data Stack: which place for Spark ?

Modern Data Stack: Which Place for Spark ?

One year ago, some were already predicting that dbt will one day become bigger than Spark, and the year 2021 proved them right: dbt has become incredibly popular and rumor has it that dbt-labs might raise again at $6 billion valuation. At this rate, they will soon catch up with Databricks which reached a $38 billion valuation in September 2021.

Still, what struck me the most about Spark this …

data data engineering data stack dbt modern data stack notes-from-industry spark