Web: https://towardsdatascience.com/modern-data-stack-which-place-for-spark-8e10365a8772?source=rss----7f60cf5620c9---4

Jan. 25, 2022, 8:58 p.m. | Furcy Pin

Towards Data Science - Medium towardsdatascience.com

Modern Data Stack: Which Place for Spark ?

One year ago, some were already predicting that dbt will one day become bigger than Spark, and the year 2021 proved them right: dbt has become incredibly popular and rumor has it that dbt-labs might raise again at $6 billion valuation. At this rate, they will soon catch up with Databricks which reached a $38 billion valuation in September 2021.

Still, what struck me the most about Spark this …

data data engineering data stack dbt modern data stack notes-from-industry spark

Research Scientist, 3D Reconstruction

@ Yembo | Remote, US

Clinical Assistant or Associate Professor of Management Science and Systems

@ University at Buffalo | Buffalo, NY

Data Analyst

@ Colorado Springs Police Department | Colorado Springs, CO

Predictive Ecology Postdoctoral Fellow

@ Lawrence Berkeley National Lab | Berkeley, CA

Data Analyst, Patagonia Action Works

@ Patagonia | Remote

Data & Insights Strategy & Innovation General Manager

@ Chevron Services Company, a division of Chevron U.S.A Inc. | Houston, TX