July 24, 2023, 1:42 p.m. | Leah Nguyen

Towards Data Science - Medium towardsdatascience.com

dbt Incremental — The Right Way

From Full-Load Pain to Incremental Gain (and a Few Mistakes Along the Way)

Photo by Lukas Tennie on Unsplash

When my team at GlamCorner began transitioning from traditional MySQL databases to ELT on a Postgres database with dbt as the transformation and modeling layer, we were overjoyed. We set up dbt projects and profiles, dedicated macros for our models, and built more data marts to serve downstream needs. We thought we were done — …

analytics-engineering data science dbt sql

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Machine Learning Research Scientist

@ d-Matrix | San Diego, Ca