March 22, 2024, 2:02 p.m. | Richie Bachala

Towards AI - Medium pub.towardsai.net

Building an Enterprise Data Lake with Snowflake Data Cloud & Azure using the SDLS Framework.

Over the years, my team of data engineers has managed 1000s of data integration and movement workflows, utilizing a range of ETL/ELT solutions alongside Oracle PL/SQL, Python, and Linux Scripts. We’ve also managed 100s of streaming workflows using open-source Kafka, although we won’t be focusing on streaming aspects in this blog.

One persistent challenge we encountered was the impact of undocumented database object changes in …

azure data data engineering data lake snowflake

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Data Analyst (Digital Business Analyst)

@ Activate Interactive Pte Ltd | Singapore, Central Singapore, Singapore