all AI news
Re-Bundling The Data Stack With Data Orchestration And Software Defined Assets Using Dagster
July 24, 2022, 11 p.m. | Tobias Macey
Data Engineering Podcast www.dataengineeringpodcast.com
Summary
The current stage of evolution in the data management ecosystem has resulted in domain and use case specific orchestration capabilities being incorporated into various tools. This complicates the work involved in making end-to-end workflows visible and integrated. Dagster has invested in bringing insights about external tools’ dependency graphs into one place through its "software defined assets" functionality. In this episode Nick Schrock discusses the importance of orchestration and a central location for managing data systems, the road to Dagster’s …
More from www.dataengineeringpodcast.com / Data Engineering Podcast
Making Email Better With AI At Shortwave
3 days, 2 hours ago |
www.dataengineeringpodcast.com
Designing A Non-Relational Database Engine
1 week, 3 days ago |
www.dataengineeringpodcast.com
Reconciling The Data In Your Databases With Datafold
1 month, 1 week ago |
www.dataengineeringpodcast.com
When And How To Conduct An AI Program
1 month, 3 weeks ago |
www.dataengineeringpodcast.com
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Social Insights & Data Analyst (Freelance)
@ Media.Monks | Jakarta
Cloud Data Engineer
@ Arkatechture | Portland, ME, USA