Build More Reliable Machine Learning Systems With The Dagster Orchestration Engine

Summary

Building a machine learning model one time can be done in an ad-hoc manner, but if you ever want to update it and serve it in production you need a way of repeating a complex sequence of operations. Dagster is an orchestration engine that understands the data that it is manipulating so that you can move beyond coarse task-based representations of your dependencies. In this episode Sandy Ryza explains how his background in machine learning has informed his work …

dagster data-orchestration machine machine learning mlops orchestration systems