Building an Open Source ML Pipeline: Part 1

Getting Started with our Pipeline — Data Acquisition and Storage.

1. Introduction

In this series of articles I’m interested in trying to put together a basic ML pipeline that takes into consideration modern MLOPs practices. Naturally at the beginning of these projects we set out with a list of requirements, so what do we want our pipeline to do?

• Automatically retrieve data for model training and inference.
• Validate data prior to model inference.
• Automate …

argo building etl machine learning ml mlops open source part pipeline