From Jupyter to Kubernetes: Refactoring and Deploying Notebooks Using Open-Source Tools

Software Engineering For Data Science

A step-by-step guide to going from a messy notebook to a pipeline running in Kubernetes

Notebooks are great for rapid iterations and prototyping but quickly get messy. After working on a notebook, my code becomes difficult to manage and unsuitable for deployment. In production, code organization is essential for maintainability (it’s much easier to improve and debug organized code than a long, messy notebook).

In this post, I’ll describe …

data science jupyter jupyter-notebook kubernetes machine learning notebooks open source refactoring tools