How is your notebook experimentation workflow ?

I am starting as a data scientist now and have struggled with some experimental problems. As you all know, notebooks do not help much with organization.
I recently conducted an experiment to recommend products using OpenAI embeddings.

So, my workflow was as follows:

1. I tried to divide my experiment into smaller sections within different notebooks, like one notebook for loading data, another for preprocessing.
2.I used argparse to load a config file.The final notebook generates the results and uses …

data datascience data scientist embeddings experiment experimental experimentation notebook notebooks openai organization products workflow