ML experimentation workflow for the cloud

Hi, fellow data professionals,

I'm thinking about the general structure of how to run ML experiments on the cloud (if any relevance, AWS) and wondering how you guys initialize and keep track of each run? Do you write a separate .py script for each experiment which you then run on reserved virtual machine (e.g. EC2) with some tracking tool (e.g. MLflow)? Or do/use something else?

Any help and examples are appreciated

aws cloud data datascience experiment experimentation general machine professionals thinking virtual virtual machine workflow