May 23, 2022, 9:43 a.m. | /u/suoarski

Machine Learning www.reddit.com

So I am working with a Unet (CNN) architecture with an Adam optimizer. Occasionally I have forced stopped the model, saved the weights, then resumed the training later on. When I resume, the loss plot seems to look less smooth compared to what it did earlier, but the loss also seems to have decreased significantly.

Is it generally safe to stop and resume model training in this way? Also, I'm not sure how to interpret the decreased but less smooth …

machinelearning resume tensorflow training

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Data Engineer

@ Paxos | Remote - United States

Data Analytics Specialist

@ Media.Monks | Kuala Lumpur

Software Engineer III- Pyspark

@ JPMorgan Chase & Co. | India

Engineering Manager, Data Infrastructure

@ Dropbox | Remote - Canada

Senior AI NLP Engineer

@ Hyro | Tel Aviv-Yafo, Tel Aviv District, Israel