Dec. 12, 2023, 5:58 a.m. | /u/__harshit1__

Deep Learning www.reddit.com

Hi. I’m training a simple Autoencoder on Cifar10 with mse loss using Pytorch lightning. After tinkering around the hyperparameters my loss suddenly starts to shoot up out of the blue after about 20epochs for no apparent reason. I am able to control it by clipping gradients but wanted to understand what I’m doing wrong that the model has started to lose stability?

autoencoder control deeplearning lightning loss pytorch pytorch lightning reason simple training

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Data Engineer - Takealot Group (Takealot.com | Superbalist.com | Mr D Food)

@ takealot.com | Cape Town