Dec. 12, 2023, 5:58 a.m. | /u/__harshit1__

Deep Learning

Hi. I’m training a simple Autoencoder on Cifar10 with mse loss using Pytorch lightning. After tinkering around the hyperparameters my loss suddenly starts to shoot up out of the blue after about 20epochs for no apparent reason. I am able to control it by clipping gradients but wanted to understand what I’m doing wrong that the model has started to lose stability?

autoencoder control deeplearning lightning loss pytorch pytorch lightning reason simple training

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Robotics Technician - Weekend Day Shift

@ GXO Logistics | Hillsboro, OR, US, 97124

Gen AI Developer

@ NTT DATA | Irving, TX, US

Applied AI/ML - Vice President

@ JPMorgan Chase & Co. | LONDON, United Kingdom

Research Fellow (Computer Science/Engineering/AI)

@ Nanyang Technological University | NTU Main Campus, Singapore

Senior Machine Learning Engineer

@ Rasa | Remote - Germany