[D] CycleGAN performance immediately deteriorates

Hi, I've been trying to train a CycleGAN on spectrograms for a while now but I'm really struggling to get very far. I'm using this model and a dataset of about 6000 512x512 mel spectrograms. No matter what I do, my results start of at their best (not necessarily great) and get worse after 1, maybe 2 epochs, and eventually descend to mostly noise. For a long time 'the best' wasn't very good, however I've finally got somewhere so the …

cyclegan dataset machinelearning performance