[D] GAN training initially degrades results of pre-trained generator

I have an issue with the training of a GAN, which consists of a generator and two discriminators. The generator is used to generate waveforms.

1-The generator is independently pre-trained by regression.

2-The two randomly initialized discriminators are then activated, and GANs training takes place.

The orange curve, represents the l1-norm between input and output: the l1-norm steeply rises for the first few validation steps. In the blue curve, I tried freezing the generator for 80k steps, to allow pre-training …

gan machinelearning training