[D] VAE: CIFAR-10 & PyTorch - loss not improving

I have implemented a Variational Autoencoder using Conv-6 CNN (VGG-* family) as the encoder and decoder with CIFAR-10 in PyTorch. You can refer to the full code here.

The problem is that the total loss (= reconstruction loss + KL-divergence loss) doesn't improve. Also, the log-variance is almost 0 indicating further that the multivariate Gaussians being mapped in the latent space is not happening as expected, since the log variance should have values between say -4 to +3, etc. …

cifar-10 machinelearning pytorch