Enriching StyleGAN with Illumination Physics. (arXiv:2205.10351v1 [cs.CV])

StyleGAN generates novel images of a scene from latent codes which are
impressively disentangled. But StyleGAN generates images that are "like" its
training set. This paper shows how to use simple physical properties of images
to enrich StyleGAN's generation capacity. We use an intrinsic image method to
decompose an image, then search the latent space of a pretrained StyleGAN to
find novel directions that fix one component (say, albedo) and vary another
(say, shading). Therefore, we can change the lighting …

arxiv cv physics