Rayleigh EigenDirections (REDs): GAN latent space traversals for multidimensional features. (arXiv:2201.10423v1 [cs.CV])

Web: http://arxiv.org/abs/2201.10423

We present a method for finding paths in a deep generative model's latent
space that can maximally vary one set of image features while holding others
constant. Crucially, unlike past traversal approaches, ours can manipulate
multidimensional features of an image such as facial identity and pixels within
a specified region. Our method is principled and conceptually simple: optimal
traversal directions are chosen by maximizing differential changes to one
feature set such that changes to another set are negligible. We show …

arxiv cv gan space