Styleformer: Transformer based Generative Adversarial Networks with Style Vector. (arXiv:2106.07023v3 [cs.CV] UPDATED)

We propose Styleformer, which is a style-based generator for GAN
architecture, but a convolution-free transformer-based generator. In our paper,
we explain how a transformer can generate high-quality images, overcoming the
disadvantage that convolution operations are difficult to capture global
features in an image. Furthermore, we change the demodulation of StyleGAN2 and
modify the existing transformer structure (e.g., residual connection, layer
normalization) to create a strong style-based generator with a convolution-free
structure. We also make Styleformer lighter by applying Linformer, enabling …

arxiv cv generative adversarial networks networks styleformer transformer vector