CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models

arXiv:2404.15677v1 Announce Type: new
Abstract: Recent advances in text-to-image models have opened new frontiers in human-centric generation. However, these models cannot be directly employed to generate images with consistent newly coined identities. In this work, we propose CharacterFactory, a framework that allows sampling new characters with consistent identities in the latent space of GANs for diffusion models. More specifically, we consider the word embeddings of celeb names as ground truths for the identity-consistent generation task and train a GAN model …

arxiv characters consistent cs.cv diffusion diffusion models gans sampling type