TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Sampling

arXiv:2310.01819v3 Announce Type: replace
Abstract: Generating creative combinatorial objects from two seemingly unrelated object texts is a challenging task in text-to-image synthesis, often hindered by a focus on emulating existing data distributions. In this paper, we develop a straightforward yet highly effective method, called \textbf{balance swap-sampling}. First, we propose a swapping mechanism that generates a novel combinatorial object image set by randomly exchanging intrinsic elements of two text embeddings through a cutting-edge diffusion model. Second, we introduce a balance swapping …

abstract arxiv balance creative cs.cv data focus image object objects paper sampling synthesis text text-to-image type