Towards Flexible, Scalable, and Adaptive Multi-Modal Conditioned Face Synthesis

arXiv:2312.16274v2 Announce Type: replace
Abstract: Recent progress in multi-modal conditioned face synthesis has enabled the creation of visually striking and accurately aligned facial images. Yet, current methods still face issues with scalability, limited flexibility, and a one-size-fits-all approach to control strength, not accounting for the differing levels of conditional entropy, a measure of unpredictability in data given some condition, across modalities. To address these challenges, we introduce a novel uni-modal training approach with modal surrogates, coupled with an entropy-aware modal-adaptive …

abstract accounting arxiv control cs.cv current entropy face flexibility images modal multi-modal progress scalability scalable synthesis type