DreamPBR: Text-driven Generation of High-resolution SVBRDF with Multi-modal Guidance

arXiv:2404.14676v1 Announce Type: new
Abstract: Prior material creation methods had limitations in producing diverse results mainly because reconstruction-based methods relied on real-world measurements and generation-based methods were trained on relatively small material datasets. To address these challenges, we propose DreamPBR, a novel diffusion-based generative framework designed to create spatially-varying appearance properties guided by text and multi-modal controls, providing high controllability and diversity in material generation. Key to achieving diverse and high-quality PBR material generation lies in integrating the capabilities of …

abstract arxiv challenges create cs.cv cs.gr datasets diffusion diverse framework generative guidance limitations material modal multi-modal novel prior resolution results small text type world