MaPa: Text-driven Photorealistic Material Painting for 3D Shapes

arXiv:2404.17569v1 Announce Type: new
Abstract: This paper aims to generate materials for 3D meshes from text descriptions. Unlike existing methods that synthesize texture maps, we propose to generate segment-wise procedural material graphs as the appearance representation, which supports high-quality rendering and provides substantial flexibility in editing. Instead of relying on extensive paired data, i.e., 3D meshes with material graphs and corresponding text descriptions, to train a material graph generative model, we propose to leverage the pre-trained 2D diffusion model as …

arxiv cs.cv material painting photorealistic text type