MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignment

arXiv:2404.02899v1 Announce Type: new
Abstract: We present MatAtlas, a method for consistent text-guided 3D model texturing. Following recent progress we leverage a large scale text-to-image generation model (e.g., Stable Diffusion) as a prior to texture a 3D model. We carefully design an RGB texturing pipeline that leverages a grid pattern diffusion, driven by depth and edges. By proposing a multi-step texture refinement process, we significantly improve the quality and 3D consistency of the texturing output. To further address the problem …

abstract arxiv consistent cs.cv cs.gr design diffusion geometry grid image image generation material pipeline prior progress scale stable diffusion text text-to-image texture type