Language-guided Semantic Style Transfer of 3D Indoor Scenes. (arXiv:2208.07870v1 [cs.CV])

We address the new problem of language-guided semantic style transfer of 3D
indoor scenes. The input is a 3D indoor scene mesh and several phrases that
describe the target scene. Firstly, 3D vertex coordinates are mapped to RGB
residues by a multi-layer perceptron. Secondly, colored 3D meshes are
differentiablly rendered into 2D images, via a viewpoint sampling strategy
tailored for indoor scenes. Thirdly, rendered 2D images are compared to
phrases, via pre-trained vision-language models. Lastly, errors are
back-propagated to the …

3d arxiv cv language semantic style transfer transfer