External Knowledge Enhanced 3D Scene Generation from Sketch

arXiv:2403.14121v1 Announce Type: new
Abstract: Generating realistic 3D scenes is challenging due to the complexity of room layouts and object geometries.We propose a sketch based knowledge enhanced diffusion architecture (SEK) for generating customized, diverse, and plausible 3D scenes. SEK conditions the denoising process with a hand-drawn sketch of the target scene and cues from an object relationship knowledge base. We first construct an external knowledge base containing object relationships and then leverage knowledge enhanced graph reasoning to assist our model …

3d scene generation 3d scenes abstract architecture arxiv complexity cs.cv denoising diffusion diverse knowledge object process room type