AWOL: Analysis WithOut synthesis using Language

arXiv:2404.03042v1 Announce Type: new
Abstract: Many classical parametric 3D shape models exist, but creating novel shapes with such models requires expert knowledge of their parameters. For example, imagine creating a specific type of tree using procedural graphics or a new kind of animal from a statistical shape model. Our key idea is to leverage language to control such existing models to produce novel shapes. This involves learning a mapping between the latent space of a vision-language model and the parameter …

abstract analysis arxiv cs.cv example expert graphics imagine key kind knowledge language novel parameters parametric statistical synthesis tree type