Understanding Pure CLIP Guidance for Voxel Grid NeRF Models. (arXiv:2209.15172v1 [cs.CV])

We explore the task of text to 3D object generation using CLIP. Specifically,
we use CLIP for guidance without access to any datasets, a setting we refer to
as pure CLIP guidance. While prior work has adopted this setting, there is no
systematic study of mechanics for preventing adversarial generations within
CLIP. We illustrate how different image-based augmentations prevent the
adversarial generation problem, and how the generated results are impacted. We
test different CLIP model architectures and show that ensembling …

arxiv clip guidance nerf understanding voxel