HyperFields: Towards Zero-Shot Generation of NeRFs from Text

arXiv:2310.17075v3 Announce Type: replace
Abstract: We introduce HyperFields, a method for generating text-conditioned Neural Radiance Fields (NeRFs) with a single forward pass and (optionally) some fine-tuning. Key to our approach are: (i) a dynamic hypernetwork, which learns a smooth mapping from text token embeddings to the space of NeRFs; (ii) NeRF distillation training, which distills scenes encoded in individual NeRFs into one dynamic hypernetwork. These techniques enable a single network to fit over a hundred unique scenes. We further demonstrate …

abstract arxiv cs.cv distillation dynamic embeddings fields fine-tuning key mapping nerf neural radiance fields replace space text token type zero-shot