A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision. (arXiv:2112.13884v2 [cs.CV] UPDATED)

Using natural language as a supervision for training visual recognition
models holds great promise. Recent works have shown that if such supervision is
used in the form of alignment between images and captions in large training
datasets, then the resulting aligned models perform well on zero-shot
classification as downstream tasks2. In this paper, we focus on teasing out
what parts of the language supervision are essential for training zero-shot
image classification models. Through extensive and careful experiments, we show
that: …

arxiv bag cv learning words