What does a platypus look like? Generating customized prompts for zero-shot image classification. (arXiv:2209.03320v1 [cs.CV])

Open vocabulary models are a promising new paradigm for image classification.
Unlike traditional classification models, open vocabulary models classify among
any arbitrary set of categories specified with natural language during
inference. This natural language, called "prompts", typically consists of a set
of hand-written templates (e.g., "a photo of a {}") which are completed with
each of the category names. This work introduces a simple method to generate
higher accuracy prompts, without using explicit knowledge of the image domain
and with …

arxiv classification image platypus