Text2Model: Text-based Model Induction for Zero-shot Image Classification

arXiv:2210.15182v2 Announce Type: replace-cross
Abstract: We address the challenge of building task-agnostic classifiers using only text descriptions, demonstrating a unified approach to image classification, 3D point cloud classification, and action recognition from scenes. Unlike approaches that learn a fixed representation of the output classes, we generate at inference time a model tailored to a query classification task. To generate task-based zero-shot classifiers, we train a hypernetwork that receives class descriptions and outputs a multi-class model. The hypernetwork is designed to …

abstract action recognition arxiv building challenge classification classifiers cloud cs.cv cs.lg generate image inference learn recognition representation text type zero-shot