DetCLIPv3: Towards Versatile Generative Open-vocabulary Object Detection

arXiv:2404.09216v1 Announce Type: new
Abstract: Existing open-vocabulary object detectors typically require a predefined set of categories from users, significantly confining their application scenarios. In this paper, we introduce DetCLIPv3, a high-performing detector that excels not only at both open-vocabulary object detection, but also generating hierarchical labels for detected objects. DetCLIPv3 is characterized by three core designs: 1. Versatile model architecture: we derive a robust open-set detection framework which is further empowered with generation ability via the integration of a caption …

abstract application arxiv cs.cv detection detectors generative hierarchical labels object objects paper set type