Multi-modal Transformers Excel at Class-agnostic Object Detection. (arXiv:2111.11430v2 [cs.CV] UPDATED)

What constitutes an object? This has been a long-standing question in
computer vision. Towards this goal, numerous learning-free and learning-based
approaches have been developed to score objectness. However, they generally do
not scale well across new domains and for unseen objects. In this paper, we
advocate that existing methods lack a top-down supervision signal governed by
human-understandable semantics. To bridge this gap, we explore recent
Multi-modal Vision Transformers (MViT) that have been trained with aligned
image-text pairs. Our extensive experiments …

arxiv cv detection excel transformers