Enhancing DETRs Variants through Improved Content Query and Similar Query Aggregation

arXiv:2405.03318v1 Announce Type: new
Abstract: The design of the query is crucial for the performance of DETR and its variants. Each query consists of two components: a content part and a positional one. Traditionally, the content query is initialized with a zero or learnable embedding, lacking essential content information and resulting in sub-optimal performance. In this paper, we introduce a novel plug-and-play module, Self-Adaptive Content Query (SACQ), to address this limitation. The SACQ module utilizes features from the transformer encoder …

abstract aggregation arxiv components cs.cv cs.mm design detr embedding information part performance query through type variants