PnP-DETR: Towards Efficient Visual Analysis with Transformers. (arXiv:2109.07036v3 [cs.CV] UPDATED)

Recently, DETR pioneered the solution of vision tasks with transformers, it
directly translates the image feature map into the object detection result.
Though effective, translating the full feature map can be costly due to
redundant computation on some area like the background. In this work, we
encapsulate the idea of reducing spatial redundancy into a novel poll and pool
(PnP) sampling module, with which we build an end-to-end PnP-DETR architecture
that adaptively allocates its computation spatially to be more efficient. …

analysis arxiv cv pnp transformers