TAPTR: Tracking Any Point with Transformers as Detection

arXiv:2403.13042v1 Announce Type: new
Abstract: In this paper, we propose a simple and strong framework for Tracking Any Point with TRansformers (TAPTR). Based on the observation that point tracking bears a great resemblance to object detection and tracking, we borrow designs from DETR-like algorithms to address the task of TAP. In the proposed framework, in each video frame, each tracking point is represented as a point query, which consists of a positional part and a content part. As in DETR, …

abstract algorithms arxiv bears cs.cv cs.ro designs detection detr framework object observation paper simple tracking transformers type