SHE-Net: Syntax-Hierarchy-Enhanced Text-Video Retrieval

arXiv:2404.14066v1 Announce Type: new
Abstract: The user base of short video apps has experienced unprecedented growth in recent years, resulting in a significant demand for video content analysis. In particular, text-video retrieval, which aims to find the top matching videos given text descriptions from a vast video corpus, is an essential function, the primary challenge of which is to bridge the modality gap. Nevertheless, most existing approaches treat texts merely as discrete tokens and neglect their syntax structures. Moreover, the …

abstract analysis apps arxiv challenge cs.cv cs.ir demand function growth retrieval syntax text type vast video videos