Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval

arXiv:2403.17998v1 Announce Type: new
Abstract: The increasing prevalence of video clips has sparked growing interest in text-video retrieval. Recent advances focus on establishing a joint embedding space for text and video, relying on consistent embedding representations to compute similarity. However, the text content in existing datasets is generally short and concise, making it hard to fully describe the redundant semantics of a video. Correspondingly, a single text embedding may be less expressive to capture the video embedding and empower the …

abstract advances arxiv compute consistent cs.cv datasets embedding focus however modeling retrieval space stochastic text type video