all AI news
GPTSee: Enhancing Moment Retrieval and Highlight Detection via Description-Based Similarity Features
March 5, 2024, 2:48 p.m. | Yunzhuo Sun, Yifang Xu, Zien Xie, Yukun Shu, Sidan Du
cs.CV updates on arXiv.org arxiv.org
Abstract: Moment retrieval (MR) and highlight detection (HD) aim to identify relevant moments and highlights in video from corresponding natural language query. Large language models (LLMs) have demonstrated proficiency in various computer vision tasks. However, existing methods for MR\&HD have not yet been integrated with LLMs. In this letter, we propose a novel two-stage model that takes the output of LLMs as the input to the second-stage transformer encoder-decoder. First, MiniGPT-4 is employed to generate the …
abstract aim arxiv computer computer vision cs.ai cs.cv detection features highlight highlights identify language language models large language large language models llms moments natural natural language natural language query query retrieval tasks type via video vision
More from arxiv.org / cs.CV updates on arXiv.org
Compact 3D Scene Representation via Self-Organizing Gaussian Grids
2 days, 17 hours ago |
arxiv.org
Fingerprint Matching with Localized Deep Representation
2 days, 17 hours ago |
arxiv.org
Jobs in AI, ML, Big Data
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne