MovieLLM: Enhancing Long Video Understanding with AI-Generated Movies

arXiv:2403.01422v1 Announce Type: new
Abstract: The development of multimodal models has marked a significant step forward in how machines understand videos. These models have shown promise in analyzing short video clips. However, when it comes to longer formats like movies, they often fall short. The main hurdles are the lack of high-quality, diverse video data and the intensive work required to collect or annotate such data. In the face of these challenges, we propose MovieLLM, a novel framework designed to …

abstract arxiv cs.cv development generated machines movies multimodal multimodal models quality type understanding video videos video understanding