Video ReCap: Recursive Captioning of Hour-Long Videos

arXiv:2402.13250v1 Announce Type: new
Abstract: Most video captioning models are designed to process short video clips of few seconds and output text describing low-level visual concepts (e.g., objects, scenes, atomic actions). However, most real-world videos last for minutes or hours and have a complex hierarchical structure spanning different temporal granularities. We propose Video ReCap, a recursive video captioning model that can process video inputs of dramatically different lengths (from 1 second to 2 hours) and output video captions at multiple …

arxiv captioning cs.cv hour recap recursive type video videos