Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

arXiv:2402.19479v1 Announce Type: new
Abstract: The quality of the data and annotation upper-bounds the quality of a downstream model. While there exist large text corpora and image-text pairs, high-quality video-text data is much harder to collect. First of all, manual labeling is more time-consuming, as it requires an annotator to watch an entire video. Second, videos have a temporal dimension, consisting of several scenes stacked together, and showing multiple actions. Accordingly, to establish a video dataset with high-quality captions, we …

abstract annotation arxiv captioning cs.cv data image labeling multiple quality teachers text type video videos