Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark

arXiv:2401.13888v2 Announce Type: replace
Abstract: Despite the recent emergence of video captioning models, how to generate the text description with specific entity names and fine-grained actions is far from being solved, which however has great applications such as basketball live text broadcast. In this paper, a new multimodal knowledge graph supported basketball benchmark for video captioning is proposed. Specifically, we construct a multimodal basketball game knowledge graph (KG_NBA_2022) to provide additional knowledge beyond videos. Then, a multimodal basketball game video …

abstract applications arxiv basketball benchmark broadcast captioning cs.cv emergence fine-grained generate graph knowledge knowledge graph multimodal new multimodal paper text type video