LLM-AD: Large Language Model based Audio Description System

arXiv:2405.00983v1 Announce Type: new
Abstract: The development of Audio Description (AD) has been a pivotal step forward in making video content more accessible and inclusive. Traditionally, AD production has demanded a considerable amount of skilled labor, while existing automated approaches still necessitate extensive training to integrate multimodal inputs and tailor the output from a captioning style to an AD style. In this paper, we introduce an automated AD generation pipeline that harnesses the potent multimodal and instruction-following capacities of GPT-4V(ision). …

abstract arxiv audio automated cs.cv development inputs labor language language model large language large language model llm making multimodal pivotal production skilled training type video while