Automated Audio Captioning with Epochal Difficult Captions for Curriculum Learning. (arXiv:2206.01918v1 [cs.CL])

In this paper, we propose an algorithm, Epochal Difficult Captions, to
supplement the training of any model for the Automated Audio Captioning task.
Epochal Difficult Captions is an elegant evolution to the keyword estimation
task that previous work have used to train the encoder of the AAC model.
Epochal Difficult Captions modifies the target captions based on a curriculum
and a difficulty level determined as a function of current epoch. Epochal
Difficult Captions can be used with any model architecture …

arxiv audio captioning curriculum curriculum learning learning