The Role of Data Curation in Image Captioning

Image captioning models are typically trained by treating all samples equally, neglecting to account for mismatched or otherwise difficult data points. In contrast, recent work has shown the effectiveness of training models by scheduling the data using curriculum learning strategies. This paper contributes to this direction by actively curating difficult samples in datasets without increasing the total number of samples. We explore the effect of using three data curation methods within the training process: complete removal of an sample, caption …

captioning contrast cs.ai cs.cl cs.cv curation curriculum curriculum learning data data curation image paper role samples scheduling strategies training training models work