Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipedia. (arXiv:2209.10474v1 [cs.CV])

Humans exploit prior knowledge to describe images, and are able to adapt
their explanation to specific contextual information, even to the extent of
inventing plausible explanations when contextual information and images do not
match. In this work, we propose the novel task of captioning Wikipedia images
by integrating contextual knowledge. Specifically, we produce models that
jointly reason over Wikipedia articles, Wikimedia images and their associated
descriptions to produce contextualized captions. Particularly, a similar
Wikimedia image can be used to illustrate …

arxiv captioning image wikipedia