On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization. (arXiv:2205.11686v1 [cs.CL])

Integrating vision and language has gained notable attention following the
success of pretrained language models. Despite that, a fraction of emerging
multimodal models is suitable for text generation conditioned on images. This
minority is typically developed and evaluated for image captioning, a text
generation task conditioned solely on images with the goal to describe what is
explicitly visible in an image. In this paper, we take a step back and ask: How
do these models work for more complex generative …

arxiv captioning case case study generation images study text text generation