An image speaks a thousand words, but can everyone listen? On translating images for cultural relevance

arXiv:2404.01247v1 Announce Type: cross
Abstract: Given the rise of multimedia content, human translators increasingly focus on culturally adapting not only words but also other modalities such as images to convey the same meaning. While several applications stand to benefit from this, machine translation systems remain confined to dealing with language in speech and text. In this work, we take a first step towards translating images to make them culturally relevant. First, we build three pipelines comprising state-of-the-art generative models to …

arxiv cs.cl cs.cv image images type words