Human vs. LMMs: Exploring the Discrepancy in Emoji Interpretation and Usage in Digital Communication

arXiv:2401.08212v2 Announce Type: replace
Abstract: Leveraging Large Multimodal Models (LMMs) to simulate human behaviors when processing multimodal information, especially in the context of social media, has garnered immense interest due to its broad potential and far-reaching implications. Emojis, as one of the most unique aspects of digital communication, are pivotal in enriching and often clarifying the emotional and tonal dimensions. Yet, there is a notable gap in understanding how these advanced models, such as GPT-4V, interpret and employ emojis in …

abstract arxiv communication context cs.cv digital emoji human information interpretation large multimodal models lmms media multimodal multimodal models processing social social media type usage