ChatGPT vs Gemini vs LLaMA on Multilingual Sentiment Analysis

Automated sentiment analysis using Large Language Model (LLM)-based models like ChatGPT, Gemini or LLaMA2 is becoming widespread, both in academic research and in industrial applications. However, assessment and validation of their performance in case of ambiguous or ironic text is still poor. In this study, we constructed nuanced and ambiguous scenarios, we translated them in 10 languages, and we predicted their associated sentiment using popular LLMs. The results are validated against post-hoc human responses. Ambiguous scenarios are often well-coped by …

academic academic research analysis applications assessment automated case chatgpt cs.ai cs.cl gemini industrial language language model large language large language model llama llama2 llm multilingual performance research sentiment sentiment analysis study text validation