Llama meets EU: Investigating the European Political Spectrum through the Lens of LLMs

arXiv:2403.13592v1 Announce Type: new
Abstract: Instruction-finetuned Large Language Models inherit clear political leanings that have been shown to influence downstream task performance. We expand this line of research beyond the two-party system in the US and audit Llama Chat in the context of EU politics in various settings to analyze the model's political knowledge and its ability to reason in context. We adapt, i.e., further fine-tune, Llama Chat on speeches of individual euro-parties from debates in the European Parliament to …

abstract arxiv audit beyond chat clear context cs.cl expand influence language language models large language large language models line llama llms performance political politics research spectrum through type