101 Billion Arabic Words Dataset

arXiv:2405.01590v1 Announce Type: new
Abstract: In recent years, Large Language Models have revolutionized the field of natural language processing, showcasing an impressive rise predominantly in English-centric domains. These advancements have set a global benchmark, inspiring significant efforts toward developing Arabic LLMs capable of understanding and generating the Arabic language with remarkable accuracy. Despite these advancements, a critical challenge persists: the potential bias in Arabic LLMs, primarily attributed to their reliance on datasets comprising English data that has been translated into …

abstract accuracy arabic arxiv benchmark billion cs.cl dataset domains english global language language models language processing large language large language models llms natural natural language natural language processing processing set type understanding words