Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca

arXiv:2304.08177v3 Announce Type: replace-cross
Abstract: Large Language Models (LLMs), such as ChatGPT and GPT-4, have dramatically transformed natural language processing research and shown promising strides towards Artificial General Intelligence (AGI). Nonetheless, the high costs associated with training and deploying LLMs present substantial obstacles to transparent, accessible academic research. While several large language models, such as LLaMA, have been open-sourced by the community, these predominantly focus on English corpora, limiting their usefulness for other languages. In this paper, we propose a …

alpaca arxiv chinese cs.cl cs.hc cs.lg encoding llama text type