RakutenAI-7B: Extending Large Language Models for Japanese

arXiv:2403.15484v1 Announce Type: cross
Abstract: We introduce RakutenAI-7B, a suite of Japanese-oriented large language models that achieve the best performance on the Japanese LM Harness benchmarks among the open 7B models. Along with the foundation model, we release instruction- and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat respectively, under the Apache 2.0 license.

abstract apache apache 2.0 arxiv benchmarks chat cs.cl cs.lg foundation foundation model harness japanese language language models large language large language models license performance release type