Breeze-7B Technical Report

arXiv:2403.02712v1 Announce Type: new
Abstract: Breeze-7B is an open-source language model based on Mistral-7B, designed to address the need for improved language comprehension and chatbot-oriented capabilities in Traditional Chinese. This technical report provides an overview of the additional pretraining, finetuning, and evaluation stages for the Breeze-7B model. The Breeze-7B family of base and chat models exhibits good performance on language comprehension and chatbot-oriented tasks, reaching the top in several benchmarks among models comparable in its complexity class.

abstract arxiv capabilities chat chatbot chinese cs.cl evaluation family finetuning good language language model mistral overview pretraining report technical type