ChuXin: 1.6B Technical Report

arXiv:2405.04828v1 Announce Type: new
Abstract: In this report, we present ChuXin, an entirely open-source language model with a size of 1.6 billion parameters. Unlike the majority of works that only open-sourced the model weights and architecture, we have made everything needed to train a model available, including the training data, the training process, and the evaluation code. Our goal is to empower and strengthen the open research community, fostering transparency and enabling a new wave of innovation in the field …

abstract architecture arxiv billion cs.cl data evaluation everything language language model parameters process report technical train training training data type