Gemma: Open Models Based on Gemini Research and Technology

arXiv:2403.08295v1 Announce Type: new
Abstract: This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models. Gemma models demonstrate strong performance across academic benchmarks for language understanding, reasoning, and safety. We release two sizes of models (2 billion and 7 billion parameters), and provide both pretrained and fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out of 18 text-based tasks, and we present comprehensive evaluations of …

abstract academic art arxiv benchmarks billion cs.ai cs.cl family gemini gemma language language understanding open models performance reasoning release research safety state technology type understanding work