Yi: Open Foundation Models by 01.AI

arXiv:2403.04652v1 Announce Type: new
Abstract: We introduce the Yi model family, a series of language and multimodal models that demonstrate strong multi-dimensional capabilities. The Yi model family is based on 6B and 34B pretrained language models, then we extend them to chat models, 200K long context models, depth-upscaled models, and vision-language models. Our base models achieve strong performance on a wide range of benchmarks like MMLU, and our finetuned chat models deliver strong human preference rate on major evaluation platforms …

01.ai abstract arxiv capabilities chat context cs.ai cs.cl family foundation language language models multimodal multimodal models series them type upscaled vision vision-language models