The Rise of ‘Small Language Models’ and Reinforcement Learning

This week, several companies staked out new ground in the latest forefront of AI research: trying to prove that their models can do more with less. On Monday, the French AI startup Mistral—fresh off its $415 million funding round—published a new model called Mixtral 8x7B. The model, which is open-source, quickly racked up plaudits from AI researchers for its ability to match the quality of GPT-3.5 on some benchmarks despite its relatively puny size. Mixtral is small …

ai research companies french french ai startup funding funding round language language models mistral mixtral mixtral 8x7b monday reinforcement reinforcement learning research small small language models startup