Microsoft claims that small, localized language models can be powerful as well

Microsoft has announced the development of a small, locally run family of AI language models called Phi-3 mini. In their Technical Report posted on the arXiv preprint server, the team behind the new SLM describes it as more capable than others of its size and more cost effective than larger models. They also claim it outperforms many models in its class and even some that are larger.

ai language models arxiv business cost development family language language models microsoft phi phi-3 report server slm small team technical