Microsoft's small language model outperforms larger models on standardized math tests

A small team of AI researchers at Microsoft reports that the company's Orca-Math small language model outperforms other, larger models on standardized math tests. The group has published a paper on the arXiv preprint server describing their testing of Orca-Math on the Grade School Math 8K (GSM8K) benchmark and how it fared compared to well-known LLMs.

ai researchers arxiv benchmark computer sciences language language model larger models math microsoft orca paper reports researchers school server small small language model team testing tests the company