all AI news
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
March 6, 2024, 5:42 a.m. | Zhengyang Tang, Xingxing Zhang, Benyou Wan, Furu Wei
cs.LG updates on arXiv.org arxiv.org
Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in problem-solving. However, their proficiency in solving mathematical problems remains inadequate. We propose MathScale, a simple and scalable method to create high-quality mathematical reasoning data using frontier LLMs (e.g., {\tt GPT-3.5}). Inspired by the cognitive mechanism in human mathematical learning, it first extracts topics and knowledge points from seed math questions and then build a concept graph, which is subsequently used to generate new math questions. MathScale …
abstract arxiv capabilities cognitive cs.ai cs.cl cs.lg data gpt gpt-3 gpt-3.5 human language language models large language large language models llms mathematical reasoning problem-solving quality reasoning scalable scaling simple type
More from arxiv.org / cs.LG updates on arXiv.org
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Principal Machine Learning Engineer (AI, NLP, LLM, Generative AI)
@ Palo Alto Networks | Santa Clara, CA, United States
Consultant Senior Data Engineer F/H
@ Devoteam | Nantes, France