MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models

arXiv:2309.12284v4 Announce Type: replace
Abstract: Large language models (LLMs) have pushed the limits of natural language understanding and exhibited excellent problem-solving ability. Despite the great success, most existing open-source LLMs (e.g., LLaMA-2) are still far away from satisfactory for solving mathematical problem due to the complex reasoning procedures. To bridge this gap, we propose MetaMath, a fine-tuned language model that specializes in mathematical reasoning. Specifically, we start by bootstrapping mathematical questions by rewriting the question from multiple perspectives without extra …

abstract arxiv bootstrap bridge cs.ai cs.cl language language models language understanding large language large language models llama llms natural natural language problem-solving questions reasoning success type understanding