ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math Questions

arXiv:2312.01661v2 Announce Type: replace
Abstract: Mathematical questioning is crucial for assessing students problem-solving skills. Since manually creating such questions requires substantial effort, automatic methods have been explored. Existing state-of-the-art models rely on fine-tuning strategies and struggle to generate questions that heavily involve multiple steps of logical and arithmetic reasoning. Meanwhile, large language models(LLMs) such as ChatGPT have excelled in many NLP tasks involving logical and arithmetic reasoning. Nonetheless, their applications in generating educational questions are underutilized, especially in the field …

abstract art arxiv chatgpt cs.ai cs.cl fine-tuning generate math multiple problem-solving questions skills state state-of-the-art models strategies struggle students type university