Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra

arXiv:2404.03647v1 Announce Type: cross
Abstract: In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra in solving undergraduate-level control problems. Controls provides an interesting case study for LLM reasoning due to its combination of mathematical theory and engineering design. We introduce ControlBench, a benchmark dataset tailored to reflect the breadth, depth, and complexity of classical control design. We use this dataset to study and evaluate the problem-solving …

abstract art arxiv benchmark capabilities case case study claude claude 3 claude 3 opus control cs.ai cs.lg engineering explore gemini gpt gpt-4 language language models large language large language models llms math.oc opus paper state study type undergraduate