Feb. 12, 2024, 5:46 a.m. | Shima Imani Hamid Palangi

cs.CL updates on arXiv.org arxiv.org

Large Language Models (LLMs) have demonstrated impressive performance across a wide range of applications; however, assessing their reasoning capabilities remains a significant challenge. In this paper, we introduce a framework grounded in group and symmetry principles, which have played a crucial role in fields such as physics and mathematics, and offer another way to evaluate their capabilities. While the proposed framework is general, to showcase the benefits of employing these properties, we focus on arithmetic reasoning and investigate the performance …

applications capabilities challenge cs.cl fields framework language language models large language large language models llms mathematics paper performance physics reasoning role symmetry

Research Scholar (Technical Research)

@ Centre for the Governance of AI | Hybrid; Oxford, UK

HPC Engineer (x/f/m) - DACH

@ Meshcapade GmbH | Remote, Germany

Data Science Advisor

@ Blue Yonder | Hamburg

Data Analyst

@ Sinch | São Paulo, State of São Paulo, Brazil - Remote

Data Engineer - Híbrido

@ SGS | Callao, Peru

Senior Analytics Engineer Brazil

@ Hiflylabs | Blumenau, Hungary