all AI news
Assessing LLMs' Mathematical Reasoning in Financial Document Question Answering
Feb. 20, 2024, 5:50 a.m. | Pragya Srivastava, Manuj Malik, Tanuja Ganu
cs.CL updates on arXiv.org arxiv.org
Abstract: Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain. This study explores LLMs' mathematical reasoning on four financial tabular question-answering datasets: TATQA, FinQA, ConvFinQA, and Multihiertt. Through extensive experiments with various models and prompting techniques, we assess how LLMs adapt to complex tables and mathematical tasks. We focus on sensitivity to table complexity and performance variations with …
abstract arxiv capability cs.cl datasets document excel financial language language models language understanding large language large language models llms mathematical reasoning natural natural language question question answering reasoning study tables tabular text through type uncertain understanding unstructured
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Senior Machine Learning Engineer
@ Samsara | Canada - Remote