BizBench: A Quantitative Reasoning Benchmark for Business and Finance

arXiv:2311.06602v2 Announce Type: replace
Abstract: Answering questions within business and finance requires reasoning, precision, and a wide-breadth of technical knowledge. Together, these requirements make this domain difficult for large language models (LLMs). We introduce BizBench, a benchmark for evaluating models' ability to reason about realistic financial problems. BizBench comprises eight quantitative reasoning tasks, focusing on question-answering (QA) over financial data via program synthesis. We include three financially-themed code-generation tasks from newly collected and augmented QA data. Additionally, we isolate the …

abstract arxiv benchmark business cs.cl domain finance financial for business knowledge language language models large language large language models llms precision quantitative questions reason reasoning requirements technical together type