CFBenchmark: Chinese Financial Assistant Benchmark for Large Language Model

arXiv:2311.05812v2 Announce Type: replace
Abstract: Large language models (LLMs) have demonstrated great potential in the financial domain. Thus, it becomes important to assess the performance of LLMs in the financial tasks. In this work, we introduce CFBenchmark, to evaluate the performance of LLMs for Chinese financial assistant. The basic version of CFBenchmark is designed to evaluate the basic ability in Chinese financial text processing from three aspects~(\emph{i.e.} recognition, classification, and generation) including eight tasks, and includes financial texts ranging in …

arxiv assistant benchmark chinese cs.cl financial language language model large language large language model replace type