LAiW: A Chinese Legal Large Language Models Benchmark

arXiv:2310.05620v2 Announce Type: replace
Abstract: General and legal domain LLMs have demonstrated strong performance in various tasks of LegalAI. However, the current evaluations of these LLMs in LegalAI are defined by the experts of computer science, lacking consistency with the logic of legal practice, making it difficult to judge their practical capabilities. To address this challenge, we are the first to build the Chinese legal LLMs benchmark LAiW, based on the logic of legal practice. To align with the thinking …

abstract arxiv benchmark capabilities chinese computer computer science cs.cl current domain experts general judge language language models large language large language models legal llms logic making performance practical practice science tasks type