eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure

arXiv:2406.16490v1 Announce Type: new
Abstract: This study investigates the performance of the zero-shot method in classifying data using three large language models, alongside two models with large input token sizes and the two pre-trained models on legal data. Our main dataset comes from the domain of U.S. civil procedure. It includes summaries of legal cases, specific questions, potential answers, and detailed explanations for why each solution is relevant, all sourced from a book aimed at law students. By comparing different …

abstract argument arxiv civil cs.cl data dataset domain input language language models large language large language models legal performance pre-trained models reasoning study token type zero-shot