Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferences

arXiv:2404.08666v1 Announce Type: cross
Abstract: Natural language processing (NLP) has grown significantly since the advent of the Transformer architecture. Transformers have given birth to pre-trained large language models (PLMs). There has been tremendous improvement in the performance of NLP systems across several tasks. NLP systems are on par or, in some cases, better than humans at accomplishing specific tasks. However, it remains the norm that \emph{better quality datasets at the time of pretraining enable PLMs to achieve better performance, regardless …

abstract acl architecture arxiv birth conferences cs.cl cs.lg datasets emnlp improvement language language models language processing large language large language models natural natural language natural language processing nlp nlp systems performance processing systems tasks transformer transformer architecture transformers trends type