Bringing order into the realm of Transformer-based language models for artificial intelligence and law

Transformer-based language models (TLMs) have widely been recognized to be a cutting-edge technology for the successful development of deep-learning-based solutions to problems and applications that require natural language processing and understanding. Like for other textual domains, TLMs have indeed pushed the state-of-the-art of AI approaches for many tasks of interest in the legal domain. Despite the first Transformer model being proposed about six years ago, there has been a rapid progress of this technology at an unprecedented rate, whereby BERT …

applications art artificial artificial intelligence cs.ai cs.cl cs.ir cs.ne development domains edge edge technology indeed intelligence language language models language processing law natural natural language natural language processing physics.soc-ph processing solutions state technology textual transformer understanding