June 1, 2023, 3:16 p.m. | /u/BlockPretty5695

Machine Learning www.reddit.com

From what I gather, the SOTA in Named entity recognition/relation extraction is still finetuning encoder models (Roberta, etc) on the domain text, and then the task specific training (for NER this would be token classification).

With all the developments that have been occurring with autoregressive models, has anyone worked on applying them to the NER and RE, specifically for a fairly specific task, not just your basic <ORG> <PERSON> <LOC>?

Thanks!

autoregressive model autoregressive models classification encoder etc extraction finetuning machinelearning ner recognition roberta sota text training

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Tableau/PowerBI Developer (A.Con)

@ KPMG India | Bengaluru, Karnataka, India

Software Engineer, Backend - Data Platform (Big Data Infra)

@ Benchling | San Francisco, CA