[D] Language Modeling for Sequence Labeling of Long Text with Specialized Corpus

Hi everyone,

I have a non-standard-class (not PER/ORG etc.) sequence labeling task that I want to tackle with pretrained language models however the task has some attributes that make it difficult to use the standard methods such as using a pretrained NER model thus wanted to see if my planned approach is the best.

The task:

* Sequence Labeling with custom classes (not PERSON, ORG, LOCATION etc.)
* Very Long Text =\~ 20k+ tokens
* Specialized corpus
* Tokens that …

labeling language machinelearning modeling text