SkIn: Skimming-Intensive Long-Text Classification Using BERT for Medical Corpus. (arXiv:2209.05741v2 [cs.CL] UPDATED)

BERT is a widely used pre-trained model in natural language processing.
However, since BERT is quadratic to the text length, the BERT model is
difficult to be used directly on the long-text corpus. In some fields, the
collected text data may be quite long, such as in the health care field.
Therefore, to apply the pre-trained language knowledge of BERT to long text, in
this paper, imitating the skimming-intensive reading method used by humans when
reading a long paragraph, the …

arxiv bert classification medical text text classification