Building for Tomorrow: Assessing the Temporal Persistence of Text Classifiers. (arXiv:2205.05435v6 [cs.CL] UPDATED)

Performance of text classification models tends to drop over time due to
changes in data, which limits the lifetime of a pretrained model. Therefore an
ability to predict a model's ability to persist over time can help design
models that can be effectively used over a longer period of time. In this
paper, we provide a thorough discussion into the problem, establish an
evaluation setup for the task. We look at this problem from a practical
perspective by assessing the …

arxiv building classifiers persistence temporal text