Understanding Outliers in Text Data with Transformers, Cleanlab, and Topic Modeling

Understanding Outliers in Text Data with Transformers, cleanlab, and Topic Modeling

An open-source python workflow to audit text datasets

Many text corpora contain heterogeneous documents, some of which may be anomalous and worth understanding more. For deployed ML systems, in particular, we may want to automatically flag test documents that do not stem from the same distribution as their training data and understand emerging themes within these new documents that were absent from the …

data modeling nlp outlier-detection outliers text topic modeling transformers understanding