Achieving state-of-the-art for offensive tweet prediction using transformers

Utilising DistilBERT and fine-tuning for text classification

Whilst it’s easy to take for granted that tools like Hugging Face make it easy to apply complex models and transfer learning to any problem we like, I thought it would be beneficial to show that these tools can actually achieve state-of-the-art (SOTA) results in an afternoon. Otherwise, what’s the point in trying?

Our task will be to predict whether a tweet is inoffensive or not. To …

art hugging face naturallanguageprocessing prediction state text classification transformers tweet twitter