CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media texts

arXiv:2309.05494v3 Announce Type: replace
Abstract: Social media platforms play an essential role in crisis communication, but analyzing crisis-related social media texts is challenging due to their informal nature. Transformer-based pre-trained models like BERT and RoBERTa have shown success in various NLP tasks, but they are not tailored for crisis-related texts. Furthermore, general-purpose sentence encoders are used to generate sentence embeddings, regardless of the textual complexities in crisis-related texts. Advances in applications like text classification, semantic search, and clustering contribute to …

arxiv crisis cs.cl language language models media social social media type