Multi-Modal Discussion Transformer: Integrating Text, Images and Graph Transformers to Detect Hate Speech on Social Media

arXiv:2307.09312v4 Announce Type: replace-cross
Abstract: We present the Multi-Modal Discussion Transformer (mDT), a novel methodfor detecting hate speech in online social networks such as Reddit discussions. In contrast to traditional comment-only methods, our approach to labelling a comment as hate speech involves a holistic analysis of text and images grounded in the discussion context. This is done by leveraging graph transformers to capture the contextual relationships in the discussion surrounding a comment and grounding the interwoven fusion layers that combine …

abstract arxiv contrast cs.cl cs.lg cs.mm cs.si discussions graph hate speech images labelling media modal multi-modal networks novel reddit social social media social networks speech text transformer transformers type