Learning to Defer in Content Moderation: The Human-AI Interplay

arXiv:2402.12237v1 Announce Type: new
Abstract: Successful content moderation in online platforms relies on a human-AI collaboration approach. A typical heuristic estimates the expected harmfulness of a post and uses fixed thresholds to decide whether to remove it and whether to send it for human review. This disregards the prediction uncertainty, the time-varying element of human review capacity and post arrivals, and the selective sampling in the dataset (humans only review posts filtered by the admission algorithm).
In this paper, we …

abstract ai collaboration arxiv collaboration content moderation cs.ai cs.gt cs.hc cs.lg cs.pf human moderation online platforms platforms prediction review type uncertainty