"You are an expert annotator": Automatic Best-Worst-Scaling Annotations for Emotion Intensity Modeling

arXiv:2403.17612v1 Announce Type: new
Abstract: Labeling corpora constitutes a bottleneck to create models for new tasks or domains. Large language models mitigate the issue with automatic corpus labeling methods, particularly for categorical annotations. Some NLP tasks such as emotion intensity prediction, however, require text regression, but there is no work on automating annotations for continuous label assignments. Regression is considered more challenging than classification: The fact that humans perform worse when tasked to choose values from a rating scale lead …

abstract annotations arxiv categorical cs.cl domains emotion expert however intensity issue labeling language language models large language large language models modeling nlp prediction regression scaling tasks text type