Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting

arXiv:2404.12782v1 Announce Type: new
Abstract: Automatic live video commenting is with increasing attention due to its significance in narration generation, topic explanation, etc. However, the diverse sentiment consideration of the generated comments is missing from the current methods. Sentimental factors are critical in interactive commenting, and lack of research so far. Thus, in this paper, we propose a Sentiment-oriented Transformer-based Variational Autoencoder (So-TVAE) network which consists of a sentiment-oriented diversity encoder module and a batch attention module, to achieve diverse …

arxiv autoencoder cs.ai cs.cv network sentiment transformer type video