Polling Latent Opinions: A Method for Computational Sociolinguistics Using Transformer Language Models. (arXiv:2204.07483v1 [cs.CL])

Text analysis of social media for sentiment, topic analysis, and other
analysis depends initially on the selection of keywords and phrases that will
be used to create the research corpora. However, keywords that researchers
choose may occur infrequently, leading to errors that arise from using small
samples. In this paper, we use the capacity for memorization, interpolation,
and extrapolation of Transformer Language Models such as the GPT series to
learn the linguistic behaviors of a subgroup within larger corpora of …

arxiv computational language language models opinions polling transformer