Fine-tuning vs Prompting, Can Language Models Understand Human Values?

arXiv:2403.09720v1 Announce Type: new
Abstract: Accurately handling the underlying support values in sentences is crucial for understanding the speaker's tendencies, yet it poses a challenging task in natural language understanding (NLU). In this article, we explore the potential of fine-tuning and prompt tuning in this downstream task, using the Human Value Detection 2023. Additionally, we attempt to validate whether models can effectively solve the problem based on the knowledge acquired during the pre-training stage. Simultaneously, our interest lies in the …

abstract article arxiv cs.ai cs.cl explore fine-tuning human language language models language understanding natural natural language nlu prompt prompting prompt tuning speaker support type understanding value values