Towards Understanding Counseling Conversations: Domain Knowledge and Large Language Models

arXiv:2402.14200v1 Announce Type: new
Abstract: Understanding the dynamics of counseling conversations is an important task, yet it is a challenging NLP problem regardless of the recent advance of Transformer-based pre-trained language models. This paper proposes a systematic approach to examine the efficacy of domain knowledge and large language models (LLMs) in better representing conversations between a crisis counselor and a help seeker. We empirically show that state-of-the-art language models such as Transformer-based models and GPT models fail to predict the …

abstract advance arxiv conversations cs.cl domain domain knowledge dynamics knowledge language language models large language large language models llms nlp paper transformer type understanding