Automatic Evaluation for Mental Health Counseling using LLMs

arXiv:2402.11958v1 Announce Type: new
Abstract: High-quality psychological counseling is crucial for mental health worldwide, and timely evaluation is vital for ensuring its effectiveness. However, obtaining professional evaluation for each counseling session is expensive and challenging. Existing methods that rely on self or third-party manual reports to assess the quality of counseling suffer from subjective biases and limitations of time-consuming.
To address above challenges, this paper proposes an innovative and efficient automatic approach using large language models (LLMs) to evaluate the …

abstract arxiv cs.cl evaluation health llms mental health professional quality reports session type vital