Domain-Specific Improvement on Psychotherapy Chatbot Using Assistant

arXiv:2404.16160v1 Announce Type: new
Abstract: Large language models (LLMs) have demonstrated impressive generalization capabilities on specific tasks with human-written instruction data. However, the limited quantity, diversity, and professional expertise of such instruction data raise concerns about the performance of LLMs in psychotherapy tasks when provided with domain-specific instructions. To address this, we firstly propose Domain-Specific Assistant Instructions based on AlexanderStreet therapy, and secondly, we use an adaption fine-tuning method and retrieval augmented generation method to improve pre-trained LLMs. Through quantitative …

abstract arxiv assistant capabilities chatbot concerns cs.ai cs.cl data diversity domain expertise however human improvement language language models large language large language models llms performance professional raise specific tasks tasks type