Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model

Large Foundational Language Models are capable of performing many tasks at a high level but are difficult to deploy in many applications because of their size and proprietary ownership. Many will be motivated to distill specific capabilities of foundational models into smaller models that can be owned and controlled. In the development of a therapeutic chatbot, we wish to distill a capability known as reflective listening, in which a therapist produces reflections of client speech. These reflections either restate what …

applications capabilities cs.cl deploy distillation evaluation foundational models interviewing language language model language models ownership proprietary reflections style tasks will