Baichuan2-Sum: Instruction Finetune Baichuan2-7B Model for Dialogue Summarization

Large language models (LLMs) like Llama, Baichuan and Bloom models show remarkable ability with instruction fine-tuning in many natural language tasks. Nevertheless, for the dialogue summarization task, which aims to generate summaries for different roles in dialogue, most of the state-of-the-art methods conduct on small models (e.g Bart and Bert). Existing methods try to add task specified optimization on small models like adding global-local centrality score to models. In this paper, we propose an instruction fine-tuning model: Baichuan2-Sum, for role-oriented …

art bart bert bloom cs.ai cs.cl cs.lg dialogue fine-tuning generate language language models large language large language models llama llms natural natural language roles show small state summarization tasks