CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning

arXiv:2311.13246v2 Announce Type: replace
Abstract: Instruction tuning is crucial for enabling Language Learning Models (LLMs) in responding to human instructions. The quality of instruction pairs used for tuning greatly affects the performance of LLMs. However, the manual creation of high-quality instruction datasets is costly, leading to the adoption of automatic generation of instruction pairs by LLMs as a popular alternative. To ensure the high quality of LLM-generated instruction datasets, several approaches have been proposed. Nevertheless, existing methods either compromise dataset …

arxiv cs.cl data data quality llm quality type