Jellyfish: A Large Language Model for Data Preprocessing

arXiv:2312.01678v4 Announce Type: replace-cross
Abstract: This paper explores the utilization of LLMs for data preprocessing (DP), a crucial step in the data mining pipeline that transforms raw data into a clean format conducive to easy processing. Whereas the use of LLMs has sparked interest in devising universal solutions to DP, recent initiatives in this domain typically rely on GPT APIs, raising inevitable data breach concerns. Unlike these approaches, we consider instruction-tuning local LLMs (7 - 13B models) as universal DP …

arxiv cs.ai cs.cl cs.db cs.lg data data preprocessing language language model large language large language model type