SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)

arXiv:2306.00739v4 Announce Type: replace
Abstract: Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially revolutionizing how humans interact with data. This paper introduces the SQL-PaLM framework, a comprehensive solution for understanding and enhancing Text-to-SQL using LLMs, using in the learning regimes of few-shot prompting and instruction fine-tuning. With few-shot prompting, we explore the effectiveness of consistency decoding with execution-based error filtering. With instruction fine-tuning, we delve deep …

abstract application arxiv cs.ai cs.cl cs.db data framework humans language language model language models large language large language model large language models llms model adaptation natural natural language palm paper process query query language solution sql structured query language text text-to-sql type understanding