TableLlama: Towards Open Large Generalist Models for Tables

arXiv:2311.09206v2 Announce Type: replace
Abstract: Semi-structured tables are ubiquitous. There has been a variety of tasks that aim to automatically interpret, augment, and query tables. Current methods often require pretraining on tables or special model architecture design, are restricted to specific table types, or have simplifying assumptions about tables and tasks. This paper makes the first step towards developing open-source large language models (LLMs) as generalists for a diversity of table-based tasks. Towards that end, we construct TableInstruct, a new …

abstract aim architecture arxiv assumptions cs.cl current design pretraining query simplifying table tables tasks type types