Experimental Design for Active Transductive Inference in Large Language Models

arXiv:2404.08846v1 Announce Type: new
Abstract: Transduction, the ability to include query-specific examples in the prompt at inference time, is one of the emergent abilities of large language models (LLMs). In this work, we propose a framework for adaptive prompt design called active transductive inference (ATI). We design the LLM prompt by adaptively choosing few-shot examples for a given inference query. The examples are initially unlabeled and we query the user to label the most informative ones, which maximally reduces the …

abstract arxiv cs.cl cs.lg design examples experimental framework inference language language models large language large language models llm llm prompt llms prompt query the prompt type work