A Survey on Prompting Techniques in LLMs

arXiv:2312.03740v2 Announce Type: replace
Abstract: Autoregressive Large Language Models have transformed the landscape of Natural Language Processing. Pre-train and prompt paradigm has replaced the conventional approach of pre-training and fine-tuning for many downstream NLP tasks. This shift has been possible largely due to LLMs and innovative prompting techniques. LLMs have shown great promise for a variety of downstream tasks owing to their vast parameters and huge datasets that they are pre-trained on. However, in order to fully realize their potential, …

abstract arxiv autoregressive cs.ai cs.cl fine-tuning landscape language language models language processing large language large language models llms natural natural language natural language processing nlp paradigm pre-training processing prompt prompting shift survey tasks train training type