LLM can Achieve Self-Regulation via Hyperparameter Aware Generation

arXiv:2402.11251v1 Announce Type: new
Abstract: In the realm of Large Language Models (LLMs), users commonly employ diverse decoding strategies and adjust hyperparameters to control the generated text. However, a critical question emerges: Are LLMs conscious of the existence of these decoding strategies and capable of regulating themselves? The current decoding generation process often relies on empirical and heuristic manual adjustments to hyperparameters based on types of tasks and demands. However, this process is typically cumbersome, and the decoding hyperparameters may …

abstract arxiv control cs.cl current decoding diverse generated hyperparameter language language models large language large language models llm llms process question regulation self-regulation strategies text type via