Continuous Language Model Interpolation for Dynamic and Controllable Text Generation

arXiv:2404.07117v1 Announce Type: cross
Abstract: As large language models (LLMs) have gained popularity for a variety of use cases, making them adaptable and controllable has become increasingly important, especially for user-facing applications. While the existing literature on LLM adaptation primarily focuses on finding a model (or models) that optimizes a single predefined objective, here we focus on the challenging case where the model must dynamically adapt to diverse -- and often changing -- user preferences. For this, we leverage adaptation …

abstract applications arxiv become cases continuous cs.cl cs.lg dynamic interpolation language language model language models large language large language models literature llm llms making text text generation them type use cases