[R] LLM Augmented LLMs: Expanding Capabilities through Composition

**arXiv**: [https://arxiv.org/abs/2401.02412](https://arxiv.org/abs/2401.02412)

**OpenReview**: [https://openreview.net/forum?id=jjA4O1vJRz](https://openreview.net/forum?id=jjA4O1vJRz)

**Abstract**:

>Foundational models with billions of parameters which have been trained on large corpora of data have demonstrated non-trivial skills in a variety of domains. However, due to their monolithic structure, it is challenging and expensive to augment them or impart new skills. On the other hand, due to their adaptation abilities, several new instances of these models are being trained towards new domains and tasks. In this work, we study the problem of efficient and …

abstract data domains foundational models instances machinelearning parameters skills them