[R] Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey

**Paper**: [https://arxiv.org/abs/2403.14608](https://arxiv.org/abs/2403.14608)

**Abstract**:

>Large models represent a groundbreaking advancement in multiple application fields, enabling remarkable achievements across various tasks. However, their unprecedented scale comes with significant computational costs. These models, often consisting of billions of parameters, require vast amounts of computational resources for execution. Especially, the expansive scale and computational demands pose considerable challenges when customizing them for particular downstream tasks, particularly over the hardware platforms constrained by computational capabilities.
**Parameter Efficient Fine-Tuning** (**PEFT**) provides a practical solution by efficiently …

abstract advancement application challenges computational costs enabling fields groundbreaking however large models machinelearning multiple parameters resources scale tasks them vast