LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models

arXiv:2306.12420v2 Announce Type: replace
Abstract: Foundation models have demonstrated a great ability to achieve general human-level intelligence far beyond traditional approaches. As the technique keeps attracting attention from the AI community, an increasing number of foundation models are becoming publicly accessible. However, a significant shortcoming of most of these models lies in their performance in specialized-domain and task-specific applications, necessitating domain- and task-aware fine-tuning to develop effective scientific language models. As the number of available foundation models and specialized tasks …

arxiv cs.ai cs.cl finetuning foundation inference toolkit type