Stylus: Automatic Adapter Selection for Diffusion Models

arXiv:2404.18928v1 Announce Type: cross
Abstract: Beyond scaling base models with more data or parameters, fine-tuned adapters provide an alternative way to generate high fidelity, custom images at reduced costs. As such, adapters have been widely adopted by open-source communities, accumulating a database of over 100K adapters-most of which are highly customized with insufficient descriptions. This paper explores the problem of matching the prompt to a set of relevant adapters, built on recent work that highlight the performance gains of composing …

abstract adapter alternative arxiv beyond communities costs cs.ai cs.cl cs.cv cs.gr cs.lg data database diffusion diffusion models fidelity generate images parameters scaling type