One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications

arXiv:2312.16145v2 Announce Type: replace-cross
Abstract: The prevalent use of commercial and open-source diffusion models (DMs) for text-to-image generation prompts risk mitigation to prevent undesired behaviors. Existing concept erasing methods in academia are all based on full parameter or specification-based fine-tuning, from which we observe the following issues: 1) Generation alternation towards erosion: Parameter drift during target elimination causes alternations and potential deformations across all generations, even eroding other concepts at varying degrees, which is more evident with multi-concept erased; 2) …

adapter applications arxiv concepts cs.ai cs.cv cs.lg diffusion diffusion models them type