A-SDM: Accelerating Stable Diffusion through Redundancy Removal and Performance Optimization

arXiv:2312.15516v3 Announce Type: replace
Abstract: The Stable Diffusion Model (SDM) is a popular and efficient text-to-image (t2i) generation and image-to-image (i2i) generation model. Although there have been some attempts to reduce sampling steps, model distillation, and network quantization, these previous methods generally retain the original network architecture. Billion scale parameters and high computing requirements make the research of model architecture adjustment scarce. In this work, we first explore the computational redundancy part of the network, and then prune the redundancy …

abstract architecture arxiv billion cs.cv diffusion diffusion model distillation image image-to-image model distillation network network architecture optimization parameters performance popular quantization reduce redundancy sampling scale stable diffusion text text-to-image through type