InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization

arXiv:2404.04650v1 Announce Type: new
Abstract: Recent strides in the development of diffusion models, exemplified by advancements such as Stable Diffusion, have underscored their remarkable prowess in generating visually compelling images. However, the imperative of achieving a seamless alignment between the generated image and the provided prompt persists as a formidable challenge. This paper traces the root of these difficulties to invalid initial noise, and proposes a solution in the form of Initial Noise Optimization (InitNO), a paradigm that refines this …

arxiv boosting cs.cv diffusion diffusion models image image diffusion noise optimization text text-to-image type via