Fine color guidance in diffusion models and its application to image compression at extremely low bitrates

arXiv:2404.06865v1 Announce Type: new
Abstract: This study addresses the challenge of, without training or fine-tuning, controlling the global color aspect of images generated with a diffusion model. We rewrite the guidance equations to ensure that the outputs are closer to a known color map, and this without hindering the quality of the generation. Our method leads to new guidance equations. We show in the color guidance context that, the scaling of the guidance should not decrease but remains high throughout …

abstract application arxiv challenge color compression cs.cv diffusion diffusion model diffusion models fine-tuning generated global guidance image images low map study training type