Control Color: Multimodal Diffusion-based Interactive Image Colorization

arXiv:2402.10855v1 Announce Type: new
Abstract: Despite the existence of numerous colorization methods, several limitations still exist, such as lack of user interaction, inflexibility in local colorization, unnatural color rendering, insufficient color variation, and color overflow. To solve these issues, we introduce Control Color (CtrlColor), a multi-modal colorization method that leverages the pre-trained Stable Diffusion (SD) model, offering promising capabilities in highly controllable interactive image colorization. While several diffusion-based methods have been proposed, supporting colorization in multiple modalities remains non-trivial. In …

abstract arxiv color colorization control cs.cv diffusion image interactive limitations modal multi-modal multimodal overflow rendering solve type variation