InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists

arXiv:2310.00390v2 Announce Type: replace
Abstract: Recent advances in generative diffusion models have enabled text-controlled synthesis of realistic and diverse images with impressive quality. Despite these remarkable advances, the application of text-to-image generative models in computer vision for standard visual recognition tasks remains limited. The current de facto approach for these tasks is to design model architectures and loss functions that are tailored to the task at hand. In this paper, we develop a unified language interface for computer vision tasks …

abstract advances application arxiv computer computer vision cs.cv current diffusion diffusion models diverse generative generative models image image diffusion images instruction-tuned quality recognition standard synthesis tasks text text-to-image type vision visual