Score-based Conditional Generation with Fewer Labeled Data by Self-calibrating Classifier Guidance

Score-based generative models (SGMs) are a popular family of deep generative models that achieve leading image generation quality. Early studies extend SGMs to tackle class-conditional generation by coupling an unconditional SGM with the guidance of a trained classifier. Nevertheless, such classifier-guided SGMs do not always achieve accurate conditional generation, especially when trained with fewer labeled data. We argue that the problem is rooted in the classifier's tendency to overfit without coordinating with the underlying unconditional distribution. To make the classifier …

class classifier cs.cv cs.lg data deep generative models family generative generative models guidance image image generation popular quality studies