DiffuLT: How to Make Diffusion Model Useful for Long-tail Recognition

arXiv:2403.05170v1 Announce Type: new
Abstract: This paper proposes a new pipeline for long-tail (LT) recognition. Instead of re-weighting or re-sampling, we utilize the long-tailed dataset itself to generate a balanced proxy that can be optimized through cross-entropy (CE). Specifically, a randomly initialized diffusion model, trained exclusively on the long-tailed dataset, is employed to synthesize new samples for underrepresented classes. Then, we utilize the inherent information in the original dataset to filter out harmful samples and keep the useful ones. Our …

abstract arxiv cross-entropy cs.cv dataset diffusion diffusion model entropy generate paper pipeline recognition sampling through type