Cyclical Focal Loss. (arXiv:2202.08978v2 [cs.CV] UPDATED)

Web: http://arxiv.org/abs/2202.08978

The cross-entropy softmax loss is the primary loss function used to train
deep neural networks. On the other hand, the focal loss function has been
demonstrated to provide improved performance when there is an imbalance in the
number of training samples in each class, such as in long-tailed datasets. In
this paper, we introduce a novel cyclical focal loss and demonstrate that it is
a more universal loss function than cross-entropy softmax loss or focal loss.
We describe the intuition …

arxiv cv loss