On the Content Bias in Fr\'echet Video Distance

arXiv:2404.12391v1 Announce Type: cross
Abstract: Fr\'echet Video Distance (FVD), a prominent metric for evaluating video generation models, is known to conflict with human perception occasionally. In this paper, we aim to explore the extent of FVD's bias toward per-frame quality over temporal realism and identify its sources. We first quantify the FVD's sensitivity to the temporal axis by decoupling the frame and motion quality and find that the FVD increases only slightly with large temporal corruption. We then analyze the …

abstract aim arxiv bias conflict cs.cv cs.gr cs.lg explore human identify paper per perception quality temporal type video video generation