CoFInAl: Enhancing Action Quality Assessment with Coarse-to-Fine Instruction Alignment

arXiv:2404.13999v1 Announce Type: new
Abstract: Action Quality Assessment (AQA) is pivotal for quantifying actions across domains like sports and medical care. Existing methods often rely on pre-trained backbones from large-scale action recognition datasets to boost performance on smaller AQA datasets. However, this common strategy yields suboptimal results due to the inherent struggle of these backbones to capture the subtle cues essential for AQA. Moreover, fine-tuning on smaller datasets risks overfitting. To address these issues, we propose Coarse-to-Fine Instruction Alignment (CoFInAl). …

alignment arxiv assessment cs.cv quality type