UAVM: A Unified Model for Audio-Visual Learning. (arXiv:2208.00061v1 [cs.CV])

Conventional audio-visual models have independent audio and video branches.
We design a unified model for audio and video processing called Unified
Audio-Visual Model (UAVM). In this paper, we describe UAVM, report its new
state-of-the-art audio-visual event classification accuracy of 65.8% on
VGGSound, and describe the intriguing properties of the model.

arxiv audio cv learning unified model