LoCoNet: Long-Short Context Network for Active Speaker Detection

arXiv:2301.08237v2 Announce Type: replace
Abstract: Active Speaker Detection (ASD) aims to identify who is speaking in each frame of a video. ASD reasons from audio and visual information from two contexts: long-term intra-speaker context and short-term inter-speaker context. Long-term intra-speaker context models the temporal dependencies of the same speaker, while short-term inter-speaker context models the interactions of speakers in the same scene. These two contexts are complementary to each other and can help infer the active speaker. Motivated by these …

arxiv context cs.cv detection network speaker type