Double Mixture: Towards Continual Event Detection from Speech

arXiv:2404.13289v1 Announce Type: new
Abstract: Speech event detection is crucial for multimedia retrieval, involving the tagging of both semantic and acoustic events. Traditional ASR systems often overlook the interplay between these events, focusing solely on content, even though the interpretation of dialogue can vary with environmental context. This paper tackles two primary challenges in speech event detection: the continual integration of new events without forgetting previous ones, and the disentanglement of semantic from acoustic events. We introduce a new task, …

arxiv continual cs.cl cs.mm cs.sd detection eess.as event speech type