Whispy: Adapting STT Whisper Models to Real-Time Environments

arXiv:2405.03484v1 Announce Type: cross
Abstract: Large general-purpose transformer models have recently become the mainstay in the realm of speech analysis. In particular, Whisper achieves state-of-the-art results in relevant tasks such as speech recognition, translation, language identification, and voice activity detection. However, Whisper models are not designed to be used in real-time conditions, and this limitation makes them unsuitable for a vast plethora of practical applications. In this paper, we introduce Whispy, a system intended to bring live capabilities to the …

abstract analysis art arxiv become cs.lg cs.sd detection eess.as environments general however identification language realm real-time recognition results speech speech analysis speech recognition state tasks transformer transformer models translation type voice whisper