Efficient Ensemble for Multimodal Punctuation Restoration using Time-Delay Neural Network

arXiv:2302.13376v2 Announce Type: replace-cross
Abstract: Punctuation restoration plays an essential role in the post-processing procedure of automatic speech recognition, but model efficiency is a key requirement for this task. To that end, we present EfficientPunct, an ensemble method with a multimodal time-delay neural network that outperforms the current best model by 1.0 F1 points, using less than a tenth of its inference network parameters. We streamline a speech recognizer to efficiently output hidden layer acoustic embeddings for punctuation restoration, as …

arxiv cs.cl cs.hc cs.lg cs.sd delay eess.as ensemble multimodal network neural network type