Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization. (arXiv:2208.13085v3 [eess.AS] UPDATED)

This paper describes a speaker diarization model based on target speaker
voice activity detection (TS-VAD) using transformers. To overcome the original
TS-VAD model's drawback of being unable to handle an arbitrary number of
speakers, we investigate model architectures that use input tensors with
variable-length time and speaker dimensions. Transformer layers are applied to
the speaker axis to make the model output insensitive to the order of the
speaker profiles provided to the TS-VAD model. Time-wise sequential layers are
interspersed between …

arxiv detection integration transformers voice