all AI news
SpeechAlign: a Framework for Speech Translation Alignment Evaluation
April 26, 2024, 4:47 a.m. | Belen Alastruey, Aleix Sant, Gerard I. G\'allego, David Dale, Marta R. Costa-juss\`a
cs.CL updates on arXiv.org arxiv.org
Abstract: Speech-to-Speech and Speech-to-Text translation are currently dynamic areas of research. In our commitment to advance these fields, we present SpeechAlign, a framework designed to evaluate the underexplored field of source-target alignment in speech models. The SpeechAlign framework has two core components. First, to tackle the absence of suitable evaluation datasets, we introduce the Speech Gold Alignment dataset, built upon a English-German text translation gold alignment dataset. Secondly, we introduce two novel metrics, Speech Alignment Error …
abstract advance alignment arxiv commitment components core cs.cl dynamic evaluation fields framework research speech speech-to-text text translation type
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US