Evaluating Subtitle Segmentation for End-to-end Generation Systems. (arXiv:2205.09360v1 [cs.CL])

Subtitles appear on screen as short pieces of text, segmented based on formal
constraints (length) and syntactic/semantic criteria. Subtitle segmentation can
be evaluated with sequence segmentation metrics against a human reference.
However, standard segmentation metrics cannot be applied when systems generate
outputs different than the reference, e.g. with end-to-end subtitling systems.
In this paper, we study ways to conduct reference-based evaluations of
segmentation accuracy irrespective of the textual content. We first conduct a
systematic analysis of existing metrics for evaluating …

arxiv generation segmentation systems