From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions

arXiv:2402.17633v1 Announce Type: new
Abstract: Text segmentation is a fundamental task in natural language processing, where documents are split into contiguous sections. However, prior research in this area has been constrained by limited datasets, which are either small in scale, synthesized, or only contain well-structured documents. In this paper, we address these limitations by introducing a novel benchmark YTSeg focusing on spoken content that is inherently more unstructured and both topically and structurally diverse. As part of this work, we …

abstract arxiv benchmark cs.cl datasets documents language language processing natural natural language natural language processing novel prior processing research scale segmentation small smart synthesized text type video