Adaptative Bilingual Aligning Using Multilingual Sentence Embedding

arXiv:2403.11921v1 Announce Type: new
Abstract: In this paper, we present an adaptive bitextual alignment system called AIlign. This aligner relies on sentence embeddings to extract reliable anchor points that can guide the alignment path, even for texts whose parallelism is fragmentary and not strictly monotonic. In an experiment on several datasets, we show that AIlign achieves results equivalent to the state of the art, with quasi-linear complexity. In addition, AIlign is able to handle texts whose parallelism and monotonicity properties …

abstract alignment anchor arxiv bilingual cs.cl datasets embedding embeddings experiment extract guide multilingual paper path show type