Application of Transformers for Nonlinear Channel Compensation in Optical Systems

arXiv:2304.13119v2 Announce Type: replace-cross
Abstract: In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used effectively for nonlinear equalization in coherent long-haul transmission. For this application, we present an implementation of the encoder part of the Transformer and analyze its performance over a wide range of different hyper-parameters. It is shown that by processing …

abstract application arxiv compensation computation cs.it cs.lg eess.sp equalization math.it memory optical paper show systems transformers type