2000 character limit reached
Application of Transformers for Nonlinear Channel Compensation in Optical Systems
Published 25 Apr 2023 in cs.IT, cs.LG, eess.SP, and math.IT | (2304.13119v3)
Abstract: In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used effectively for nonlinear compensation (NLC) in coherent long-haul transmission systems. For this application, we present an implementation of the encoder part of the Transformer and analyze its performance over a wide range of different hyper-parameters. It is shown that by proper embeddings and processing blocks of symbols at each iteration and also carefully selecting subsets of the encoder's output to be processed together, an efficient nonlinear equalization can be achieved for different complexity constraints. To reduce the computational complexity of the attention mechanism, we further propose the use of a physic-informed mask inspired by nonlinear perturbation theory. We also compare the Transformer-NLC with digital back-propagation (DBP) under different transmission scenarios in order to demonstrate the flexibility and generalizability of the proposed data-driven solution.
- E. Ip and J. M. Kahn, “Compensation of dispersion and nonlinear impairments using digital backpropagation,” Journal of Lightwave Technology, vol. 26, no. 20, pp. 3416–3425, 2008.
- L. B. Du and A. J. Lowery, “Improved single channel backpropagation for intra-channel fiber nonlinearity compensation in long-haul optical communication systems,” Optics Express, vol. 18, no. 16, pp. 17 075–17 088, 2010.
- E. F. Mateo, F. Yaman, and G. Li, “Efficient compensation of inter-channel nonlinear effects via digital backward propagation in WDM optical transmission,” Optics Express, vol. 18, no. 14, pp. 15 144–15 154, 2010.
- A. Mecozzi and R.-J. Essiambre, “Nonlinear Shannon limit in pseudolinear coherent systems,” Journal of Lightwave Technology, vol. 30, no. 12, pp. 2011–2024, 2012.
- Z. Tao, L. Dou, W. Yan, L. Li, T. Hoshida, and J. C. Rasmussen, “Multiplier-free intrachannel nonlinearity compensating algorithm operating at symbol rate,” Journal of Lightwave Technology, vol. 29, no. 17, pp. 2570–2576, 2011.
- S. Zhang, F. Yaman, K. Nakamura, T. Inoue, V. Kamalov, L. Jovanovski, V. Vusirikala, E. Mateo, Y. Inada, and T. Wang, “Field and lab experimental demonstration of nonlinear impairment compensation using neural networks,” Nature Communications, vol. 10, no. 1, pp. 1–8, 2019.
- C. Häger and H. D. Pfister, “Nonlinear interference mitigation via deep neural networks,” in Optical fiber communication conference. Optical Society of America, 2018, pp. W3A–4.
- O. Sidelnikov, A. Redyuk, S. Sygletos, M. Fedoruk, and S. Turitsyn, “Advanced convolutional neural networks for nonlinearity mitigation in long-haul WDM transmission systems,” Journal of Lightwave Technology, vol. 39, no. 8, pp. 2397–2406, 2021.
- S. Deligiannidis, A. Bogris, C. Mesaritakis, and Y. Kopsinis, “Compensation of fiber nonlinearities in digital coherent systems leveraging long short-term memory neural networks,” Journal of Lightwave Technology, vol. 38, no. 21, pp. 5991–5999, 2020.
- P. J. Freire, Y. Osadchuk, B. Spinnler, A. Napoli, W. Schairer, N. Costa, J. E. Prilepsky, and S. K. Turitsyn, “Performance versus complexity study of neural network equalizers in coherent optical systems,” Journal of Lightwave Technology, vol. 39, no. 19, pp. 6085–6096, 2021.
- A. Bakhshali, H. Najafi, B. B. Hamgini, and Z. Zhang, “Neural network architectures for optical channel nonlinear compensation in digital subcarrier multiplexing systems,” Opt. Express, vol. 31, no. 16, pp. 26 418–26 434, Jul 2023.
- H. Ming, X. Chen, X. Fang, L. Zhang, C. Li, and F. Zhang, “Ultralow complexity long short-term memory network for fiber nonlinearity mitigation in coherent optical communication systems,” Journal of Lightwave Technology, vol. 40, no. 8, pp. 2427–2434, 2022.
- P. J. Freire, A. Napoli, D. A. Ron, B. Spinnler, M. Anderson, W. Schairer, T. Bex, N. Costa, S. K. Turitsyn, and J. E. Prilepsky, “Reducing computational complexity of neural networks in optical channel equalization: From concepts to implementation,” Journal of Lightwave Technology, 2023.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in Neural Information Processing Systems, vol. 30, 2017.
- P. K. A. Wai and C. Menyak, “Polarization mode dispersion, decorrelation, and diffusion in optical fibers with randomly varying birefringence,” Journal of Lightwave Technology, vol. 14, no. 2, pp. 148–157, 1996.
- Y. Gao, J. C. Cartledge, A. S. Karar, S. S.-H. Yam, M. O’Sullivan, C. Laperle, A. Borowiec, and K. Roberts, “Reducing the complexity of perturbation based nonlinearity pre-compensation using symmetric EDC and pulse shaping,” Optics Express, vol. 22, no. 2, pp. 1209–1219, 2014.
- I. Hubara, M. Courbariaux, D. Soudry, R. El-Yaniv, and Y. Bengio, “Quantized neural networks: Training neural networks with low precision weights and activations,” The Journal of Machine Learning Research, vol. 18, no. 1, pp. 6869–6898, 2017.
- P. J. Freire, D. Abode, J. E. Prilepsky, N. Costa, B. Spinnler, A. Napoli, and S. K. Turitsyn, “Transfer learning for neural networks-based equalizers in coherent optical systems,” Journal of Lightwave Technology, vol. 39, no. 21, pp. 6733–6745, 2021.
- D. Bahdanau, K. Cho, and Y. Bengio, “Neural machine translation by jointly learning to align and translate,” arXiv preprint arXiv:1409.0473, 2014.
- A. Katharopoulos, A. Vyas, N. Pappas, and F. Fleuret, “Transformers are RNNs: Fast autoregressive Tansformers with linear attention,” in International Conference on Machine Learning. PMLR, 2020, pp. 5156–5165.
- S. Zhai, W. Talbott, N. Srivastava, C. Huang, H. Goh, R. Zhang, and J. Susskind, “An attention free transformer,” arXiv preprint arXiv:2105.14103, 2021.
- R. Xiong, Y. Yang, D. He, K. Zheng, S. Zheng, C. Xing, H. Zhang, Y. Lan, L. Wang, and T. Liu, “On layer normalization in the Transformer architecture,” in International Conference on Machine Learning. PMLR, 2020, pp. 10 524–10 533.
- R. Child, S. Gray, A. Radford, and I. Sutskever, “Generating long sequences with sparse transformers,” arXiv preprint arXiv:1904.10509, 2019.
- I. Beltagy, M. E. Peters, and A. Cohan, “Longformer: The long-document transformer,” arXiv preprint arXiv:2004.05150, 2020.
- G. P. Agrawal, “Nonlinear fiber optics,” 2nd ed., New York: Academic, 1995.
- H. N. Tan and S. T. Le, “On the effectiveness of nonlinearity compensation for high-baudrate single-channel transmissions,” Optics Communications, vol. 433, pp. 36–43, 2019.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.