Improved Syndrome-based Neural Decoder for Linear Block Codes
Abstract: In this work, we investigate the problem of neural-based error correction decoding, and more specifically, the new so-called syndrome-based decoding technique introduced to tackle scalability in the training phase for larger code sizes. We improve on previous works in terms of allowing full decoding of the message rather than codewords, allowing thus the application to non-systematic codes, and proving that the single-message training property is still viable. The suggested system is implemented and tested on polar codes of sizes (64,32) and (128,64), and a BCH of size (63,51), leading to a significant improvement in both Bit Error Rate (BER) and Frame Error Rate (FER), with gains between 0.3dB and 1dB for the implemented codes in the high Signal-to-Noise Ratio (SNR) regime.
- G. Zeng, D. Hush, and N. Ahmed, “An Application of Neural Net in Decoding Error-Correcting Codes,” in IEEE International Symposium on Circuits and Systems. IEEE, 1989.
- J. Bruck and M. Blaum, “Neural Networks, Error-Correcting Codes, and Polynomials over the Binary n𝑛nitalic_n-Cube,” IEEE Transactions on Information Theory, vol. 35, no. 5, pp. 976–987, 1989.
- J. Yuan, V. Bhargava, and Q. Wang, “An Error Correcting Neural Network,” in Conference Proceeding IEEE Pacific Rim Conference on Communications, Computers and Signal Processing. IEEE, 1989.
- T. Gruber, S. Cammerer, J. Hoydis, and S. ten Brink, “On Deep Learning-Based Channel Decoding,” in 2017 51st Annual Conference on Information Sciences and Systems (CISS). IEEE, mar 2017.
- T. O’Shea and J. Hoydis, “An Introduction to Deep Learning for the Physical Layer,” IEEE Transactions on Cognitive Communications and Networking, vol. 3, no. 4, pp. 563–575, dec 2017.
- J. Seo, J. Lee, and K. Kim, “Decoding of Polar Code by Using Deep Feed-Forward Neural Networks,” in 2018 International Conference on Computing, Networking and Communications (ICNC). IEEE, mar 2018.
- A. Bennatan, Y. Choukroun, and P. Kisilev, “Deep Learning for Decoding of Linear Codes - A Syndrome-Based Approach,” 2018.
- Y. Choukroun and L. Wolf, “Error Correction Code Transformer,” 2022.
- E. Nachmani, Y. Be'ery, and D. Burshtein, “Learning to Decode Linear Codes Using Deep Learning,” in 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton). IEEE, sep 2016.
- E. Nachmani, E. Marciano, L. Lugosch, W. J. Gross, D. Burshtein, and Y. Be'ery, “Deep Learning Methods for Improved Decoding of Linear Codes,” IEEE Journal of Selected Topics in Signal Processing, vol. 12, no. 1, pp. 119–131, feb 2018.
- E. Nachmani and L. Wolf, “Autoregressive Belief Propagation for Decoding Block Codes,” 2021.
- W. Xu, Z. Wu, Y.-L. Ueng, X. You, and C. Zhang, “Improved Polar Decoder Based on Deep Learning,” in 2017 IEEE International Workshop on Signal Processing Systems (SiPS). IEEE, oct 2017.
- L. Lugosch and W. J. Gross, “Learning from the Syndrome,” in 2018 52nd Asilomar Conference on Signals, Systems, and Computers. IEEE, oct 2018.
- E. Arikan, “Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels,” IEEE Transactions on Information Theory, vol. 55, no. 7, pp. 3051–3073, jul 2009.
- ——, “Systematic Polar Coding,” IEEE Communications Letters, vol. 15, no. 8, pp. 860–862, aug 2011.
- T. Richardson and R. Urbanke, “The Capacity of Low-Density Parity-Check Codes Under Message-Passing Decoding,” IEEE Transactions on Information Theory, vol. 47, no. 2, pp. 599–618, 2001.
- K. Cho, B. van Merrienboer, D. Bahdanau, and Y. Bengio, “On the Properties of Neural Machine Translation: Encoder-Decoder Approaches,” 2014.
- M. A. et al., “TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems,” 2015, software available from tensorflow.org. [Online]. Available: https://www.tensorflow.org/
- F. Chollet et al., “Keras,” 2015. [Online]. Available: https://keras.io
- D. P. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” 2014.
- M. Fossorier and S. Lin, “Soft-decision decoding of linear block codes based on ordered statistics,” IEEE Transactions on Information Theory, vol. 41, no. 5, pp. 1379–1396, 1995.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.