How Many Matrices Should I Prepare To Polarize Channels Optimally Fast? (2405.16360v1)
Abstract: Polar codes that approach capacity at a near-optimal speed, namely with scaling exponents close to $2$, have been shown possible for $q$-ary erasure channels (Pfister and Urbanke), the BEC (Fazeli, Hassani, Mondelli, and Vardy), all BMS channels (Guruswami, Riazanov, and Ye), and all DMCs (Wang and Duursma). There is, nevertheless, a subtlety separating the last two papers from the first two, namely the usage of multiple dynamic kernels in the polarization process, which leads to increased complexity and fewer opportunities to hardware-accelerate. This paper clarifies this subtlety, providing a trade-off between the number of kernels in the construction and the scaling exponent. We show that the number of kernels can be bounded by $O(\ell{3/\mu-1})$ where $\mu$ is the targeted scaling exponent and $\ell$ is the kernel size. In particular, if one settles for scaling exponent approaching $3$, a single kernel suffices, and to approach the optimal scaling exponent of $2$, about $O(\sqrt{\ell})$ kernels suffice.
- E. Arikan, “Channel polarization: A method for constructing capacity-achieving codes for symmetric binary-input memoryless channels,” IEEE Transactions on Information Theory, vol. 55, no. 7, pp. 3051–3073, July 2009.
- E. Arikan and E. Telatar, “On the rate of channel polarization,” in 2009 IEEE International Symposium on Information Theory, June 2009, pp. 1493–1495.
- S. B. Korada, E. Şaşoğlu, and R. Urbanke, “Polar codes: Characterization of exponent, bounds, and constructions,” IEEE Transactions on Information Theory, vol. 56, no. 12, pp. 6253–6264, Dec 2010.
- R. Mori and T. Tanaka, “Source and channel polarization over finite fields and reed–solomon matrices,” IEEE Transactions on Information Theory, vol. 60, no. 5, pp. 2720–2736, May 2014.
- S. H. Hassani, R. Mori, T. Tanaka, and R. L. Urbanke, “Rate-dependent analysis of the asymptotic behavior of channel polarization,” IEEE Transactions on Information Theory, vol. 59, no. 4, pp. 2267–2276, April 2013.
- A. Fazeli and A. Vardy, “On the scaling exponent of binary polarization kernels,” in 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton), Sep. 2014, pp. 797–804.
- H. Yao, A. Fazeli, and A. Vardy, “Explicit polar codes with small scaling exponent,” in 2019 IEEE International Symposium on Information Theory (ISIT), 2019, pp. 1757–1761.
- H. D. Pfister and R. L. Urbanke, “Near-optimal finite-length scaling for polar codes over large alphabets,” IEEE Transactions on Information Theory, vol. 65, no. 9, pp. 5643–5655, Sep. 2019.
- A. Fazeli, H. Hassani, M. Mondelli, and A. Vardy, “Binary linear codes with optimal scaling: Polar codes with large kernels,” IEEE Transactions on Information Theory, vol. 67, no. 9, pp. 5693–5710, Sep. 2021.
- M. Mondelli, S. H. Hassani, and R. L. Urbanke, “Unified scaling of polar codes: Error exponent, scaling exponent, moderate deviations, and error floors,” IEEE Transactions on Information Theory, vol. 62, no. 12, pp. 6698–6712, Dec 2016.
- H.-P. Wang, T.-C. Lin, A. Vardy, and R. Gabrys, “Sub-4.7 scaling exponent of polar codes,” IEEE Transactions on Information Theory, pp. 1–1, 2023.
- V. Guruswami, A. Riazanov, and M. Ye, “Arıkan meets shannon: Polar codes with near-optimal convergence to channel capacity,” IEEE Transactions on Information Theory, pp. 1–1, 2022.
- H.-P. Wang and I. M. Duursma, “Polar codes’ simplicity, random codes’ durability,” IEEE Transactions on Information Theory, vol. 67, no. 3, pp. 1478–1508, 2021.
- M. Ye and A. Barg, “Polar codes using dynamic kernels,” in 2015 IEEE International Symposium on Information Theory (ISIT), June 2015, pp. 231–235.
- C. Chang and A. Sahai, “Universal quadratic lower bounds on source coding error exponents,” in 2007 41st Annual Conference on Information Sciences and Systems, March 2007, pp. 714–719.
- R. Pedarsani, S. H. Hassani, I. Tal, and E. Telatar, “On the construction of polar codes,” in 2011 IEEE International Symposium on Information Theory Proceedings, July 2011, pp. 11–15.
- I. Tal and A. Vardy, “How to construct polar codes,” IEEE Transactions on Information Theory, vol. 59, no. 10, pp. 6562–6582, Oct 2013.
- N. Goela and M. Raginsky, “Channel polarization through the lens of blackwell measures,” IEEE Transactions on Information Theory, vol. 66, no. 10, pp. 6222–6241, Oct 2020.