Papers
Topics
Authors
Recent
Search
2000 character limit reached

MacKay–Neal Codes: Sparse-Graph Innovations

Updated 5 July 2026
  • MacKay–Neal codes are sparse-graph constructions that employ a distinctive split between punctured (hidden) and transmitted variables to enable near-capacity MAP decoding.
  • They feature a two-edge-type structure that supports complex decoding algorithms such as belief propagation and spatial coupling, thereby enhancing performance thresholds.
  • Their rate-adaptive formulations integrate a nonlinear outer distribution matcher with an inner LDPC encoder, offering flexibility across diverse communication scenarios.

Searching arXiv for MacKay–Neal code papers to ground the article in the cited literature. MacKay–Neal (MN) codes are sparse-graph coding constructions characterized by a punctured/transmitted variable-node split and a corresponding two-edge-type decoding structure. In the classical formulation, they are non-systematic or punctured multi-edge-type LDPC-like ensembles defined entirely by sparse parity constraints; in more recent rate-adaptive formulations, they appear as nonlinear concatenations of an outer constant-composition distribution matcher and an inner LDPC encoder, with the punctured variables carrying a priori information rather than direct channel observations (Kasai et al., 2011). Across these formulations, the defining feature is the coexistence of hidden or punctured variables and transmitted variables within a single sparse-graph representation, which gives MN codes a distinctive operating point: strong asymptotic performance under MAP decoding with bounded degrees, poor uncoupled BP behavior in some settings, and substantial gains under spatial coupling, where BP thresholds approach capacity or symmetric-information-rate limits on several channel families (Fukushima et al., 2015).

1. Definition and structural forms

MacKay–Neal codes were originally associated with sparse constructions based on very sparse matrices, and in the binary channel-coding setting they can be written through a parity-check matrix of the form

(H1    H2),(H_1 \;\; H_2),

where H1H_1 connects punctured or state variables and H2H_2 connects transmitted parity variables (Kasai et al., 2011). In the (,r,g)(\ell,r,g)-MN description, H1H_1 is an N×(/r)NN \times (\ell/r)N random binary matrix with column weight \ell and row weight rr, while H2H_2 is an N×NN \times N random binary matrix with column and row weight H1H_10. The parity constraints are

H1H_11

with H1H_12 punctured and H1H_13 transmitted (Kasai et al., 2011).

In the multi-edge-type formulation used for erasure analysis, MN codes comprise two variable-node classes and one check-node class. Type-1 variables are punctured; type-2 variables are transmitted; check nodes connect to both edge types (Okazaki et al., 2014). The corresponding degree-distribution pair for uncoupled H1H_14 MN codes on the BEC is

H1H_15

which makes explicit that only the type-2 class is observed through the channel (Okazaki et al., 2014).

A distinct recent formulation uses a nonlinear outer encoder. In that construction, an MN code is the concatenation of an outer nonlinear constant-composition distribution matcher and an inner nonsystematic LDPC encoder, often protograph-based and, in the strongest reported results, spatially coupled (Zahr et al., 16 Oct 2025). The outer matcher maps messages to binary sequences of fixed Hamming weight H1H_16, while the inner LDPC acts on those sequences and produces transmitted parity bits. The punctured-node class is then initialized by a priori log-likelihood ratios derived from the matcher rather than by channel observations (Zahr et al., 16 Oct 2025). This differs from standard LDPC, repeat-accumulate, and turbo-like constructions in that rate adaptation is driven by the outer nonlinear component while the inner sparse graph remains fixed (Zahr et al., 16 Oct 2025).

A unifying interpretation is that MN codes are sparse-graph systems in which some variables are never transmitted directly but remain inferable through check constraints and, in nonlinear variants, through external priors. This suggests that the punctured/transmitted split is the central invariant across the literature, even though the exact algebraic realization varies.

2. Graph-theoretic viewpoint and relation to other code families

MN codes are routinely described as two-edge-type LDPC codes, or more generally as multi-edge-type sparse-graph ensembles with punctured and transmitted variable-node classes (Okazaki et al., 2014). In this sense they are closely related to generalized LDPC and turbo-like graph families, but they are distinguished by deliberate puncturing of one variable class and by the role this hidden class plays in the sparse representation (Zahr et al., 16 Oct 2025).

A standard contrast is with ordinary LDPC ensembles, where all variable nodes are transmitted. In MN codes, punctured variables carry no direct channel observation and are reconstructed through parity constraints and, in rate-adaptive variants, through a priori information supplied by an outer distribution matcher (Zahr et al., 2023). This puncturing mechanism is not a secondary implementation detail; it is what enables the bounded-degree capacity-achieving behavior under MAP decoding emphasized in the early MN/HA literature (Kasai et al., 2011).

The literature also places MN codes in a dual relationship with Hsu–Anastasopoulos (HA) codes. In the bounded-density setting, HA codes are dual in spirit to MN codes, and with matched parameter choices the MN generator matrix equals the HA parity-check matrix (Kasai et al., 2011). This duality later reappears in quantum CSS constructions based on punctured MN/HA constituents, where the same hidden-variable architecture is used to obtain nested sparse systems with finite degrees (Kasai, 30 Jun 2026). In the classical nested-CSS construction built from MN and HA ingredients, the visible MN-side code H1H_17 is defined through the extended sparse constraint

H1H_18

and the visible HA-side code H1H_19 through

H2H_20

with CSS orthogonality induced by the inclusion H2H_21 (Kasai, 25 Mar 2026).

Another persistent comparison is with LDGM-like structures. In several expositions, the transmitted-node side of an MN graph is described as LDGM-like, while the punctured side is LDPC-like (Okazaki et al., 2014). This suggests that MN codes occupy an intermediate position between sparse parity-check and sparse generator constructions. A plausible implication is that much of their asymptotic behavior is governed by how these two sparse substructures interact under puncturing and iterative inference.

3. Density evolution, belief propagation, and threshold behavior

On the BEC, the uncoupled MN recursion is explicit and exposes the main difficulty of the ensemble under BP decoding. For H2H_22-MN codes, with H2H_23 and H2H_24 the erasure probabilities on punctured and transmitted edges, density evolution obeys

H2H_25

H2H_26

with initialization H2H_27, H2H_28 (Kasai et al., 2011). In uncoupled form, this system has the fixed trajectory H2H_29, (,r,g)(\ell,r,g)0, so the punctured side never resolves, which is why uncoupled MN codes have no useful BP threshold on the BEC despite strong MAP behavior (Kasai et al., 2011).

In the multi-edge-type BEC formalism, the same phenomenon is written as

(,r,g)(\ell,r,g)1

with

(,r,g)(\ell,r,g)2

(,r,g)(\ell,r,g)3

or, for generalized erasure channels with detector transfer (,r,g)(\ell,r,g)4,

(,r,g)(\ell,r,g)5

with the corresponding check update (,r,g)(\ell,r,g)6 (Okazaki et al., 2014). This generalization is central in universality proofs over erasure channels with memory (Fukushima et al., 2015).

For binary-input AWGN analysis in modern rate-adaptive MN codes, density evolution is formulated in the LLR domain on an equivalent parallel-channel model. Variable-node and check-node updates take the standard forms

(,r,g)(\ell,r,g)7

(,r,g)(\ell,r,g)8

with separate tracking of edge classes for punctured and transmitted nodes (Zahr et al., 16 Oct 2025). The punctured class is initialized either by the prior

(,r,g)(\ell,r,g)9

or, in the equivalent model, by a binary symmetric a priori channel with crossover probability H1H_10 (Zahr et al., 16 Oct 2025).

The BP threshold is then defined as the minimum H1H_11 or H1H_12 such that density evolution drives all message means to H1H_13, equivalently to zero bit error probability (Zahr et al., 16 Oct 2025). In the rate-adaptive setting, one fixes the entropy H1H_14 of the punctured-node prior and finds the largest communication-channel entropy H1H_15 permitting successful decoding. For a rate-H1H_16 inner code, the Shannon bound is

H1H_17

which provides the benchmark against which thresholds are reported (Zahr et al., 16 Oct 2025).

4. Spatial coupling, threshold saturation, and universality

Spatial coupling is the mechanism that transforms the poor uncoupled BP behavior of MN codes into near-capacity performance. In coupled constructions, the protograph or graph is replicated across sections and edges are spread across neighboring positions, while termination or shortening outside the active range seeds highly reliable boundary regions (Kasai et al., 2011). Decoding then proceeds as a wave from the boundaries into the chain interior, producing threshold saturation in the now-standard sense associated with coupled LDPC systems (Zahr et al., 16 Oct 2025).

On the BEC, coupled MN codes with bounded degrees were shown empirically to approach capacity. For the base-matrix SC-MN family with H1H_18, the reported BP thresholds move toward H1H_19 as N×(/r)NN \times (\ell/r)N0 increases and the rate tends to N×(/r)NN \times (\ell/r)N1: for N×(/r)NN \times (\ell/r)N2, N×(/r)NN \times (\ell/r)N3 and N×(/r)NN \times (\ell/r)N4 (Kasai et al., 2011). This established the basic phenomenon before later rigorous proofs.

A stronger BEC result concerns ensembles with no degree-2 bit nodes. For N×(/r)NN \times (\ell/r)N5 SC-MN codes with N×(/r)NN \times (\ell/r)N6, the asymptotic BP threshold under spatial coupling satisfies

N×(/r)NN \times (\ell/r)N7

so these coupled MN codes achieve BEC capacity with N×(/r)NN \times (\ell/r)N8 (Okazaki et al., 2014). The removal of degree-2 variable nodes is important because earlier N×(/r)NN \times (\ell/r)N9 designs had many such nodes and correspondingly higher error floors (Okazaki et al., 2014).

For generalized erasure channels with memory, the universality claim is sharper. Spatially coupled MN codes with bounded degrees universally achieve the symmetric information rate of arbitrary generalized erasure channels with memory under BP decoding, in the sense that the transmitter need only know the SIR while the receiver uses a channel-matched APP detector and BP decoder (Fukushima et al., 2015). In that setting the proof is based on the potential-function method, and for \ell0 with \ell1, the potential threshold equals the SIR limit: \ell2 and the coupled BP threshold saturates to that value as \ell3 (Fukushima et al., 2015).

Recent rate-adaptive spatially coupled MN codes extend the same phenomenon to the biAWGN channel over the full rate interval \ell4. In the protograph SC-LDPC inner-code construction with two variable-node classes per position, the \ell5 SC-MN ensemble is reported to achieve BP thresholds within approximately \ell6 dB of binary-input AWGN capacity uniformly across the full \ell7 rate range, while the \ell8 ensemble stays within approximately \ell9 dB (Zahr et al., 16 Oct 2025). The paper interprets this as near-universal operation across rates because varying the outer distribution-matcher parameter changes only the entropy of the a priori channel seen by punctured nodes, while the inner coupled decoder remains fixed (Zahr et al., 16 Oct 2025).

5. Rate adaptation and equivalent parallel-channel analysis

A major modern development is the use of MN codes as rate-adaptive schemes with a fixed inner LDPC graph and an outer constant-composition distribution matcher. In that architecture, the outer matcher maps messages rr0 to binary rr1-tuples rr2 of Hamming weight rr3, with rate

rr4

so choosing rr5 spans rr6 (Zahr et al., 16 Oct 2025). The inner nonsystematic SC-LDPC encoder has rate

rr7

under zero-tail termination, and the overall code rate is

rr8

for large rr9 and H2H_20 (Zahr et al., 16 Oct 2025).

The essential analytical device is an equivalent parallel channel. Because the outer distribution matcher makes the concatenation nonlinear, direct density evolution is inconvenient. The remedy is to insert a random i.i.d. bit scrambler after the matcher, known at the receiver, which preserves error probability over symmetric channels and restores the all-zero codeword assumption (Zahr et al., 16 Oct 2025). The resulting model replaces the nonlinear system by an inner LDPC code transmitted over two parallel channels: an a priori channel for punctured nodes and the physical communication channel for transmitted nodes. In the specific biAWGN formulation, the a priori channel is a BSC with crossover probability H2H_21, and the physical channel is a binary-input AWGN channel (Zahr et al., 16 Oct 2025).

This viewpoint yields concrete initial LLRs. A-type punctured nodes are initialized with

H2H_22

while C-type transmitted nodes are initialized with

H2H_23

Under all-zero transmission on BPSK AWGN,

H2H_24

(Zahr et al., 16 Oct 2025).

A closely related block-protograph formulation replaces the constant-composition prior by a BSCH2H_25 for density-evolution purposes and combines threshold analysis with input–output weight-distribution analysis to screen out ensembles with poor error floors (Zahr et al., 16 Oct 2025). In that formulation, the inner code is defined by

H2H_26

with puncturing of the first H2H_27 variable nodes and generator

H2H_28

and the overall rate is

H2H_29

(Zahr et al., 16 Oct 2025). The same work reports that a single fixed inner protograph can operate within approximately N×NN \times N0 dB of the Shannon limit over broad rate ranges, while error-floor behavior depends strongly on the asymptotic input–output weight distribution near the origin (Zahr et al., 16 Oct 2025).

The later spatially coupled rate-adaptive construction improves the waterfall threshold dramatically relative to those block designs, with the N×NN \times N1 SC-MN ensemble moving from approximately N×NN \times N2 dB from capacity in the best block protograph designs to approximately N×NN \times N3 dB across the full rate interval (Zahr et al., 16 Oct 2025).

6. Applications, extensions, and limitations

MN codes have been studied in several channel models beyond the standard memoryless BEC. On erasure relay channels under decode-and-forward, spatially coupled protograph MN codes were reported to have achievable regions essentially at the DF capacity boundary. For the N×NN \times N4 SC-MN ensemble of rate approximately N×NN \times N5, the achievable region tracks the theoretical DF limit within less than N×NN \times N6, with the residual gap attributed to finite-N×NN \times N7 wiggles in density evolution (Uchikawa et al., 2011). This result emphasized that the punctured/transmitted split and coupled structure remain effective in joint decoding architectures that connect source and relay graphs through degree-2 equality checks (Uchikawa et al., 2011).

MN codes were also analyzed for channels with N×NN \times N8-ary inputs and affine-subspace outputs, motivated as a simplified model of joint iterative decoding with non-binary modulation. In that setting, binary SC-MN codes with N×NN \times N9 structure achieve thresholds very close to the Shannon limit, but the iterative decoding threshold degrades as H1H_100 increases because of EXIT-like wiggles; increasing the randomized coupling width H1H_101 mitigates those wiggles (Kasai et al., 2012). For the H1H_102 ensemble at rate H1H_103, thresholds with H1H_104 remain close to H1H_105 but worsen with H1H_106, while with H1H_107 and H1H_108 the thresholds are essentially at H1H_109 for all tested H1H_110 values (Kasai et al., 2012).

In quantum coding, spatially coupled MN/HA constructions have been used to build CSS codes over the quantum erasure channel. There, a five-message density evolution for hard-erasure CSS decoding decomposes into Z-side and X-side constituents, and the coupled-vector potential method shows that seeded BP decoding reaches the minimum of the constituent thresholds; in the equal-rate specialization, this coincides with the hashing bound determined by the design rate (Kasai, 30 Jun 2026). A related non-coupled nested MN/HA construction was later used to obtain finite-degree quantum LDPC codes with non-vanishing rate and, for explicit balanced triples, Gilbert–Varshamov distance by rigorous computer-assisted proof (Kasai, 25 Mar 2026). These developments use the same sparse punctured-variable architecture, indicating that the MN paradigm extends naturally beyond classical binary-input channel coding.

The principal limitations stated across the literature are consistent. Many results are asymptotic in coupling length, lifting factor, or section size; finite-length BER and FER behavior is often not reported in the strongest asymptotic threshold papers (Zahr et al., 16 Oct 2025). Extensions beyond symmetric channels or beyond the specific detector models used in generalized erasure analysis remain open (Fukushima et al., 2015). In rate-adaptive nonlinear MN constructions, the equivalent parallel-channel model relies on symmetry and scrambling; extensions to non-symmetric channels, mismatched demappers, or higher-order modulations beyond pure BPSK constraints are explicitly listed as open problems (Zahr et al., 16 Oct 2025).

A recurrent misconception is that MN codes are simply punctured LDPC codes. The literature supports a narrower statement: they are punctured sparse-graph ensembles with a specific two-class structure and, in several important formulations, with a nonlinear outer mechanism or a duality relation to HA constructions that ordinary punctured LDPC ensembles do not automatically inherit (Kasai et al., 2011). Another misconception is that their strong asymptotic MAP behavior directly implies strong uncoupled BP performance. On the BEC, the opposite is explicit: uncoupled MN codes have no useful BP threshold, and spatial coupling is the mechanism that exposes their latent capacity-approaching behavior to iterative decoding (Kasai et al., 2011).

Taken together, the literature presents MN codes as a family of punctured sparse-graph constructions whose defining structural asymmetry between hidden and transmitted variables enables bounded-degree near-capacity performance once coupled or otherwise regularized. The early BEC evidence, the later BEC and generalized-erasure proofs, and the recent rate-adaptive biAWGN constructions all point in the same direction: the practical significance of MN codes lies less in the uncoupled ensemble itself than in the coupled, protograph-based, or outer-matched realizations that convert an intrinsically strong sparse representation into an effective BP-decodable system (Okazaki et al., 2014).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to MacKay-Neal Codes.