---
title: Minimum Protected-Depth Envelope
url: https://www.emergentmind.com/topics/minimum-protected-depth-envelope
type: topic
---

# Minimum Protected-Depth Envelope

Searching arXiv for the cited paper and related prior work.
The depth complexity of encoding good error-correcting codes can be studied in the arbitrary-gates, unbounded fan-in Boolean circuit model by measuring size in wires rather than gates. In that setting, the central quantity is \(S_d(n)\), the minimum number of wires in a depth-\(d\) circuit that encodes a code \(C:\{0,1\}^n \to \{0,1\}^{32n}\) with distance at least \(4n\). The paper "On the Minimum Depth of Circuits with Linear Number of Wires Encoding Good Codes" establishes that \(S_d(n)\) is governed by inverse-Ackermann-type functions \(\lambda_d(n)\), proves that linear-wire encoders become possible at depth \(\alpha(n)\), and shows that this depth is necessary up to an additive constant \(2\). It also isolates a subclass of MDS codes, called superconcentrator-induced codes, whose encoders are tightly characterized by superconcentrator graphs [2402.00378].

## 1. Circuit model and the coding problem

The circuit model is strictly stronger than standard \(AC^0/AC^1\). Inputs are \(n\) Boolean bits; gates have unbounded fan-in and fan-out; and a gate of fan-in \(s\) may compute any Boolean function \(\{0,1\}^s \to \{0,1\}\). Size is the number of wires, namely directed edges between inputs, gates, and outputs. Depth is the length of the longest directed path from an input to an output [2402.00378].

Within this model, the paper studies encoders for good error-correcting codes. A code is called good when it has constant rate \(r \in (0,1)\) and constant relative distance \(\delta \in (0,\tfrac12)\). More generally, the paper considers codes
\[
C:\{0,1\}^n \to \{0,1\}^{\lfloor n/r \rfloor}
\]
with relative distance at least \(\delta\), under the condition \(r < 1-h(\delta)\), where \(h\) is the binary entropy function. The normalized form used to define \(S_d(n)\) fixes output length \(32n\) and distance at least \(4n\), corresponding to rate \(1/32\) and relative distance \(1/8\) [2402.00378].

Formally,
\[
S_d(n)=\min\{\text{number of wires of a depth-}d\text{ circuit encoding a code }C:\{0,1\}^n\to\{0,1\}^{32n}\text{ with distance }\ge 4n\}.
\]
In the formal upper-bound statement the construction is linear, meaning that all gates are XOR gates, so the code is linear over \(\mathbb{F}_2\). The broader lower bound, however, applies even when arbitrary Boolean-function gates of unrestricted fan-in are allowed [2402.00378].

The underlying question is a depth-size tradeoff: for a fixed depth \(d\), how many wires are required to encode a constant-rate, constant-distance code? The paper sharpens an earlier result of Gál, Hansen, Koucký, Pudlák, and Viola by removing the depth dependence from the hidden constant in the upper bound and by extending the lower-bound method to super-constant depths [2402.00378].

## 2. Inverse-Ackermann-type functions and the upper bound

The main asymptotic scale is given by a family of slowly growing functions \(\lambda_d(n)\). For a function \(f:\mathbb{N}\to\mathbb{N}\) with \(f(n)<n\) for all \(n>0\), let
\[
f^{(i)}=\underbrace{f\circ f\circ\cdots\circ f}_{i\text{ times}},\qquad
f^*(n)=\min\{i:f^{(i)}(n)\le 1\}.
\]
The paper defines
\[
\lambda_1(n)=\lfloor \sqrt{n}\rfloor,\qquad
\lambda_2(n)=\lceil \log n\rceil,\qquad
\lambda_d(n)=\lambda_{d-2}^*(n)\quad(d\ge 3)
\]
[2402.00378].

A few representative cases are listed below.

| Depth parameter | Function | Order stated in the paper |
|---|---|---|
| \(d=2\) | \(\lambda_2(n)\) | \(\Theta(\log n)\) |
| \(d=3\) | \(\lambda_3(n)\) | \(\Theta(\log\log n)\) |
| \(d=4\) | \(\lambda_4(n)\) | \(\Theta(\log^* n)\) |

These functions decrease with depth and become extremely small well before any conventional logarithmic scale. The paper defines an inverse-Ackermann depth threshold by
\[
\alpha(n)=\min\{\text{even }d:\lambda_d(n)\le 6\}.
\]
This quantity grows extremely slowly and is used as the critical depth at which linear wire complexity becomes attainable [2402.00378].

The main upper bound states that for any \(r\in(0,1)\) and \(\delta\in(0,\tfrac12)\) satisfying \(r<1-h(\delta)\), for sufficiently large \(n\) and any \(d\ge 3\), not necessarily constant, there exists a linear circuit
\[
C:\{0,1\}^n\to\{0,1\}^{\lfloor n/r\rfloor}
\]
of size \(O_{r,\delta}(\lambda_d(n)\cdot n)\) and depth \(d\) that encodes an error-correcting code with relative distance at least \(\delta\). In particular, when \(d=\alpha(n)\), the circuit has size \(O_{r,\delta}(n)\) [2402.00378].

Specialized to the normalization underlying \(S_d(n)\), this yields
\[
S_d(n)=O(\lambda_d(n)\cdot n),
\]
with an absolute constant hidden in the \(O(\cdot)\), independent of \(d\). This improves the earlier \(O_d(\lambda_d(n)\cdot n)\) bound, where the constant deteriorated rapidly with \(d\) because of the recursive analysis used there [2402.00378].

A more explicit constructive statement is given in terms of \((n,r,s)\)-partial good codes and a quantity \(S_d(n,r,s)\). The paper proves that there exist absolute constants \(c,D>0\) such that, for suitable parameter ranges,
\[
S_{2k}\Bigl(n,\frac{n}{A(k-1,r)},\frac{n}{r}\Bigr)\le 2cn
\]
with output fan-in at most \(D\), and
\[
S_{2k}\Bigl(n,\frac{n}{r},n\Bigr)\le 3c\,\lambda_{2k}(r)\cdot n.
\]
Taking \(r=n\) yields
\[
S_{2k}(n)\le 3c\,\lambda_{2k}(n)\cdot n,
\]
which is the stated \(O(\lambda_d(n)\cdot n)\) behavior for all \(d\ge 3\) [2402.00378].

The passage to linear size at depth \(\alpha(n)\) follows from inverse-Ackermann properties proved in the appendix. In particular, the paper records that if \(\lambda_d(n)\le d\), then \(\lambda_{d+2}(n)=O(1)\), and by definition \(\alpha(n)\) is the smallest even \(d\) for which \(\lambda_d(n)\le 6\). Consequently,
\[
S_{\alpha(n)}(n)=O(\lambda_{\alpha(n)}(n)\cdot n)=O(n),
\]
stated as Corollary 3.9 [2402.00378].

## 3. Lower bounds and near-optimal depth

The principal lower bound shows that the inverse-Ackermann threshold is not merely sufficient but essentially necessary. Let \(\rho\in(0,1)\), \(\delta\in(0,\tfrac12)\), and \(c>0\) be constants, and let
\[
C_n:\{0,1\}^n\to\{0,1\}^{\lfloor n/\rho\rfloor}
\]
be a family of circuits of size at most \(cn\) encoding error-correcting codes with relative distance at least \(\delta\). Then, for sufficiently large \(n\), the depth of \(C_n\) is at least
\[
\alpha(n)-2
\]
even when arbitrary Boolean-function gates of unrestricted fan-in are allowed [2402.00378].

Combined with the upper bound, this yields a necessary-and-sufficient depth threshold for linear-wire encoders of good Boolean codes:
\[
\text{minimum depth for }O(n)\text{ wires}=\alpha(n)\pm O(1).
\]
More precisely, depth \(\alpha(n)\) suffices, while depth below \(\alpha(n)-2\) is impossible for asymptotically linear-wire encoders [2402.00378].

The argument is graph-theoretic. A circuit is converted into a directed acyclic graph, and the resulting graph must satisfy a dense regularity condition. The paper defines a layered depth-\(d\) DAG with \(n\) inputs and \(n\) outputs to be \((\epsilon,\delta,\mu)\)-densely regular if, for every \(k\in[\mu n,n]\), there exist distributions on \(k\)-element subsets of inputs and outputs such that each individual vertex is selected with probability at most \(k/(\delta n)\), while the expected number of vertex-disjoint paths from the sampled input set to the sampled output set is at least \(\epsilon k\) [2402.00378].

Let \(D(n,d,\epsilon,\delta,\mu)\) denote the minimum number of edges of such a layered DAG. Pudlák’s original theorem gave
\[
D(n,d,\epsilon,\delta,1/r)=\Omega_{d,\epsilon,\delta}(n\lambda_d(r))
\]
for fixed \(d\). The paper refines Pudlák’s method and makes the dependence on \(d\) explicit:
\[
D\left(n,d,\epsilon,\delta,\frac1r\right)\ge \Omega\Bigl(2^{-d/2}\epsilon\delta^2\lambda_d(r)\,n\Bigr),
\]
with an absolute hidden constant [2402.00378].

A key input from earlier work is that circuits encoding good Boolean codes must have densely regular underlying graphs. In the form quoted in the paper: if \(C\) encodes a code
\[
\{0,1\}^{\rho n}\to\{0,1\}^n
\]
with relative distance at least \(\delta\), then after extending the graph with \((1-\rho)n\) dummy inputs, the underlying graph is \((\rho\delta,\rho,1/n)\)-densely regular [2402.00378].

To conclude the circuit lower bound, the graph is first layered, increasing size by a factor \(d\), and then the refined Pudlák bound is applied with \(r=\lfloor n/\rho\rfloor\). Comparison between the lower bound on edges and the assumed \(O(n)\) wire count yields
\[
\lambda_d\Bigl(\lfloor n/\rho\rfloor\Bigr)\le O_{\rho,\delta,c}(d\,2^{d/2}).
\]
The inverse-Ackermann properties then force \(d+2\ge \alpha(n)\), which is equivalent to the stated lower bound \(d\ge \alpha(n)-2\) [2402.00378].

For fixed depth \(d\), the upper and lower bounds match up to constant factors:
\[
S_d(n)=\Theta(\lambda_d(n)\cdot n).
\]
For super-constant depths, the paper presents this as a nearly complete characterization, while also noting that some intermediate regimes remain open [2402.00378].

## 4. The depth threshold as a minimum protected-depth envelope

The paper’s results admit a threshold interpretation. If the objective is to preserve linear wire complexity while encoding good codes, then the depth scale \(\alpha(n)\) functions as a minimum protected-depth envelope. Below that envelope, the connectivity requirements imposed by constant rate and constant relative distance force superlinear size; at the envelope, linear size becomes achievable [2402.00378].

For constant depth, the tradeoff is already explicit. Since
\[
\lambda_2(n)=\Theta(\log n),\qquad
\lambda_3(n)=\Theta(\log\log n),\qquad
\lambda_4(n)=\Theta(\log^* n),
\]
the corresponding wire bounds are of the form
\[
n\log n,\qquad n\log\log n,\qquad n\log^* n
\]
up to constant factors. Thus constant depth cannot support linear-wire encoding of good codes [2402.00378].

The same conclusion persists for slowly growing depths below the inverse-Ackermann scale. The paper explicitly notes that even depths such as \(\log^* n\), which are already very small relative to \(n\), remain below the point at which \(\lambda_d(n)\) becomes constant. Consequently, the wire complexity is still superlinear there [2402.00378].

At depth \(\alpha(n)\), however, \(\lambda_{\alpha(n)}(n)=O(1)\), so the upper bound becomes linear:
\[
S_{\alpha(n)}(n)=O(n).
\]
The lower bound shows that this is best possible up to an additive constant \(2\) in the depth parameter. This yields the sharp statement that the necessary and sufficient depth for linear wires is \(\alpha(n)\pm O(1)\) [2402.00378].

A plausible implication is that the obstruction is not tied to gate functionality but to graph structure. The lower bound allows arbitrary Boolean gates, yet still forces depth \(\alpha(n)-2\) for linear-wire encoding. This suggests that the controlling phenomenon is the depth required to realize sufficient disjoint-path connectivity with only \(O(n)\) edges [2402.00378].

## 5. Superconcentrator-induced codes

The second major theme is a special class of codes over finite fields. A code
\[
C:\mathbb{F}^n\to\mathbb{F}^m
\]
is called a superconcentrator-induced code if for every distinct \(x,y\in\mathbb{F}^n\),
\[
\mathrm{dist}(C(x),C(y))\ge m-\mathrm{dist}(x,y)+1.
\]
Since \(\mathrm{dist}(x,y)\le n\), this implies \(\mathrm{dist}(C(x),C(y))\ge m-n+1\), so such codes achieve the Singleton bound and are MDS. The paper describes them as a subclass of MDS codes with the stronger property that output distance increases as input distance decreases [2402.00378].

For linear codes, this condition has a precise matrix characterization. A linear code \(C:\mathbb{F}^n\to\mathbb{F}^m\) is a superconcentrator-induced code if and only if every square submatrix of its generator matrix is nonsingular. The paper identifies these matrices as totally invertible or totally nonsingular [2402.00378].

The graph-theoretic counterpart is the notion of an \((n,m)\)-superconcentrator: a DAG with \(n\) inputs and \(m\) outputs such that for every \(k\le \min\{n,m\}\), and every \(k\)-element input set \(X\) and \(k\)-element output set \(Y\), there exist \(k\) vertex-disjoint paths from \(X\) to \(Y\). The paper notes that classical results of Valiant and of Dolev, Dwork, Pippenger, and Wigderson show that superconcentrators exist with size \(\Theta(\lambda_d(n)\,n)\) at depth \(d\) [2402.00378].

The central observation is a two-way connection between these algebraic codes and superconcentrator graphs.

| Direction | Statement | Consequence |
|---|---|---|
| Code \(\to\) graph | Any unrestricted arithmetic circuit encoding a superconcentrator-induced code must be a superconcentrator graph | The code inequality forces disjoint-path connectivity |
| Graph \(\to\) code | Any superconcentrator graph can be converted to a linear arithmetic circuit over a sufficiently large field that encodes a superconcentrator-induced code | Superconcentrator structure is sufficient for the code property |

The first direction is proved by contradiction via Menger’s theorem. If the underlying graph were not a superconcentrator, there would be equal-size input and output sets \(S,T\) separated by a cut \(V\) of size smaller than \(|S|\). Fixing inputs outside \(S\) and varying inputs on \(S\), the outputs on \(T\) would be determined by fewer than \(|S|\) field elements, so two distinct inputs would collide on \(T\). That would force
\[
\mathrm{dist}(C(x),C(x'))\le m-|T|=m-|S|,
\]
while \(\mathrm{dist}(x,x')\le |S|\), contradicting
\[
\mathrm{dist}(C(x),C(x'))\ge m-\mathrm{dist}(x,x')+1
\]
[2402.00378].

The converse direction is probabilistic. Given an \((n,m)\)-superconcentrator \(G\), one replaces each internal vertex by an addition gate over \(\mathbb{F}\) and assigns a random coefficient \(r_e\in\mathbb{F}\) to each edge. If \(d\) is the depth of \(G\), then with probability at least
\[
1-\sum_{i=1}^n {n\choose i}{m\choose i}\frac{d i}{|\mathbb{F}|},
\]
the resulting circuit encodes a superconcentrator-induced code [2402.00378].

The proof studies the \(n\times m\) generator matrix \(M\), where
\[
M_{i,j}=\sum_{\text{paths }p:x_i\to y_j}\prod_{e\in p} r_e.
\]
For each equal-size pair \(X\subseteq[n]\), \(Y\subseteq[m]\), the determinant \(\det(M_{X,Y})\) is a polynomial in the variables \(r_e\). Because \(G\) is a superconcentrator, there exist \(|X|\) vertex-disjoint paths from \(X\) to \(Y\), which implies that this polynomial is nonzero. Its degree is at most \(d|X|\), so Schwartz–Zippel yields
\[
\Pr[\det(M_{X,Y})=0]\le \frac{d|X|}{|\mathbb{F}|},
\]
and a union bound gives the stated failure probability [2402.00378].

The paper therefore obtains a tight structural equivalence: encoding a superconcentrator-induced code forces superconcentrator topology, and superconcentrator topology can be turned into such a code over sufficiently large fields. This shows that the \(\lambda_d(n)\cdot n\) tradeoff is not merely an artifact of one proof technique but is intrinsic to the combinatorial structure of this class of codes [2402.00378].

## 6. Consequences, scope, and open questions

One consequence is a sharp answer to the question of how much depth is required to encode good Boolean codes with linear resources. For every depth \(d\), the paper frames the wire complexity as \(\Theta(\lambda_d(n)\cdot n)\) for fixed \(d\), and shows that linear wires are achievable exactly when depth reaches the inverse-Ackermann scale up to an additive constant [2402.00378].

The work also distinguishes circuit models. In the unbounded fan-in, arbitrary-gate Boolean model, the critical depth is \(\alpha(n)\). By contrast, for bounded fan-in models such as AND/OR circuits, the depth-time tradeoff is different; the paper notes that Sipser and Spielman show depth \(O(\log n)\) is optimal and sufficient for linear-size encoders [2402.00378].

For arithmetic circuits over finite fields, the superconcentrator-induced construction gives linear encoders over large fields. The paper states that exponential field size in the size of the graph suffices for the probabilistic conversion from superconcentrators to codes. It further notes that reducing the field size while maintaining the superconcentrator-code property connects to the classical MDS conjecture [2402.00378].

The construction itself is non-explicit. The paper emphasizes that, as in the earlier work of Gál, Hansen, Koucký, Pudlák, and Viola, the resulting families are probabilistic rather than explicit. An open problem is to construct explicit families of good codes whose encoding circuits match the optimal depth-size tradeoff, especially at inverse-Ackermann depth [2402.00378].

The paper also identifies unresolved depth regimes. It states that the precise asymptotic complexity of encoding good codes remains open for
\[
d\in[\omega(1),\alpha(n)-3].
\]
This leaves a gap between the fixed-depth regime, where the \(\Theta(\lambda_d(n)\cdot n)\) behavior is exact, and the inverse-Ackermann threshold, where linear wires become possible [2402.00378].

Finally, the parameter range treated by the upper bound covers any constant rate and relative distance within the Gilbert–Varshamov bound, via the condition \(r<1-h(\delta)\). The paper notes natural extensions, including sub-constant rate, very high rate with small distance, and nonbinary alphabets under Boolean encoders. These are presented as directions rather than resolved cases [2402.00378].

Source: https://www.emergentmind.com/topics/minimum-protected-depth-envelope