Constant-additive-error approximation complexity for information bottleneck

Determine whether the optimal values of the constrained information bottleneck function $IB(P_{XY},R)$ and the Lagrangian information bottleneck function $L_{\beta}(P_{XY})$ can be approximated within a constant additive error in polynomial time for arbitrary finite-alphabet joint distributions.

Background

The paper establishes NP-hardness and inverse-polynomial additive inapproximability for both the constrained information bottleneck value IB(PXY,R)IB(P_{XY},R) and the Lagrangian value Lβ(PXY)L_{\beta}(P_{XY}) on explicitly specified rational finite-alphabet distributions. In particular, the proved lower bounds rule out polynomial-time approximation within errors of order ∣X∣−3/2|X|^{-3/2} unless P=NP\mathrm{P}=\mathrm{NP}.

The authors leave unresolved whether this computational barrier persists for approximation within a constant additive error, which would provide a substantially stronger hardness result than the inverse-polynomial bounds proved in the paper. The question concerns the general information bottleneck problem without the structural assumptions used in known exactly solvable cases.

References

the complexity of approximation within a constant additive error of eq:IB_def and eq:L_beta_def remains open.

eq:IB_def:

IB(PXY,R)=sup⁡PT∣X:T−X−YI(X;T)≤RI(Y;T).IB(P_{XY},R) =\sup_{\substack{P_{T\mid X}:\,T-X-Y\\ I(X;T)\leq R}} I(Y;T).

eq:L_beta_def:

Lβ(PXY)=sup⁡PT∣X: T−X−Y[I(Y;T)−βI(X;T)],β>0.L_{\beta}(P_{XY}) =\sup_{P_{T\mid X}:\,T-X-Y} \bigl[I(Y;T)-\beta I(X;T)\bigr], \qquad \beta>0.

— The Information Bottleneck is NP-hard  (2610.22272 - Bruno et al., 15 Oct 2026) in Section 1, Introduction