---
title: Balanced Truncation & System Lifting
url: https://www.emergentmind.com/topics/balanced-truncation-and-system-lifting
type: topic
---

# Balanced Truncation & System Lifting

Balanced truncation is a well-established model order reduction (MOR) technique for linear systems, and system lifting refers to the process of reformulating nonlinear or nonstandard problems (e.g., those with quadratic outputs) into forms amenable to balanced truncation. When a system possesses outputs that are nonlinear or quadratic in the state, or when dynamics are nonlinear but polynomial, system lifting to a quadratic-bilinear (QB) or bilinear form is a key step prior to applying balanced truncation. These methodologies are fundamental in reducing computational complexity for large-scale systems while preserving essential dynamical characteristics.

## 1. Fundamental Concepts: Balanced Truncation and System Lifting

Balanced truncation for a standard linear time-invariant (LTI) system centers on computing reachability and observability Gramians, transforming the system into a balanced realization where states are equally controllable and observable, and truncating the least controllable/observable states. For general nonlinear systems or systems with quadratic outputs, direct application is not possible.

System lifting addresses this by introducing auxiliary variables to encapsulate nonlinearities or quadratic outputs, resulting in an augmented (typically higher-dimensional but structured) system—often quadratic-bilinear (QB) or bilinear with linear output—that can then be tackled using generalized versions of the Gramians and Lyapunov equations underpinning balanced truncation [1709.06677, 1907.12084, 2507.03684].

## 2. Lifting Linear and Nonlinear Systems

For a linear system with quadratic output,
\[
\dot x = Ax + Bu,\qquad y = x^T M x,
\]
lifting proceeds by augmenting the state with the quadratic output. The lifted state \(\tilde{x} = [x^T, y]^T\) evolves according to a quadratic-bilinear system with a single linear output:
\[
\dot{\tilde{x}} = \tilde{A}\tilde{x} + \tilde{B}u + \sum_j u_j \tilde{N}_j \tilde{x} + \tilde{H}(\tilde{x} \otimes \tilde{x}),\qquad \tilde{y} = \tilde{c}^T \tilde{x},
\]
where \(\tilde{A}\), \(\tilde{B}\), \(\tilde{N}_j\), and \(\tilde{H}\) encode the dynamics and output mappings, with only one nonzero row in \(\tilde{H}\) corresponding to the quadratic output structure. This lifted system, however, is generally not stable and thus requires stabilization (e.g., shifting \(\tilde{A}\) by \(-\varepsilon\) on the new auxiliary state) before balanced truncation can be applied [1709.06677].

For general nonlinear ODEs,
\[
\dot z = f(z) + B_0 u,
\]
lifting is achieved by introducing auxiliary variables representing monomials or nonlinear functions in \(z\), rewriting the dynamics in terms of the original and auxiliary variables, and differentiating to obtain a full quadratic-bilinear system of the form
\[
\dot x = A x + H(x \otimes x) + \sum_i N_i x u_i + B u, \qquad y = Cx,
\]
where the block structure ensures that the original coordinates have linear self-dynamics, and auxiliary states are slaved to the original via quadratic or bilinear coupling [1907.12084].

For bilinear systems with quadratic (and linear) outputs,
\[
\dot x = A x + \sum_{k=1}^m N_k x u_k + B u, \qquad y_j = C_j x + x^T M_j x,
\]
lifting uses the second-moment state, \(\xi = \mathrm{vec}(x x^T)\), to obtain a lifted system in \([x^\top, \xi^\top]^\top\) with a linear output in the lifted variables, facilitating direct application of bilinear balanced truncation techniques [2507.03684].

## 3. Gramians and Lyapunov Equations for Lifted Systems

Balanced truncation for linear systems relies on standard (linear) Lyapunov equations. For lifted quadratic-bilinear or bilinear systems, computable Gramians satisfy generalized Lyapunov equations incorporating cubic, quadratic, or Volterra terms.

- In the quadratic-bilinear lifted case, the Gramians \(\tilde{P}, \tilde{Q}\) obey coupled quadratic Lyapunov equations:
\[
\tilde{A}\tilde{P} + \tilde{P}\tilde{A}^T + \tilde{B}\tilde{B}^T + \tilde{H}(\tilde{P}\otimes \tilde{P})\tilde{H}^T + \sum_j\tilde{N}_j \tilde{P} \tilde{N}_j^T = 0,
\]
\[
\tilde{A}^T \tilde{Q} + \tilde{Q} \tilde{A} + \tilde{c}\tilde{c}^T + \tilde{H}^{(2)}(\tilde{P} \otimes \tilde{Q})\tilde{H}^{(2)T} + \sum_j\tilde{N}_j^T \tilde{Q}\tilde{N}_j = 0.
\]
However, exploiting the problem's structure, these reduce to just two linear Lyapunov equations for the main blocks, specifically for \(P\) and \(Q\) as follows:
\[
A P + P A^T + B B^T = 0,
\]
\[
A^T Q + Q A + S P S + 4 M B B^T M = 0, \qquad S = A^T M + M A
\]
with explicit algebraic formulas for the scalar auxiliary parts [1709.06677].

- For general lifted bilinear systems, reachability and observability Gramians \(P, Q\) are defined via Volterra series and satisfy coupled generalized Lyapunov equations:
\[
\widetilde{A} P + P \widetilde{A}^T + \sum_{k=1}^m \widetilde{N}_k P \widetilde{N}_k^T + \widetilde{B} \widetilde{B}^T = 0
\]
and its adjoint for \(Q\) [2507.03684]. Truncated Gramians can be computed by approximating the series using the leading terms, significantly reducing computational cost.

- For lifted QB systems with zero eigenvalues (from auxiliary variables), Lyapunov equations are singular. Artificial stabilization (shifting the spectrum of the auxiliary block) is introduced to ensure Gramians exist and decay rates are favorable for low-rank projection [1907.12084].

## 4. Balanced Truncation Procedure for Lifted Systems

The reduction procedure consists of the following steps:
1. **Gramian Computation:** Solve linear or generalized Lyapunov equations for the reachability (\(P\)) and observability (\(Q\)) Gramians of the lifted system, employing low-rank or iterative solvers (e.g., ADI, MESS toolbox) where possible. For QB and bilinear systems, truncated Gramians using only first- or second-order terms can drastically reduce computational demand [1709.06677, 2507.03684].
2. **Balancing Transformation:** Factor Gramians as \(P = L_P L_P^T\), \(Q = L_Q L_Q^T\), compute SVD \(L_Q^T L_P = U \Sigma V^T\), and form balancing/projecting matrices. In lifted QB systems, the SVD structure captures the original system's Gramian singular values plus an auxiliary term.
3. **Projection and Truncation:** Restrict the lifted system to the \(r\) dominant balanced modes to obtain a reduced order quadratic-bilinear or bilinear system.
4. **Recovery:** The resulting reduced system, typically of order much smaller than the full lifted dimension, preserves key input-output behavior with strong error bounds in the linear regime (\(\| G - G_r \|_\infty \leq 2 \sum_{i>r} \sigma_i\)) or energy-based local bounds in the QB case.
5. **Stabilization and Structure Preservation:** Any artificial stabilization introduced during lifting is removed or minimized in the final model. Block-structured projections can retain physical or algebraic structure of the original model [1709.06677, 1907.12084].

## 5. Numerical Performance and Applications

Empirical studies highlight several advantages and tradeoffs:
- Lifting quadratic-output or nonlinear systems to QB/bilinear form allows balanced truncation with controllable computational cost and error.
- Direct (unlifted) approaches for linear systems with quadratic outputs suffer from a “many-output penalty”: the number of outputs in the reduced-order model (ROM) can be prohibitively large. Lifting circumvents this by encoding all quadratic outputs into a single linear output for the lifted auxiliary state [1709.06677].
- In benchmark problems (e.g., 5000-dimensional linear systems, stochastic-Galerkin mass-spring-damper, tubular-reactor PDEs), the lifted approach matches or surpasses the direct multi-output approach in accuracy while drastically reducing CPU time (speed-ups of 6x–90x depending on the chosen Lyapunov solver and lift) [1709.06677, 1907.12084, 2507.03684].
- The stabilization parameter or artificial damping introduced for auxiliary states does not noticeably affect ROM accuracy within practical ranges (\(<10^{-7}\) relative error for \(\varepsilon\) over several orders of magnitude) [1709.06677].
- Consistent findings across linear, bilinear, and nonlinear test cases indicate that truncated Gramians provide near-identical accuracy to full nonlinear Gramians at a fraction of the cost, validating their use for large-scale systems [2507.03684].

In comparisons with alternative data-driven MOR approaches such as POD-DEIM, balanced truncation of lifted systems demonstrates superior robustness to noise and mismatch between training data and test scenarios. Unlike snapshot-based methods, the balanced truncation approach for lifted systems yields a priori error control and captures input-driven dynamics even in the absence of representative training data [1907.12084].

## 6. Connections and Recent Developments

The lifting–balanced truncation paradigm has catalyzed advances in high-fidelity MOR for systems with polynomial or quadratic outputs and for classes of weakly nonlinear PDEs. Multi-stage lifting (introducing several layers of auxiliary variables) extends applicability to higher-order polynomial and even certain transcendental nonlinearities. The Kronecker product and tensor-matricization structures inherent in the lifted system dynamics facilitate efficient exploitation of sparsity and symmetry in both Gramian computation and numerical solution of generalized Lyapunov equations [1709.06677, 1907.12084, 2507.03684].

Recent contributions include primal-dual frameworks for formulating Gramians of bilinear–quadratic-output systems, rigorous existence and uniqueness guarantees for the corresponding Gramians under small-gain conditions, and systematic construction of computationally efficient truncated Gramians via Volterra expansions [2507.03684].

A plausible implication is that further algorithmic improvements in low-rank and tensor-structured Lyapunov solvers, as well as extensions to even broader classes of nonlinear systems, can be expected to synergize with the lifting–balanced truncation methodology, widening its applicability in control, estimation, and simulation of high-dimensional complex systems.

Source: https://www.emergentmind.com/topics/balanced-truncation-and-system-lifting