---
title: 'GridTD: Tensor Decomposed Multi-Res Grid Encoding'
url: https://www.emergentmind.com/topics/tensor-decomposed-multi-resolution-grid-encoding-gridtd
type: topic
---

# GridTD: Tensor Decomposed Multi-Res Grid Encoding

Searching arXiv for recent papers on GridTD and closely related tensor-decomposed multi-resolution grid methods.
Tensor Decomposed Multi-resolution Grid Encoding (GridTD) is an unsupervised continuous representation framework for compressive imaging reconstruction that combines tensor decomposition, multi-resolution grid encoding, and a lightweight neural network to recover high-dimensional images from compressed measurements. In the formulation introduced for video snapshot compressive imaging (SCI), spectral SCI, and compressive dynamic MRI, GridTD replaces a full \(D\)-dimensional grid encoder with a tensor-decomposed construction built from one-dimensional multi-resolution encoders, then fuses them through a CP-like structure and a small multilayer perceptron (MLP). The method is presented as retaining the hierarchical modeling ability of multi-resolution grid encoding while inheriting the compactness of tensor decomposition, and the accompanying analysis derives a Lipschitz property, a generalization error bound, and fixed-point convergence results for the reconstruction algorithm [2507.07707].

## 1. Problem setting and rationale

GridTD is formulated for linear inverse problems of the form \(y = A(x) + \text{noise}\), specialized in the paper to three compressive imaging regimes. In video SCI, a two-dimensional measurement is formed from a three-dimensional video tensor \(\mathcal{X} \in \mathbb{R}^{n_1 \times n_2 \times n_3}\) through
\[
\mathbf{Y} = \sum_{t=1}^{n_3} \mathcal{M}_t \odot \mathcal{X}_t + \mathbf{Z}.
\]
In spectral SCI, a hyperspectral cube is encoded by a coded aperture with spectral shift,
\[
\mathbf{Y} = \sum_{t=1}^{n_3} \operatorname{shift}(\mathcal{M}_t \odot \mathcal{X}_t) + \mathbf{Z},
\]
with \(\mathbf{Y}\in\mathbb{R}^{n_1\times (n_2 + d(n_3-1))}\). In compressive dynamic MRI, multi-coil undersampled \(k\)-space data satisfy
\[
\mathbf{Y}_c = \mathbf{F}_u \mathbf{S}_c \mathbf{X},\quad 1\le c\le C.
\]
These models are treated through a single continuous-representation viewpoint in which the unknown object is modeled as a function of coordinates rather than as a fully stored discrete tensor [2507.07707].

The paper motivates GridTD by contrasting it with two prevailing families of unsupervised representations. Coordinate MLPs suffer from spectral bias and often require large networks to fit sharp spatial, temporal, or spectral detail. InstantNGP-style multi-resolution grid encoders improve high-frequency modeling, but in high-dimensional settings they require \(D\)-dimensional grids whose parameter count and encoding cost scale exponentially with the data dimension \(D\). GridTD is introduced specifically to preserve the multi-scale behavior of grid encoding while replacing full \(D\)-dimensional grids with a tensor-decomposed structure that scales linearly in \(D\) [2507.07707].

## 2. Encoding architecture and tensor-decomposed representation

GridTD operates on normalized coordinates \(\mathbf{v} \in [0,1)^D\). For each dimension \(d\), it defines a one-dimensional multi-resolution grid encoder
\[
\mathbf{H}_d(v_d):[0,1)\to\mathbb{R}^{R},
\]
where \(R = L F\) is the product of the number of levels \(L\) and the feature dimension \(F\) per level. At level \(l\), a one-dimensional grid tensor \(\mathcal{G}_{l,d} \in \mathbb{R}^{N_l\times F}\) is queried by linear interpolation:
\[
\mathbf{h}_{l,d}(v_d) = (1-u_{v_d,l})\, \mathcal{G}_{l,d}[\lfloor (N_l-1)v_d\rfloor,:] + u_{v_d,l}\,\mathcal{G}_{l,d}[\lfloor (N_l-1)v_d\rfloor+1,:],
\]
with
\[
u_{v_d,l} = (N_l-1)v_d - \lfloor (N_l-1)v_d\rfloor.
\]
The per-dimension encoding concatenates these levelwise vectors:
\[
\mathbf{H}_d(v_d) = \bigoplus_{l=1}^L \mathbf{h}_{l,d}(v_d)\in\mathbb{R}^{LF}.
\]
GridTD then fuses dimensions by element-wise multiplication,
\[
\mathbf{H}_{\rm GridTD}(\mathbf{v}) := \bigodot_{d=1}^D \mathbf{H}_d(\mathbf{v}[d]) \in \mathbb{R}^{R},
\]
so that each channel is a product of one factor from every dimension. This is the mechanism by which the encoding acquires a CP-decomposition-like structure [2507.07707].

The paper makes this tensor interpretation explicit under tensor parallelism. If \(\mathcal{H} \in \mathbb{R}^{n_1\times\cdots\times n_D\times R}\) denotes the tensor of GridTD features evaluated on a Cartesian grid, then \(\mathcal{H}\) is represented as a concatenation of rank-one outer products over dimensions, and summing over the last dimension recovers the standard CP form
\[
\sum_{r=1}^R \bigotimes_{d=1}^D \mathbf{h}_{r,d}.
\]
In this sense, GridTD is not merely inspired by tensor decomposition; its feature tensor is CP-structured, while the factor vectors themselves are parameterized by one-dimensional multi-resolution grid encoders [2507.07707].

A small MLP maps the rank-space feature to an intensity value:
\[
(g_\Theta \circ \mathbf{H}_{\rm GridTD})(\mathbf{v}) = \mathbf{W}_2 \sigma\big(\mathbf{W}_1 \mathbf{H}_{\rm GridTD}(\mathbf{v}) + \mathbf{b}\big).
\]
The paper emphasizes that a depth-2 MLP is already sufficient, and ablations show that increasing the depth to 3 or 4 layers yields negligible gain [2507.07707].

The resulting storage and encoding complexity differ sharply from full \(D\)-dimensional multi-resolution grids.

| Scheme | Storage complexity | Encoding complexity |
|---|---|---|
| InstantNGP-like \(D\)-D grids | \(\mathcal{O}(L F N_l^D)\) | \(\mathcal{O}((2n)^D L F)\) |
| GridTD | \(\mathcal{O}(L F D N_l)\) | \(\mathcal{O}(2n D L F)\) |

For the example \(D=3\) and \(n=100\), the paper reports 3.12M parameters for InstantNGP versus 0.02M for GridTD, and 38.05s versus 1.31s for 300 iterations of inpainting [2507.07707].

## 3. Reconstruction algorithm, regularization, and temporal adaptation

GridTD is trained within a plug-and-play ADMM procedure. For video SCI, the optimization is written as
\[
\min_{\mathcal{X},\mathcal{V}} \frac{1}{2}\left\|\mathbf{Y} - \sum_{t=1}^{n_3} \mathcal{M}_t \odot \mathcal{X}_t \right\|_F^2 + \text{GridTD}(\mathcal{V})
\quad \text{s.t. } \mathcal{X} = \mathcal{V}.
\]
The ADMM loop alternates among an \(\mathcal{X}\)-update, a \(\mathcal{V}\)-update, and a dual update. The \(\mathcal{X}\)-subproblem has a closed form for video SCI; the \(\mathcal{V}\)-subproblem corresponds to training the GridTD network against the current ADMM target; and the dual variable is updated by
\[
\mathcal{U}^{k+1} = \mathcal{U}^k + \mathcal{X}^{k+1} - \mathcal{V}^{k+1}.
\]
The same algorithmic pattern is used for spectral SCI and MRI with task-specific forward operators in the fidelity step [2507.07707].

During the \(\mathcal{V}\)-update, the represented tensor is produced by evaluating the GridTD network on normalized coordinates and then minimizing
\[
\frac{\rho^k}{2} \left\| \mathcal{V}_\Theta - \mathcal{X}^{k+1} - \mathcal{U}^k \right\|_F^2 + \lambda_1 \mathrm{TV}(\mathcal{V}_\Theta) + \lambda_2 \mathrm{SSTV}(\mathcal{V}_\Theta).
\]
Here
\[
\mathrm{TV}(\mathcal{V}) = \| D_x\mathcal{V} \|_1 + \| D_y\mathcal{V} \|_1,
\]
and
\[
\mathrm{SSTV}(\mathcal{V}) = \| D_x(D_z \mathcal{V})\|_1 + \| D_y(D_z\mathcal{V})\|_1.
\]
These regularizers are used to exploit spatial and temporal or spectral smoothness and to increase robustness to noise [2507.07707].

For video SCI, the paper introduces a temporal affine adapter to relax an otherwise strict low-rank temporal structure. A latent low-rank tensor \(\mathcal{L}\) is mapped to \(\mathcal{V}\) by frame-wise affine transforms,
\[
\mathcal{V} = \mathcal{A}(\mathcal{L}),
\]
with
\[
\mathcal{A}(\mathcal{L})[i,j,t] = \mathrm{Bilinear}\Big(\mathcal{L}[:,:,t],\ \Lambda^{(t)}(i,j)\Big).
\]
The affine matrix includes per-frame scale \(s^{(t)}\), rotation \(\theta^{(t)}\), and translations \(b_x^{(t)}, b_y^{(t)}\). Rather than learning independent translations, the paper models \(b_x^{(t)}\) and \(b_y^{(t)}\) by small MLPs driven by the temporal GridTD encoder,
\[
b_x^{(t)} = f_x\Big(\mathbf{H}_3\big(\tfrac{t-1}{n_3}\big)\Big),\quad
b_y^{(t)} = f_y\Big(\mathbf{H}_3\big(\tfrac{t-1}{n_3}\big)\Big).
\]
This design couples motion modeling to the same temporal feature space used by the main representation [2507.07707].

## 4. Theoretical properties

The theoretical analysis in the paper compares the smoothness and generalization of GridTD with those of InstantNGP-style encoders. Assuming a \(\gamma\)-Lipschitz activation, bounded grid embeddings, and \(\eta = \|\mathbf{W}_1\|_1 \|\mathbf{W}_2\|_1\), with \(N = \sum_{l=1}^L (N_l - 1)\), the paper proves for InstantNGP
\[
|f_{\rm INGP}(\mathbf{v}_1)-f_{\rm INGP}(\mathbf{v}_2)|
\le 2^D \gamma \eta D N \|\mathbf{v}_1-\mathbf{v}_2\|_1,
\]
whereas for GridTD
\[
|f_{\rm GridTD}(\mathbf{v}_1)-f_{\rm GridTD}(\mathbf{v}_2)|
\le 2 \gamma \eta D N \|\mathbf{v}_1-\mathbf{v}_2\|_1.
\]
The distinction is that the Lipschitz constant of GridTD scales linearly in \(D\), while the bound for InstantNGP scales as \(\mathcal{O}(2^D)\) [2507.07707].

Using these constants, the paper derives generalization error bounds for squared loss. With probability \(1-\delta\),
\[
\mathcal{G}[f_{\rm GridTD}] \le \frac{8\gamma\eta D N}{\sqrt{n}} + 3\sqrt{\frac{\log(2/\delta)}{2n}},
\]
while the corresponding bound for InstantNGP is
\[
\mathcal{G}[f_{\rm INGP}] \le \frac{2^{D+2}\gamma\eta D N}{\sqrt{n}} + 3\sqrt{\frac{\log(2/\delta)}{2n}}.
\]
The paper interprets this as showing that GridTD maintains stable generalization behavior as dimensionality increases, whereas the high-dimensional grid encoder inherits an exponential dependence on \(D\) [2507.07707].

A separate analysis addresses the reconstruction algorithm itself. Under a bounded-residual condition for the \(\mathcal{V}\)-subproblem and standard assumptions on the ADMM penalty update, the sequence \((\mathcal{X}^k, \mathcal{V}^k, \mathcal{U}^k)\) is proved to converge to a fixed point. The argument is given for video SCI and stated to apply analogously to MRI and spectral SCI variants. This places the method in a rare category among unsupervised continuous representations for inverse problems: the paper provides both representation-level and algorithm-level guarantees [2507.07707].

## 5. Empirical behavior across compressive imaging tasks

The main experimental evidence is reported on six \(256\times256\times8\) grayscale video SCI benchmarks, ten KAIST hyperspectral scenes for spectral SCI, and retrospective cardiac cine from OCMR for dynamic MRI. In video SCI, average PSNR/SSIM across Aerial, Crash, Drop, Kobe, Runner, and Traffic are reported as 29.79 dB / 0.889 for InstantNGP and 30.64 dB / 0.903 for GridTD. Other unsupervised baselines in the same table include 26.85 / 0.846 for GAP-TV, 25.47 / 0.735 for PnP-DIP, 25.62 / 0.754 for DVP, 28.21 / 0.845 for Factorized-DVP, and 29.55 / 0.871 for SCI-BDVP. The accompanying qualitative comparison emphasizes sharper edges, improved texture, and fewer artifacts for GridTD [2507.07707].

On spectral SCI, GridTD is evaluated against both supervised and unsupervised methods. The average PSNR/SSIM reported for GridTD are 36.99 / 0.953, compared with 36.09 / 0.938 for LRSDN, 35.66 / 0.945 for InstantNGP, 35.93 / 0.956 for CST-L, and 36.10 / 0.954 for MST++. The paper highlights both improved spatial detail and better preservation of local spectral signatures, with spectral curves closely matching ground truth in the provided examples [2507.07707].

On dynamic MRI, the strongest quantitative example is at acceleration factor \(9.7\) with 21 spokes, where the reported PSNR/SSIM are 27.70 / 0.666 for zero-filled NUFFT, 38.99 / 0.955 for GRASP, 37.84 / 0.935 for an INR with Fourier features, 42.38 / 0.979 for InstantNGP, and 43.98 / 0.983 for GridTD. The paper states that GridTD consistently yields the highest PSNR and SSIM, or tied best SSIM at the highest acceleration factor, while approximately halving runtime relative to InstantNGP in this task [2507.07707].

Ablations on the Runner video SCI sequence isolate the role of major components. The full model with TV, SSTV, tensor decomposition, temporal affine adapter, and a 2-layer MLP attains 35.22 / 0.957. Removing TV yields 34.79 / 0.950, removing SSTV yields 34.76 / 0.950, removing tensor decomposition—equated in the paper with reverting to InstantNGP—yields 34.50 / 0.955, and removing the affine adapter yields 35.05 / 0.957. Increasing MLP depth to 3 or 4 layers gives negligible improvement. The paper also reports that performance is stable over broad ranges of \(F\), \(L\), and \((\lambda_1,\lambda_2)\), with the best values in the reported experiment occurring near \(F=60\), \(L=60\), \(p_1=5\), and \(p_2=3.5\) for \(\lambda_1 = p_1\lambda\), \(\lambda_2 = p_2\lambda\), \(\lambda=4\times10^{-6}\) [2507.07707].

## 6. Relation to neighboring tensor-grid methods and broader design space

GridTD belongs to a broader family of methods that combine structured grids, low-rank tensor models, and lightweight decoders, but it occupies a specific point in that design space. F-Hash defines a full 4D multi-resolution “tesseract” grid over \((t,x,y,z)\) with a collision-free linearization and a shallow MLP, but it does not perform tensor decomposition; in the terminology used in that paper, it is better viewed as a full 4D multi-resolution tensor encoding rather than a decomposed one [2507.03836]. C-Pic learns low-rank latent encodings of multidimensional grid data through TT decomposition and differentiable cross-approximation, emphasizing sample-efficient learning from only a fraction of tensor entries; this suggests a different route to GridTD-like systems in which adaptive TT sampling replaces explicit hash-grid parameterization [2105.14250].

Other nearby work develops multi-resolution tensor structure more directly. A multi-resolution low-rank tensor decomposition based on sums of CP models over different grouped unfoldings treats “resolution” as a hierarchy of mode groupings rather than spatial downsampling, which is conceptually close to GridTD’s use of low-rank structure across dimensions [2406.18560]. Multi-resolution low-rank tensor formats represent a tensor as a sum of compressed tensors defined on increasingly coarse grids, using explicit prolongation and averaging operators; that formulation supplies a grid hierarchy with coarse-to-fine residual correction rather than a hash-encoded coordinate network [1908.11413]. T4DT, by contrast, compresses time-varying 3D TSDFs with Tucker, TT, QTT, OQTT, and TT–Tucker hybrids, showing that 4D grid data can be made extremely compact through closed-form tensor truncation, without the network-training loop used by GridTD [2208.01421]. In operator learning, MG-TFNO combines a multi-grid domain decomposition with a global tensor factorization of Fourier weights, which instantiates the same general pattern—multi-resolution grids plus tensorized parameters—in a PDE setting rather than an inverse-imaging one [2310.00120].

This comparison indicates that GridTD’s distinctive contribution is not merely “tensor decomposition plus grids,” but a particular synthesis: one-dimensional multi-resolution encoders along each axis, CP-like rank fusion by Hadamard products, a very small MLP, and optimization within a physics-informed ADMM loop. The paper suggests several direct extensions of that synthesis, including hyperspectral–multispectral fusion, multi-dimensional super-resolution, more sophisticated motion adapters, and alternative tensor formats such as Tucker or TT within the same encoding idea [2507.07707].

Source: https://www.emergentmind.com/topics/tensor-decomposed-multi-resolution-grid-encoding-gridtd