Geometric Consistent Learning (GCL)
- Geometric Consistent Learning (GCL) is a framework that uses Hilbert bundles and cellular sheaves to build CNNs on irregular, infinite-dimensional domains, ensuring consistent convergence across discretizations.
- It employs a two-stage discretization process—first sampling the manifold into a Hilbert cellular sheaf and then truncating fibers for finite-rank HilbNets—guaranteeing resolution independence and transferability.
- GCL offers practical benefits in applications like spatiotemporal forecasting by achieving stable geometric consistency, reducing model parameters, and demonstrating theoretical convergence in complex domains.
Geometric Consistent Learning (GCL), as instantiated in “Consistent Geometric Deep Learning via Hilbert Bundles and Cellular Sheaves” (Tandon et al., 7 May 2026), is a principled framework for building and analyzing convolutional neural networks that operate on signals living over irregular geometric domains and in fibers that may be infinite-dimensional Hilbert spaces. In this setting, geometric consistency means that, when a continuous geometric domain is discretized at different resolutions or resampled, the learned convolutional operators and network outputs converge to the same underlying continuous geometric operators and remain stable across samplings. The framework realizes this objective by defining convolutional filtering on Hilbert bundles through the connection Laplacian, sampling the manifold into a Hilbert Cellular Sheaf whose sheaf Laplacian converges to the connection Laplacian, and further discretizing fibers to obtain implementable architectures, called HilbNets, that converge to their continuous counterparts and transfer across samplings of the same geometry (Tandon et al., 7 May 2026).
1. Concept and scope
In this formulation, GCL addresses modern signals that are often infinite-dimensional—such as time series, probability distributions, or operators—and that live over irregular domains such as manifolds or networks. Classical geometric deep learning largely assumes finite-dimensional features per node and may not provide cross-sampling consistency guarantees. The Hilbert-bundle construction extends Laplacian-based convolution, heat flows, and consistency theory to settings in which “the signal at each point lives in its own Hilbert space,” while allowing arbitrary metric-compatible connections (Tandon et al., 7 May 2026).
A learning system is geometrically consistent if discretization and resampling do not alter the limiting operator being learned. The paper states this in two complementary ways. First, finer samplings produce outputs that approach those of the continuous model. Second, models trained on one sampling transfer to other samplings of the same geometry. This yields a notion of resolution independence and cross-sampling stability that is central to the framework.
The specific instantiation of GCL in this work has three parts. It defines convolutional filtering on Hilbert bundles via the connection Laplacian and the Borel functional calculus; it shows that a discretization of the base manifold induces a Hilbert Cellular Sheaf with a sheaf Laplacian that converges to as sampling density increases; and it further discretizes fibers to obtain implementable network sheaves, proving convergence and transferability for the resulting discretized HilbNets.
2. Continuous geometric model on Hilbert bundles
The continuous setting begins with a smooth, closed -dimensional Riemannian manifold with geodesic distance and normalized volume form . A Hilbert bundle assigns to each a separable real Hilbert space , and smooth sections are written as 0. A connection 1 on 2 is a covariant derivative on sections that is compatible with the Hilbert structure, so that parallel transport along curves is unitary and differentiation satisfies the Leibniz rule (Tandon et al., 7 May 2026).
The basic differential operator is the rough Laplacian, or connection Laplacian,
3
where 4 is the formal adjoint with respect to the Riemannian metric and the fiber inner products. In an orthonormal synchronous frame 5 at 6, the paper gives the coordinate expression
7
The operator extends to a closed, densely-defined operator on 8 and is self-adjoint there.
Convolutional filtering is then defined spectrally as
9
with 0 a bounded Borel function. When 1 has discrete spectrum, this becomes
2
The significance of the Borel functional calculus is that it yields bounded operators on 3 without requiring an eigen-expansion, so the formalism remains valid even when the spectrum is not discrete and the fibers are infinite-dimensional. The same operator generates bundle heat flow, 4, and the leading heat-kernel term involves parallel transport 5, making the connection geometrically explicit.
HilbNets are the neural architectures built on this operator. Given input sections 6, a filter bank 7 with 8, and a fiberwise Lipschitz nonlinearity 9, the layer recursion is
0
Practical parameterizations of 1 include polynomials, rational approximations, and band-limited expansions. This suggests that the continuous theory is designed to support implementable approximations rather than remaining purely operator-theoretic.
3. From manifolds to Hilbert Cellular Sheaves
The first discretization stage samples the manifold and induces a Hilbert Cellular Sheaf on a geometric graph. Sample points 2 are drawn i.i.d. from the uniform distribution on 3, and a graph 4 with undirected edges 5 is built. The associated sheaf 6 has node stalks
7
and edge stalks at geodesic midpoints,
8
The restriction maps are weighted unitary transports,
9
with
0
Global sections, or 1-cochains, live in the direct sum
2
The sheaf Laplacian is
3
and acts nodewise as
4
Its interpretation in the paper is that it measures local inconsistency across edges after parallel transport into a common edge stalk. In the scalar case, this reduces to a weighted graph Laplacian; in the bundle case, scalar weights are replaced by restriction operators.
The second discretization stage truncates the fibers. Fix an orthonormal basis 5 of 6 and the 7-dimensional subspace 8. A smooth bundle projection 9 produces a finite-rank network sheaf 0 with stalks 1 and block-matrix sheaf Laplacian
2
The corresponding nodewise expression is
3
where 4 is an edgewise transport in 5.
This two-stage sampling procedure is the implementability mechanism of the framework: manifold sampling produces a Hilbert sheaf, and fiber sampling produces a finite-rank network sheaf.
4. Convergence, consistency, and transferability
The central theoretical contribution is a convergence theory linking sampled sheaf operators and discretized architectures to their continuous Hilbert-bundle limits. The paper extends the sampled sheaf Laplacian to an operator on 6 by
7
For 8 and any 9, with bandwidth 0, 1, the main pointwise statement is
2
For 3, the paper also proves 4 convergence in expectation:
5
The paper presents this as a generalization to arbitrary Hilbert bundles and cellular sheaves of the graph-Laplacian-to-Laplace–Beltrami convergence result associated with Belkin–Niyogi (Tandon et al., 7 May 2026).
Finite-rank discretization is also controlled. There exists a sequence of fiber dimensions 6 such that, for 7,
8
Thus both manifold refinement and fiber refinement participate in the consistency result.
The same logic extends from operators to networks. For bounded continuous filters 9 and fiberwise Lipschitz 0, the paper states convergence in architecture,
1
It also proves transferability across independent samplings:
2
This is the formal statement of cross-sampling consistency. In the terminology of the paper, implementable HilbNets converge to the underlying continuous architectures and remain transferable across different samplings of the same bundle.
5. Architectures, algorithms, and implementation pipeline
The practical pipeline proceeds in four stages. First, one samples 3 or uses given sensors or points. Second, one builds a graph 4 with edges by 5-ball or 6-NN under geodesic distance, or a task-specific metric, and sets kernel weights 7. Third, for each edge 8 one chooses a geodesic 9 and midpoint 0 and computes or learns parallel transports 1 and 2. Fourth, one assembles the restriction maps and the sheaf Laplacian 3 in the Hilbert case or 4 in the finite-rank case (Tandon et al., 7 May 2026).
Implementable filtering avoids eigendecomposition through polynomial approximations:
5
where 6 is 7 or 8. The paper also states that Chebyshev polynomials and Lanczos/CG-based filtering apply. For sparse 9-NN graphs, polynomial filtering costs 0 per layer.
The framework allows several signal models. For time series, fibers may be 1 or 2 after truncation, with 3 applied coordinatewise in a fiber basis. For distributions, fibers may be 4 via quantile embeddings. For operators or fields, fibers may be subspaces of 5, with transports learned or computed from domain priors. Transport regularization can be imposed by optimizing over an admissible class 6, such as orthogonal or circulant transports, using a kernel on fibers.
A concise summary of the architecture and pipeline is useful:
| Component | Construction | Role |
|---|---|---|
| Continuous operator | 7 on a Hilbert bundle | Defines convolution by 8 |
| Spatial discretization | Hilbert Cellular Sheaf 9 | Approximates geometry and connection |
| Fiber discretization | Network sheaf 00 | Makes computation finite-rank |
| Filtering | Polynomial or related approximation | Avoids eigendecomposition |
| Network | HilbNet recursion with fiberwise 01 | Learns bundle-valued predictors |
This suggests that GCL is not a single loss term but an end-to-end discretization principle: continuous geometry, sampled sheaf geometry, finite-rank implementation, and architecture-level stability are treated as a single pipeline.
6. Empirical validation and observed behavior
The empirical evaluation in the paper includes both synthetic and real-world tasks. In the synthetic transport recovery experiment, the setting is a statistical bundle over centered Gaussians on 02 with Otto–Wasserstein metric, finite-rank computational fibers of dimension 03, and Levi–Civita transports known in closed form. The reported result is that a free 04 transport parametrization via Householder products recovers the Levi–Civita transport to numerical precision, approximately 05, while circulant and frozen-identity transport classes converge to analytical Frobenius-projection plateaus within approximately 06 (Tandon et al., 7 May 2026).
On spatiotemporal traffic forecasting with METR-LA and PEMS-BAY, each node carries a time-series fiber of dimension 07, and HilbNets use polynomial filters of order 08. The transport classes are frozen identity, circulant, and free 09. The paper reports MAE, RMSE, and MAPE for horizons 10, and states three qualitative outcomes: learning non-trivial transports consistently improves over frozen identity at all horizons; free 11 achieves best overall accuracy on METR-LA; and circulant transports remain competitive while using approximately 12 fewer transport parameters. The same experiments are reported to outperform FC-LSTM baselines with far fewer parameters.
The empirical discussion in the paper is explicitly tied back to the theoretical claims. The two-stage discretization is described as yielding implementable architectures; polynomial filtering avoids eigendecompositions; structured transport classes encode domain priors such as time-stationarity; and the observed stability across sampling refinements is presented as consistent with the convergence and transferability theorems. A plausible implication is that the theory is intended not merely as asymptotic justification, but as a design criterion for architecture choice and transport parameterization.
7. Broader usage, related directions, and terminological ambiguity
The expression “Geometric Consistent Learning” is not used uniformly across recent arXiv literature. Some works use GCL as a broad principle of preserving geometry under learning, while others use the acronym for different method names. The following examples illustrate the diversity of usage.
| Usage of GCL | Domain | Paper |
|---|---|---|
| Geometric consistency via Hilbert bundles and sheaves | Geometric deep learning | (Tandon et al., 7 May 2026) |
| Semantic Geometry Preservation in continual VLM learning | Continual learning | (He et al., 12 Mar 2026) |
| Geometric Set Consistency as a concrete method | Self-supervised 2D/3D vision | (Chen et al., 2022) |
| Group-wise Contrastive Learning | LiDAR registration | (Liu et al., 2023) |
| Geometry Contrastive Learning | Heterogeneous graphs | (Zhu et al., 2022) |
Several neighboring directions align with the same underlying idea that geometry should remain stable under training. “Semantic Geometry Preservation for Continual Learning” constrains cross-modal semantic geometry in pretrained vision-LLMs and explicitly links its method to the GCL principle (He et al., 12 Mar 2026). “Self-Supervised Image Representation Learning with Geometric Set Consistency” treats 3D-derived geometric consistency sets as pseudo-consistency labels for 2D representation learning and states that GSC is conceptually a direct instantiation of the broader GCL paradigm (Chen et al., 2022). “DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesis” presents GCL as the principle of enforcing invariance of geometric properties across domains during translation or adaptation (Shen et al., 2021). In multi-view stereo, GC-MVSNet and GC MVSNet plus plus enforce multi-view, multi-scale geometric consistency during learning rather than only as post-processing (Vats et al., 2023, Vats et al., 6 May 2025). In continual generalized category discovery, GOAL uses a fixed Equiangular Tight Frame classifier to impose a consistent geometric structure throughout learning, and its description states that, although the paper does not introduce the term GCL, it operationalizes the same core idea (Han et al., 23 Feb 2026).
This suggests that the acronym GCL is not standardized, but the recurring theme is stable geometry under discretization, adaptation, or task progression. Within that landscape, the Hilbert-bundle formulation is distinguished by its operator-theoretic scope, its explicit use of Hilbert Cellular Sheaves, and its convergence results for both sampled Laplacians and full neural architectures (Tandon et al., 7 May 2026).
The framework also has explicit assumptions and limitations. The main convergence theorems assume that 13 is closed, sampling is i.i.d. from the uniform measure, sections lie in 14 or 15, and transports are metric-compatible and unitary. The paper notes that real-world networks may be non-uniformly sampled and non-compact; computing or learning parallel transports can be challenging; and the block-matrix 16 scales with 17, so large fibers or graphs may require sparsification or multi-scale methods. Open questions listed in the paper include extending convergence rates, handling non-uniform sampling and boundary effects, adaptive transport learning with theoretical guarantees, and deeper connections to transformer architectures via learned sheaf transports and position-dependent bundles (Tandon et al., 7 May 2026).