Marginally Absorbing Manifold (MAM)
- Marginally Absorbing Manifold (MAM) is a subset of parameter space that traps training dynamics within a prescribed target interval, losing absorption outside this range.
- The formation of a MAM is driven by gradient discontinuities arising from contact events, where the normal component of the gradient flips to bind the dynamics.
- Cyclic inverse design protocols leverage these discontinuities to induce a return-point memory effect, ensuring reproducible and bounded memory encoding.
to=arxiv_search.search 天天中彩票双色球json {"2query2 OR \2"Learning by training: emergent return-point memory from cyclically tuning disordered sphere packings\"", "max_results": 5} to=arxiv_search.search 天天中彩票提现json {"2query2 memory\" disordered systems cyclically driven", "max_results": 2(Zu et al., 1 Sep 2025) OR \2query2} to=arxiv_search.search สำนักเลขานุการองค์กร 聚利json {"2query2 absorbing manifold\" arXiv", "max_results": 2(Zu et al., 1 Sep 2025) OR \2query2} A marginally absorbing manifold (MAM) is a subset of parameter space that is absorbing for gradient-based training dynamics over a prescribed target interval, yet loses that absorbing character immediately when the target is extended beyond the interval’s endpoints. In the formulation introduced for cyclic inverse design of athermal disordered sphere packings, the MAM is the geometric object that encodes memory of the training range and reproduces a two-sided form of return-point memory under cyclic tuning of elastic properties (&&&2query2&&&).
2(Zu et al., 1 Sep 2025) OR \2. Formal definition in parameter space
The construction is posed in an PRESERVED_PLACEHOLDER_2query2-dimensional parameter space PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2^ with coordinates
A scalar observable or training function
maps parameters to a mechanical response, such as the Poisson ratio or an elastic-modulus component . Training is defined relative to a target value $F^\*$ through the objective
$\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$
with idealized continuous-time steepest-descent dynamics
$\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$
For a closed interval of training targets , an absorbing manifold PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query2^ is defined by the requirement that for every PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \2^ and every PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \22, the training dynamics beginning at PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \23 with target PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \24 returns to the same point PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \25 up to machine precision. Equivalently, the solution with PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \26 satisfies PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \27 for some finite PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \28 when PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \29. In the discretized setting with step size 2query2, the update rule is
2(Zu et al., 1 Sep 2025) OR \2^
and absorption is operationally defined by exact return to 2 after one up-and-down target cycle within the interval (&&&2query2&&&).
A manifold is marginally absorbing when it remains absorbing for all 3 but ceases to be absorbing as soon as training targets satisfy 4 or 5. The term “marginally” is therefore literal: the manifold just barely traps the dynamics, and the two endpoints 6 and 7 are the encoded memories.
The stability condition on 8 is stated in terms of tangent displacements 9:
2query2^
Within the interval, motion tangent to 2(Zu et al., 1 Sep 2025) OR \2^ is compatible with absorption, whereas normal displacements become unstable once the target exits the interval. A common misconception is to identify any absorbing set with a MAM. In this formulation, absorption alone is insufficient; marginality requires the immediate loss of absorption outside the trained target range.
2. Gradient discontinuities as the origin of the manifold
The physical mechanism proposed for MAM formation is the presence of gradient discontinuities in the training function. In the sphere-packing model, 2 is continuous in 3, but 4 is discontinuous whenever a particle pair 5 goes into or out of contact. The system energy is given by the 2D Hertzian form
6
with pair potential
7
Linear response is governed by the Hessian
8
and an elastic-modulus component is written as
9
where 2query2^ and 2(Zu et al., 1 Sep 2025) OR \2^ (&&&2query2&&&).
Because 2 but not 3, contact formation or breaking at 4 causes a jump in 5, and thus a jump in 6. Each contact event therefore defines a codimension-2(Zu et al., 1 Sep 2025) OR \2^ surface 7 across which the gradient has a finite discontinuity.
At a point 8, the jump is decomposed relative to the local unit normal 9 and tangent directions 2query2:
2(Zu et al., 1 Sep 2025) OR \2^
Since 2 itself is continuous, the tangential contribution 3 must vanish, and the relevant discontinuity is
4
Two classes of gradient-discontinuity surfaces are then distinguished. In a Type 2(Zu et al., 1 Sep 2025) OR \2^ GD, trajectories cross the surface smoothly. In a Type 2 GD, the normal component of the gradient flips sign across the surface so that both sides push toward 5; a steepest-descent or ascent trajectory that reaches such a surface becomes bound to it. The paper’s central claim is that one or more Type 2 GD surfaces at 6 and 7 convert an otherwise reversible optimization path into a marginally absorbing one.
3. Cyclic inverse design and convergence to a MAM
The simulation protocol is organized as a cyclic inverse-design procedure on mechanically stable jammed packings. Initialization begins from a jammed packing of 8 particles at volume fraction 9. A set of $F^\*$2query2^ species diameters $F^\*$2(Zu et al., 1 Sep 2025) OR \2^ is chosen, the trainable parameters are set as
$F^\*$2
and the initial configuration is quenched so that $F^\*$3 reaches a local minimum.
Single-target training then fixes a target such as $F^\*$4, for example $F^\*$5, and minimizes
$F^\*$6
using automatic differentiation plus RMSProp, or steepest descent, with energy re-minimization with respect to particle positions at each step. This establishes the local optimization dynamics that will subsequently be driven cyclically.
The cyclic sweep defines a target sequence
$F^\*$7
using the final parameter state from one target as the initial condition for the next. One full return to $F^\*$8 constitutes a cycle. Repetition continues until three operational signatures of convergence are satisfied: the cycle-to-cycle parameter trajectory becomes indistinguishable with $F^\*$9, the training trajectories $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$2query2^ become smooth with no spikes, and no contact changes occur for intermediate targets $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$2(Zu et al., 1 Sep 2025) OR \2^ (&&&2query2&&&).
Read-out is performed by sweeping a fine grid of $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$2 values, both inside and outside the training interval, from a point on $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$3 at $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$4. The recorded observables are the net displacement $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$5, the number of iteration steps, the contact-change counts, and the perpendicular distance of $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$6 to the principal-axis direction on $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$7. The text further states that each individual training step is costly, of order $\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$8–$\ell(\theta;F^\*) = [F(\theta)-F^\*]^2,$9 gradient steps times FIRE relaxations, and that one typically needs only $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$2query2–$\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$2(Zu et al., 1 Sep 2025) OR \2^ cycles before convergence. Within the article’s internal logic, these operational criteria define the empirical identification of a MAM.
4. Memory encoding and return-point phenomena
Once the dynamics is trapped on $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$2 by two Type 2 GD surfaces, one at $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$3 and one at $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$4, cyclic training within the interval $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$5 leaves $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$6 on the same loop in $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$7. By contrast, training to $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$8 or $\frac{d\theta}{dt}=-\nabla_\theta \ell(\theta;F^\*).$9 crosses a bounding GD surface and forces motion into a new region of parameter space. In this sense, the MAM stores the two training extremes as a bounded memory.
The structure is presented as reproducing the classic hallmarks of return-point memory. First, the read-out observables display sharp kinks at 2query2^ and 2(Zu et al., 1 Sep 2025) OR \2. The listed observables include the net parameter change 2, the number of gradient steps needed, and the distance of the final 3 to the line joining 4. Second, there is complete reversibility, or absorption, for any cycle contained within the training range, but irreversibility appears once the cycle amplitude exceeds either endpoint (&&&2query2&&&).
A useful clarification is that the memory is not formulated as symbolic storage or explicit state labeling. Rather, it is encoded geometrically in the accessibility structure of parameter space under the specified training dynamics. The article’s formalism therefore treats memory as a property of constrained trajectory recurrence.
This also helps distinguish the MAM from an ordinary reversible path. The reversibility is not generic; it is conditional on the path being confined by the two endpoint GD surfaces. A plausible implication is that the “memory” resides less in any single configuration than in the manifold-plus-boundary structure generated by repeated cyclic training.
5. Gradient Discontinuity Learning as the general mechanism
The paper abstracts the sphere-packing results into a broader framework called Gradient Discontinuity Learning (GDL). In that formulation, one assumes a continuous but piecewise-smooth function 5 with a collection of GD surfaces 6 where 7 jumps. Each 8 is classified as Type 2(Zu et al., 1 Sep 2025) OR \2^ or Type 2 according to the sign change of the normal component of 9 across the surface.
Under gradient descent, or descent in PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query2query2, trajectories cross Type 2(Zu et al., 1 Sep 2025) OR \2^ surfaces smoothly but become bound to Type 2 surfaces. While bound, they slide along the surface according to the tangential component PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query2(Zu et al., 1 Sep 2025) OR \2. If a closed cycle of target values encounters two distinct Type 2 surfaces, for example at PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query22^ and PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query23, then the dynamics is driven into the codimension-2 intersection of those surfaces. Once there, cyclic variation of PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query24 can move points only back and forth along that intersection, and the resulting set is marginally absorbing (&&&2query2&&&).
Crossing beyond either bounding surface requires leaving the intersection, which produces an irreversible jump and thereby implements two-sided memory. The stated requirements for GDL are a continuous PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query25 with non-trivial GD surfaces, cyclic variation of the target, and a gradient-based update rule. The text also notes that non-infinitesimal step sizes or momentum-based optimizers may produce “effective GDs” even if PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query26 were PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query27; the stated key requirement is that the path is not perfectly reversible unless pinned at special surfaces.
Within this framework, the MAM is not introduced as an idiosyncrasy of jammed solids. It is instead presented as a generic geometric outcome of cyclic training in piecewise-smooth landscapes. The paper identifies potential applications extending beyond jammed solids to sheared suspensions, biological evolution, phenotypic plasticity, machine-learning models with constrained parameterizations, and more. Because these are listed as potential applications rather than demonstrated cases, they are best read as scope conditions for the proposed mechanism rather than as established empirical generalizations.
6. Conceptual significance, limitations, and interpretation
The principal result is that athermal disordered sphere packings, when inverse-designed by cyclic tuning of elastic constants between two endpoints, evolve toward a MAM that traps the parameters. The manifold is bounded by exactly two Type 2 gradient-discontinuity surfaces associated with the endpoint training values, is absorbing for cycles within PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query28, and becomes non-absorbing immediately outside that range. The physical origin of the gradient discontinuities is contact change, and the diagnostic for Type 2 behavior is the sign flip of the normal component of PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2query29 (&&&2query2&&&).
Several interpretive points follow directly from this formulation. First, the MAM is a dynamical object defined by training trajectories, not merely a level set of PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \2query2. Second, its memory content is explicitly bounded and two-sided, tied to PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \2^ and PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \22^ rather than to arbitrary interior targets. Third, the mechanism depends on non-smooth structure in the optimization landscape, here supplied by contact changes in Hertzian packings.
A potential misconception is that the manifold stores all details of prior training history. The formulation given here supports a narrower statement: it encodes the two extreme memories PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \23 and PRESERVED_PLACEHOLDER_2(Zu et al., 1 Sep 2025) OR \2(Zu et al., 1 Sep 2025) OR \24 and yields return-point-like signatures under read-out. Another possible misconception is that gradient discontinuities must always arise from non-differentiable microscopic physics. The text instead suggests a broader view in which “effective GDs” may be induced by optimizer details such as non-infinitesimal step sizes or momentum.
The broader significance of the MAM concept lies in its provision of a precise geometric description of how cyclic environmental variation can generate both adaptation and memory. In the paper’s terms, this furnishes a simple and broadly applicable physical framework for understanding how adaptive systems learn under environmental change and retain memory of past experiences. A plausible implication is that the relevant unit of analysis in such systems is not solely the optimized configuration, but the manifold of recurrently accessible states generated by the training protocol.