Action Dynamics Metric (ADM)

• ADM is a curvature-based one-dimensional signal derived from the Euclidean norm of ASTGCN embeddings, detecting motion-phase transitions in unsupervised action localization.
• It is integrated within a lightweight pipeline for real-time, skeleton-based boundary detection, achieving high mAP and low latency on sports video datasets.
• ADM distinctly separates from other ADM usages by focusing on embedding geometry for fine-grained, annotation-free motion segmentation in temporal action analysis.

Searching arXiv for the cited work and nearby terminology to ground the article. Action Dynamics Metric (ADM) is a novel Action Dynamics Metric (ADM), computed directly from low-dimensional ASTGCN embeddings, which detects motion boundaries by identifying inflection points in its curvature profile in the unsupervised temporal action localization pipeline introduced in “UTAL-GNN: Unsupervised Temporal Action Localization using Graph Neural Networks” (Badatya et al., 27 Aug 2025). In that formulation, ADM is a one-dimensional time series derived from the Euclidean norm of block-level spatio-temporal graph embeddings produced by a pre-trained Attention-based Spatio-Temporal Graph Convolutional Network (ASTGCN). The metric is designed for fine-grained action localization in untrimmed sports videos and is used to detect motion-phase transitions without manual labeling by analyzing sign changes in the discrete second derivative of the embedding-norm signal (Badatya et al., 27 Aug 2025). The acronym “ADM” is overloaded in other literatures, notably the Arnowitt-Deser-Misner formalism in gravity (Golovnev, 2013, Kim et al., 2024), but in this context it denotes a curvature-based action-boundary signal for skeleton sequences (Badatya et al., 27 Aug 2025).

1. Definition and mathematical form

In the technical report associated with UTAL-GNN, ADM is defined on a batch of overlapping pose sub-sequences. Let $X \in \mathbb{R}^{B\times F\times J\times C}$ be a batch of pose blocks, where $B$ is the number of overlapping blocks, $F$ is the number of frames per block, $J$ is the number of joints, and $C$ is the feature dimension. Let $A \in \{0,1\}^{J\times J}$ be the fixed human-skeleton adjacency matrix, and let $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$ denote the pre-trained ASTGCN encoder. Passing block $b$ through the encoder yields $Z_b \in \mathbb{R}^{F\times J\times D}$ (Badatya et al., 27 Aug 2025).

The Action Dynamics Metric for block $b$ is then defined as the Euclidean norm of the embedding tensor:

$B$0

ADM is therefore the one-dimensional series

$B$1

To detect motion-phase transitions, the method computes the discrete second derivative of $B$2:

$B$3

A candidate inflection point is flagged when two conditions hold: first, $B$4; second,

$B$5

These conditions are stated to identify blocks where the curvature of the ADM signal changes sign, corresponding to abrupt changes in motion dynamics (Badatya et al., 27 Aug 2025).

This formulation makes the metric unusual among temporal localization signals because the primary observable is not pose displacement, velocity, or a classifier score, but the norm of a learned spatio-temporal embedding. A plausible implication is that ADM treats boundary detection as a question of embedding geometry rather than explicit phase annotation.

2. Role within the UTAL-GNN pipeline

ADM appears as the inference-stage signal in a lightweight and unsupervised skeleton-based action localization pipeline that leverages spatio-temporal graph neural representations (Badatya et al., 27 Aug 2025). The full pipeline is organized into six steps.

First, the system performs pose sequence acquisition from an untrimmed video at 60 fps, extracting 2D joint coordinates ($B$6) per frame via a pose estimator (e.g. AlphaPose). Second, the pose stream is divided by blockwise sub-sequence partitioning using window size $B$7 frames ($B$8) and stride = 1, yielding $B$9 overlapping blocks $F$0 (Badatya et al., 27 Aug 2025).

Third, the model performs ASTGCN pre-training (denoising task). Gaussian noise $F$1 with $F$2 is added to each block. Noisy blocks are passed through $F$3 ASTGCN layers ($F$4), each with Chebyshev filter $F$5 and latent dimension $F$6. The output embedding is sent through an FC layer to reconstruct denoised poses, and the training loss is the mean squared error between original and reconstructed poses. Optimization uses Adam with $F$7 for 100 epochs (Badatya et al., 27 Aug 2025).

Fourth, at inference, the system feeds clean blocks through the pre-trained ASTGCN and obtains $F$8 for each block. Fifth, it computes $F$9 for all blocks, producing the ADM time series. Sixth, it computes $J$0, identifies indices satisfying the near-zero and sign-change criteria, and maps block index $J$1 back to a frame timestamp $J$2 (Badatya et al., 27 Aug 2025).

The operational position of ADM in this workflow is important. It is not the representation learner itself; rather, it is the boundary detection mechanism applied to the learned representation. This suggests a separation between unsupervised representation learning via denoising and unsupervised segmentation via curvature.

3. Curvature-based boundary detection

The theoretical motivation given for ADM is explicitly curvature-based. The report states: Within a continuous motion phase, the pose dynamics evolve smoothly, so the embedding norm $J$3 is approximately a low-curvature function of $J$4. At a transition such as takeoff $J$5 rotation, the dynamics and the embedding geometry change abruptly, which manifests as a local change in the second derivative of $J$6 (Badatya et al., 27 Aug 2025).

The formal statement is that if motion phase $J$7 applies $J$8 before a transition block $J$9 and motion phase $C$0 applies $C$1 after, then

$C$2

The discrete curvature $C$3 is then used to capture this jump, and the zero-crossing condition is used to isolate $C$4 (Badatya et al., 27 Aug 2025).

This framing places ADM in a family of unsupervised change-point detectors, but with the change statistic evaluated on GNN embeddings rather than raw trajectories. The report’s wording is narrower than a generic change-point formulation: the target is specifically motion-phase transitions, and the detection rule is tied to inflection points in its curvature profile rather than, for example, threshold crossings of first-order differences (Badatya et al., 27 Aug 2025).

A common source of confusion is the acronym itself. In gravitational physics, “ADM” usually denotes the Arnowitt-Deser-Misner decomposition or related Hamiltonian formalism (Golovnev, 2013). The UTAL-GNN usage is unrelated: it defines a learned action-boundary signal on skeleton embeddings rather than a spacetime metric decomposition. The shared acronym is terminological only.

4. Algorithmic specification and hyperparameters

The technical report includes explicit pseudocode for ADM extraction. The procedure takes as input a sequence of 2D poses $C$5, a window $C$6, and a pretrained ASTGCN encoder $C$7, and returns a list of frame indices marking motion boundaries. The pseudocode constructs blocks $C$8, computes embeddings $C$9, forms the norm sequence $A \in \{0,1\}^{J\times J}$0, computes $A \in \{0,1\}^{J\times J}$1, and then applies the criterion

$A \in \{0,1\}^{J\times J}$2

before assigning the center frame $A \in \{0,1\}^{J\times J}$3 to the boundary set (Badatya et al., 27 Aug 2025).

The report also enumerates the major hyperparameters and their effects:

• Window size $A \in \{0,1\}^{J\times J}$4: small $A \in \{0,1\}^{J\times J}$5 gives finer temporal resolution but noisier ADM; large $A \in \{0,1\}^{J\times J}$6 gives smoother ADM but coarser boundary localization. Empirically $A \in \{0,1\}^{J\times J}$7 yields optimal mAP/latency on DSV.
• Noise std $A \in \{0,1\}^{J\times J}$8: too low causes underfitting of denoising; too high causes embeddings to focus on global shape only. $A \in \{0,1\}^{J\times J}$9 is used.
• Number of ASTGCN blocks $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$0 and embedding dimension $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$1: $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$2 provides the best latency/accuracy trade-off in the reported ablation.
• Chebyshev filter size $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$3: controls temporal receptive field in each GCN layer; $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$4 optimizes performance.
• Curvature threshold $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$5: controls sensitivity of inflection detection and should be small relative to ADM magnitude (set via validation) (Badatya et al., 27 Aug 2025).

These hyperparameters show that ADM is not a standalone scalar rule but part of a tuned representation-and-detection stack. The role of $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$6 is especially central because it jointly controls block construction, temporal alignment, and the smoothness of the final ADM signal.

5. Empirical performance and generalization

On the DSV Diving dataset, the UTAL-GNN paper reports that the method achieves a mean Average Precision (mAP) of 82.66% and average localization latency of 29.09 ms, while matching state-of-the-art supervised performance and maintaining computational efficiency (Badatya et al., 27 Aug 2025). The detailed table in the report compares four models:

Model	mAP_avg	Latency_avg (ms)
STGCN	73.27	49.92
TSAGCN	74.93	44.17
AGCN	80.18	32.42
Ours (ADM-GNN)	82.66	29.09

The accompanying train/test values are also reported: STGCN gives $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$7, TSAGCN gives $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$8, AGCN gives $$f_{\mathrm{ASTGCN}}(\cdot,A): \mathbb{R}^{F\times J\times C} \to \mathbb{R}^{F\times J\times D}$$9, and Ours (ADM-GNN) gives $b$0 for train/test mAP, with corresponding train/test latencies of $b$1 ms for the ADM-based method (Badatya et al., 27 Aug 2025).

The key observations stated in the report are that the unsupervised ADM-based method matches or exceeds fully supervised GNNs (AGCN) in mAP and yields the lowest localization latency (29 ms avg), suitable for real-time applications (Badatya et al., 27 Aug 2025). The paper also states that the system generalizes robustly to unseen, in-the-wild diving footage without retraining, which is presented as evidence of practical applicability in embedded or dynamic environments (Badatya et al., 27 Aug 2025).

A plausible implication is that the denoising pre-training objective learns motion dynamics that transfer across recording conditions, while ADM supplies a task-specific but annotation-free boundary detector. The reported robustness claim, however, is formulated specifically for diving footage rather than as a general theorem of domain transfer.

6. Computational and deployment considerations

The report provides explicit implementation considerations for computational complexity, memory, real-time deployment, and robustness. For complexity, ASTGCN per block is given as

$b$2

operations, while ADM computation requires

$b$3

for norms plus $b$4 for curvature (Badatya et al., 27 Aug 2025).

For memory, the report states that model parameters are approximately

$b$5

and that the embedding buffer for a sliding window of $b$6 blocks is

$b$7

It further states typical total memory <200 MB for $b$8 (Badatya et al., 27 Aug 2025).

For real-time deployment, the report recommends a fixed sliding window and online curvature update, keeping only the last two $b$9 values to compute $Z_b \in \mathbb{R}^{F\times J\times D}$0. It also notes that thresholding can be implemented as a simple comparator for embedded MCU/DSP. On performance hardware, block inference and ADM can be computed in <30 ms (Badatya et al., 27 Aug 2025). These details are consistent with the latency results on DSV and explain why the method is positioned as suitable for lightweight real-time action analysis.

Regarding robustness, the report states that pre-training on denoising task confers resilience to minor estimation errors, but gross misdetections in 2D pose can degrade ADM quality (Badatya et al., 27 Aug 2025). This limitation matters because the entire pipeline depends on 2D pose fidelity at the front end. The method is therefore unsupervised with respect to action labels, but not independent of pose-estimation quality.

7. Relation to other uses of “ADM” and interpretive scope

The acronym “ADM” carries established meanings outside action localization. In canonical gravity, it refers to the Arnowitt-Deser-Misner decomposition of spacetime into lapse, shift, and induced spatial metric, with associated Hamiltonian and momentum constraints (Golovnev, 2013). Related work also discusses global shift symmetry on an ADM hypersurface and conserved charges generated by the ADM canonical momentum (Kim et al., 2024). Another distinct usage appears in Position-Dependent Mass Quantum systems and ADM formalism, where the term is tied to a covariant canonical framework for general relativity (Momeni, 2020).

These usages are conceptually separate from the Action Dynamics Metric of UTAL-GNN. In the action-localization setting, ADM is not a decomposition, a Hamiltonian formalism, or a gravitational metric. It is the scalar series $Z_b \in \mathbb{R}^{F\times J\times D}$1 constructed from ASTGCN embedding norms and interrogated through discrete curvature (Badatya et al., 27 Aug 2025). Because the data block contains multiple “ADM” expansions from unrelated domains, disambiguation is essential in bibliographic and technical contexts.

Within its own domain, ADM is presented as a lightweight, fully unsupervised mechanism to detect fine-grained motion boundaries by leveraging the geometry of spatio-temporal graph embeddings (Badatya et al., 27 Aug 2025). The strongest supported claims concern the DSV Diving setting, the ASTGCN-denoising pre-training regime, curvature-based inflection detection, and real-time suitability under the reported configuration. Broader extrapolations to other action domains would remain interpretive unless supported by additional task-specific evidence.