Heracles in Astronomy, ML, and Robotics
- Heracles is a chemically distinct, metal-poor inner-Galaxy proto-component identified via orbital dynamics and Plummer density modeling in Galactic archaeology.
- Heracles denotes a hybrid SSM–Transformer model that integrates global state-space modules and local convolution, achieving competitive high-resolution image and time-series analysis.
- Heracles also refers to a state-conditioned diffusion middleware in humanoid robotics that bridges precise tracking with generative recovery, improving robustness under large deviations.
Searching arXiv for relevant papers on “Heracles” to ground the article and disambiguate the multiple uses of the term. Found multiple distinct research usages of “Heracles,” including Milky Way archaeology, machine learning, and humanoid control. I’ll rely on the specific papers supplied in the data block and cite them precisely. Heracles is a name used for several unrelated research objects in contemporary literature. In Galactic archaeology, it denotes a chemically defined inner-Galaxy proto-Galactic component identified in APOGEE–Gaia analyses and modeled as a significant fragment of the proto-Milky Way (Horta et al., 2024). In machine learning, it denotes a hybrid SSM–Transformer architecture for high-resolution image and time-series analysis built from a Hartley-kernel global SSM, a localized convolutional SSM, and attention-based token interaction (Patro et al., 2024). In humanoid robotics, it denotes a state-conditioned diffusion middleware that operates between reference motions and low-level physics trackers, preserving identity-like tracking near nominal states and synthesizing recovery trajectories under large deviations (Tao et al., 29 Mar 2026). The shared name therefore functions as a disciplinary homonym rather than a single concept.
1. Disciplinary scope and nomenclature
In the Milky Way literature, “Heracles” appears as a stellar structure or proto-Galactic fragment inferred from chemistry, spatial concentration, and orbital properties. Horta & Schiavon identify populations in the inner Galaxy largely associated with the Heracles structure through a purely chemical dissection of APOGEE–Gaia stellar populations, and argue that the proto-Milky Way is at least comprised of two significant fragments: the main in situ progenitor and the Heracles structure (Horta et al., 2024).
In machine learning, “Heracles” names a model architecture introduced for vision and time-series analysis. It is explicitly described as “a Hybrid SSM–Transformer Model for High-Resolution Image and Time-Series Analysis,” with a three-component block comprising a global SSM, a local SSM, and an attention module (Patro et al., 2024).
In humanoid control, “Heracles” names a control framework subtitled “Bridging Precise Tracking and Generative Synthesis for General Humanoid Control.” Its core contribution is a state-conditioned diffusion middleware that adapts between precise tracking and generative recovery without explicit mode switching (Tao et al., 29 Mar 2026).
This multiplicity of meanings is important because the astronomical, machine-learning, and robotics usages are technically unrelated, despite sharing the same label.
2. Heracles in Galactic archaeology: identification and chemistry
Heracles was initially characterized in APOGEE–Gaia work as a metal-poor, low-energy, high-eccentricity substructure confined to the inner few kpc of the Milky Way halo. In APOGEE DR17 + Gaia EDR3, 300 Heracles candidate stars were selected solely by orbital parameters plus a chemical cut in the [Mg/Mn]–[Al/Fe] plane. The full criteria were , , a two-segment selection in the [Al/Fe] vs. [Mg/Mn] plane, and ; the resulting sample lay at kpc (Horta et al., 2022).
A later APOGEE–Gaia analysis used a purely chemical dissection. In that framework, stars of the “unevolved” locus in the [Mg/Mn]–[Al/Fe] plane satisfy or , with boundary
and Heracles is then isolated by additional cuts in the [Mg/Fe]–[Fe/H] plane, selecting the high-[Mg/Fe], moderate-[Fe/H] locus that is spatially confined to the inner Galaxy (Horta et al., 2024).
Chemically, Heracles is consistently described as metal poor and -enhanced. One APOGEE-based characterization gives a metallicity distribution spanning roughly with a peak around , median 0 dex, and dispersion 1 dex. For Mg, the sequence is approximately 2 dex over 3, with no statistically significant knee detected up to 4. Fe-peak and neutron-capture tracers were reported as 5 dex at 6 rising to 7 dex at 8, 9 flat at 0, and 1 at 2 (Horta et al., 2022).
The chemically dissected proto-Galaxy analysis gives a closely related but not identical description: Heracles stars span roughly 3, peak around 4, and are distinguished at fixed 5 by relatively high 6-enhancement, 7–8, compared with lower-[Mg/Fe] debris such as Gaia-Enceladus/Sausage (Horta et al., 2024).
3. Spatial structure, density modeling, and mass of the Galactic Heracles
The most explicit density model for Heracles is a triaxial, oblate Plummer profile. For Heracles-dominated chemical cells, the three-dimensional density is written as
9
or, in mass-normalized form,
0
For the core Heracles cell, the best-fit parameters are 1, 2, and 3 (Horta et al., 2024).
These values are consistent with the broader proto-Galaxy fit, which finds the chemically defined populations to be well represented by a Plummer model with a scale radius of 4 kpc and an oblate ellipsoid with flattening parameters 5 and 6. The interpretation offered there is that the Milky Way plausibly hosts a low-mass, metal-poor, bulge component (Horta et al., 2024).
Mass estimates depend on the adopted chemical cell definition. Integrating the density of Cell 2 within 7 yields
8
Summing over all three inner-Galaxy chemical cells gives a combined mass of 9, while modeling all three together gives 0 (Horta et al., 2024).
Morphologically, the best-fit 1 indicates a distinctly oblate ellipsoid, and 2 indicates only mild triaxiality. Heracles occupies the inner 3–4 kpc apocenter halo, overlaps the classical bulge/bar region, and remains chemically distinct from the bar’s younger, higher-[Fe/H] populations. Its centrally concentrated Plummer core with 5 kpc was described as resembling a low-mass, metal-poor bulge component, a “poor old heart,” embedded within the boxy/peanut bar (Horta et al., 2024).
An earlier APOGEE-based interpretation, using orbital decay and chemical arguments, estimated a progenitor stellar mass 6, with accretion at high redshift 7, and interpreted Heracles as a building block whose debris now dominate the very inner halo (Horta et al., 2022). This suggests that published mass and origin estimates depend sensitively on the adopted selection and modeling strategy.
4. Competing interpretations: accreted fragment, proto-Galactic component, or Aurora analogue
The principal controversy surrounding Galactic Heracles concerns whether it is best understood as an ex situ merger remnant, a distinct proto-Galactic fragment, or the chemical twin of an in situ population called Aurora.
One APOGEE-based study states that Heracles differs chemically from in situ populations such as Aurora and its inner halo counterparts in a statistically significant way. Using a 13-element 8 comparison,
9
with 0 for the inner high-1 comparison and 2 for Heracles versus Aurora, it reports at 3: 4 and
5
The same work argues that in every major element, especially O, Mg, and Si, Heracles is 6–7 dex lower than the in situ high-8 sequence at the same 9, and interprets this as evidence that the star formation rate was lower in Heracles than in the early Milky Way (Horta et al., 2022).
A different analysis reaches the opposite conclusion. In an unsupervised decomposition of the local stellar halo, Myeong et al. report that “Aurora is entirely consistent with the chemical properties of the so-called Heracles merger.” In APOGEE, Aurora has 0, 1, and 2; in GALAH it has 3, 4, 5, together with elevated Ba, Y, and Eu. That study proposes that the Heracles signature is “the fossil relic of the earliest, bursty phase of the Milky Way’s own disk growth (‘in situ’), rather than a disrupted satellite” (Myeong et al., 2022).
The later APOGEE–Gaia proto-Galaxy modeling of Horta & Schiavon again treats Heracles as one of at least two significant proto-Galactic fragments, alongside the main in situ progenitor. In that interpretation, Heracles is “comparably massive” to the main progenitor, formed more slowly, and contributes significantly to the metal-poor bulge/inner halo (Horta et al., 2024).
Taken together, the literature does not offer a single settled interpretation. The stable points of agreement are that Heracles is chemically old, metal poor, centrally concentrated, and associated with the ancient inner Galaxy; the disputed point is whether those properties are best attributed to an accreted building block, a separate proto-Galactic fragment, or the earliest in situ Milky Way starburst.
5. Heracles as a hybrid SSM–Transformer model for image and time-series analysis
In machine learning, Heracles is a model architecture designed to address limitations attributed both to vision transformers and to earlier vision-oriented state space models. The architecture is defined as a three-component block: a global SSM based on a real-valued Hartley kernel, a localized convolutional SSM for fine spatial detail, and an attention-based token interaction module in deeper layers. Starting from the continuous-time state-space model
6
the model uses zero-order-hold discretization,
7
and the convolutional kernel view
8
Its global operator replaces a complex FFT by the real Hartley transform 9, defining
0
where 1 is a learned Hartley-domain filter. The local stream is a discrete convolution
2
and deeper layers append multi-head self-attention with
3
The layer flow is: input tokens 4 of shape 5; split into global and local streams; sum streams, apply LayerNorm and a two-layer MLP; use only SSM+MLP in the first 6 blocks and append multi-head attention in the later 7 stages (Patro et al., 2024).
For ImageNet-1K, the training recipe is AdamW with 8, 9, 0, a 10-epoch linear warm-up plus 310-epoch cosine decay, batch size 128 on 1V100 GPUs, 2 input resolution, and RandAug, CutMix, MixToken, and Token Labeling (Patro et al., 2024).
| Variant | Params / FLOPs | ImageNet top-1 |
|---|---|---|
| Heracles-C-Small | 21.7 M / 4.1 G | 84.5% |
| Heracles-C-Base | 32.5 M / 6.5 G | 85.2% |
| Heracles-C-Large | 54.1 M / 13.4 G | 85.9% |
| Heracles-C-Huge | 156.7 M / 39.3 G | 86.4% |
The reported ImageNet comparisons state that Heracles-C-Small at 3 G achieves 4 versus BiFormer-S 5 and iFormer-S 6; Heracles-C-Base at 7 G achieves 8 versus Wave-ViT-B 9 and MaxViT-S 0; Heracles-C-Large at 1 G achieves 2 versus VOLO-D3 3 and Wave-ViT-L 4; and Heracles-C-Huge at 5 G achieves 6 versus LiT-22B 7. The paper states that Heracles-C-small achieves state-of-the-art performance on ImageNet with 8 top-1 accuracy, and that Heracles-C-Large and Heracles-C-Huge further improve accuracy to 9 and 00, respectively (Patro et al., 2024).
The same work reports transfer-learning results on CIFAR-10, CIFAR-100, Flowers-102, and Cars-196: 01, 02, 03, and 04, respectively, comparing favorably to DeiT-B. In MS-COCO instance segmentation with Mask R-CNN 05 schedule on val2017, Heracles-C-S reaches 06, 07, 08, 09, 10, and 11. In time-series forecasting on ETTm1/2, ETTh1/2, Electricity, and Weather, using MSE and MAE at horizons 12, it achieves best or second-best on almost all tables; examples given are ETTm1 at 13, MSE 14 versus best 15, and Electricity at 16, MSE 17 versus best 18 (Patro et al., 2024).
Ablation results isolate the architectural contribution of the parallel design. Global SSM only gives 19, local SSM only gives 20, a series Hartley21Conv arrangement gives 22, and the parallel Hartley23Conv arrangement gives 24, the best result in Table A1. The paper attributes this to joint global/local streams injecting both translation equivariance and long-range inductive biases absent in pure attention. It also reports that early spectral blocks reduce token dimension before quadratic attention, and gives an A100 latency of 25 ms for Heracles-C-S versus 26 ms for GFNet-H-S at 27 (Patro et al., 2024).
6. Heracles as state-conditioned diffusion middleware for humanoid control
In humanoid robotics, Heracles is a hierarchical controller built from three modules: high-level reference motions, a state-conditioned diffusion middleware, and a low-level physics tracker. The reference signal is a time-indexed trajectory 28. The middleware is a lower-frequency 29 Hz planner 30 that observes the robot’s physical state 31 and the commanded reference 32, and synthesizes a short-horizon keyframe trajectory 33. The low-level policy 34 runs at 35 Hz on a densified version 36 of 37 and the proprioceptive state, issuing joint-position commands executed via PD control at 38 Hz. The receding-horizon loop is: observe 39; generate 40; densify 41; execute 42 for the next 43 steps (Tao et al., 29 Mar 2026).
The middleware uses a continuous flow-matching diffusion model in residual space. With static baseline
44
the residual is
45
If 46, then 47, preserving identity-like behavior. Flow matching is defined with 48 as normalized ground-truth residual, 49, interpolation path
50
conditioning vector
51
and velocity-matching loss
52
Inference begins from
53
with directional warm-start residual
54
and integrates
55
using a small number of Euler steps, for example 5 steps from 56 (Tao et al., 29 Mar 2026).
The small-deviation regime is treated explicitly as an identity-map regime. Because the model is parameterized around the current state, and because the first token is “pinned” via inpainting,
57
the learned field satisfies 58 for 59, causing
60
For large deviations, the same system transitions into generative synthesis: as 61 grows, the residual departs from zero, the directional warm start seeds a coarse straight-line plan, and the learned field edits it into a human-like recovery in very few steps, akin to SD-Edit. Because the pipeline runs in closed loop at 62 Hz, it can continuously replan and blend back toward the original reference once stability is regained (Tao et al., 29 Mar 2026).
Quantitatively, on 101 unseen motion sequences spanning locomotion, dance, martial arts, daily activities, acrobatics, and discontinuous clips, the reported Completion Rate is 63 for Heracles versus 64 for the best non-generative tracker and 65 for an MLP baseline; root orientation error is 66 rad, a 67 change versus tracker alone, and root height error is 68 m, a 69 change. On the fall-and-recovery subset, Completion Rate is 70 versus 71 for the MLP and 72 for VQ-VAE; joint-position error is 73 rad versus 74 rad for the MLP, and orientation error is 75 rad versus 76 rad. With a fixed iFSQ tracker, removing directional warm start reduces Completion Rate by 77, removing noisy-state augmentation reduces it by 78, and removing kinematics-aware loss weights reduces it by 79. Qualitatively, under severe pushes and out-of-distribution martial-arts sequences, Heracles is reported to remain anthropomorphic, exhibiting compensatory stepping, arm countermotions, and torso realignment, while pure trackers collapse or execute jerky corrections; on Unitree G1, it executes omnidirectional lie-to-stand recoveries from supine, lateral, and prone configurations without task-specific engineering (Tao et al., 29 Mar 2026).