ShaLa: Multi-Domain Methods in ML and Astronomy
- ShaLa is a polysemous term defining distinct research objects, including ambiguity-aware LLM alignment, shared latent space generative modeling, and adaptive optics systems.
- In machine learning, ShaLa frameworks leverage reinforcement learning and diffusion priors to preserve annotator distributions and improve multimodal synthesis quality.
- In astronomy, ShaLa refers variably to the misnamed SHELA survey for galaxy evolution and a sodium laser guide star adaptive-optics system for diffraction-limited imaging.
ShaLa is a polysemous label used for several unrelated research objects across machine learning and astronomy. In the literature considered here, it denotes a reinforcement-learning framework for aligning LLMs to annotator label distributions, a generative framework for multimodal shared latent space modelling, an occasional misspelling of the Spitzer/HETDEX Exploratory Large-Area survey SHELA, and, in observatory instrumentation usage, the sodium laser guide star adaptive-optics system associated with ShaneAO at the Lick Observatory Shane 3-m telescope (Wu et al., 3 Jun 2026, Cui et al., 24 Aug 2025, Wold et al., 2018, Gavel et al., 2014).
1. Nomenclature and scope
The term has no single canonical meaning across fields. In recent machine-learning work, “SHALA-LLM” expands to “Smartly Handling Ambiguous Labels in Aligning LLMs,” while “ShaLa” in multimodal generative modelling abbreviates “Shared Latent Space Modelling.” In observational astronomy, “ShaLa” appears as an occasional misspelling of SHELA, the Spitzer/HETDEX Exploratory Large-Area survey; in adaptive optics, “ShaLa/ShaneAO” designates the sodium laser guide star system used with ShARCS on the Shane telescope (Wu et al., 3 Jun 2026, Cui et al., 24 Aug 2025, Wold et al., 2018, Gavel et al., 2014).
| Usage | Domain | Referent |
|---|---|---|
| SHALA-LLM | LLM alignment | RL framework for learning annotator label distributions |
| ShaLa | Multimodal generative modelling | Shared latent-space VAE plus diffusion prior |
| ShaLa / SHELA | Extragalactic survey astronomy | Occasional misspelling of the SHELA survey |
| ShaLa / ShaneAO | Adaptive optics instrumentation | Sodium laser guide star AO facility at Lick |
This disambiguation matters because the four usages are methodologically independent. Two are modern ML frameworks, one is a survey label in wide-field astronomy, and one is an AO instrumentation name. The cited works do not indicate a shared lineage beyond the reused string “ShaLa.”
2. ShaLa as ambiguity-aware LLM alignment
SHALA-LLM is a reinforcement learning–based alignment framework for subjective or ambiguity-sensitive tasks such as natural language inference and emotion recognition. Its core premise is that annotator disagreement should be treated as information rather than noise: instead of collapsing annotations to a single majority label, the model is trained to predict the full empirical annotator distribution and to emphasize highly ambiguous samples during optimization (Wu et al., 3 Jun 2026).
The formal target is the empirical annotator distribution for sample with annotators and classes,
with the model producing a parsed probability vector from a JSON-like textual output. Ambiguity is quantified by normalized entropy,
and distributional agreement is measured with the Jensen–Shannon Distance. The rollout reward is
This reward design couples soft-label alignment to ambiguity-aware prioritization: high-entropy items receive larger effective rewards when the predicted distribution matches human disagreement well.
Optimization uses Group Relative Policy Optimization. The paper defines group-normalized advantages
and a PPO-style clipped surrogate with importance ratio . In the reported experiments, the base model is Qwen2.5-Omni-7B; GRPO is implemented via TRL with AdamW, learning rate , rollouts per sample 0, temperature 1, maximum completion length 2 tokens, and KL penalty 3. Training is run on a single node with 4NVIDIA H200 GPUs under DeepSpeed ZeRO-3 and effective batch size 5.
The empirical results emphasize both distributional fidelity and conventional classification metrics. On ChaosNLI overall, JSD decreases from 6 under majority-label supervision to 7 under ShaLa, a 8 reduction; BC increases from 9 to 0; ACC rises from 1 to 2; F1 rises from 3 to 4; and W-F1 rises from 5 to 6. On MSP-Podcast, JSD improves from 7 to 8, BC from 9 to 0, ACC from 1 to 2, F1 from 3 to 4, and W-F1 from 5 to 6. On GoEmotions, JSD improves from 7 to 8 and BC from 9 to 0; the reported ShaLa label metrics are ACC 1, F1 2, and W-F1 3.
A notable ablation removes ambiguity scaling by setting 4 (“w/o Ambi-En”). That variant still benefits from JSD-based distributional alignment, but the full entropy-weighted method further improves JSD, BC, ACC, and F1 by focusing optimization on high-disagreement samples. The paper also reports smaller degradation across ambiguity strata than zero-shot or majority-label baselines; for NLI, ShaLa shows no statistically significant degradation across ambiguity levels (5), whereas majority-label supervision exhibits marked declines, including a BC drop from 6 to 7 across levels.
The stated limitations are equally specific. Evaluations are confined to categorical tasks with structured label spaces; empirical annotator distributions can preserve societal and demographic biases; GRPO-based RL is compute-intensive; robustness beyond NLI and emotion recognition remains to be established; and the method does not disentangle the reasons underlying disagreement, such as expertise or contextual variation.
3. ShaLa as multimodal shared latent space modelling
In multimodal generative modelling, ShaLa denotes a two-stage framework for learning a shared latent representation across modalities while improving synthesis quality through a latent diffusion prior. The model is explicitly motivated by limitations of prior multimodal VAEs: rigid Product-of-Experts or Mixture-of-Experts aggregation, poor expressiveness of joint posteriors, the prior-hole mismatch between the aggregated posterior and a fixed Gaussian prior, and poor scaling as the number of modalities grows (Cui et al., 24 Aug 2025).
The generative model is
8
with shared latent 9 and typically 0. Each modality has a deterministic encoder 1 and a decoder 2. Rather than combining stochastic unimodal posteriors through PoE or MoE, ShaLa uses deterministic architectural fusion:
3
where 4 is implemented as concatenation followed by a small MLP. The joint variational posterior is then
5
This places the semantic alignment burden on the fused deterministic bottleneck 6.
Stage 1 optimizes the multimodal ELBO
7
Stage 2 replaces the Gaussian prior with an expressive latent DDPM fit to samples from the aggregated posterior 8. Using the standard forward process
9
the diffusion prior is trained with
0
where the conditioning variable 1 can be a fused representation 2, a single-modality embedding 3, a subset embedding 4, or be dropped for unconditional learning. This second stage addresses the prior-hole problem and supports cross-modal inference from incomplete modality sets.
The reported benchmarks are PolyMNIST, MNIST-SVHN-Text, CUB, and ShapeNet Cars. On PolyMNIST, unconditional coherence is 5 for ShaLa versus 6 for CMVAE, 7 for MVEBM, 8 for MMVAE+, 9 for MMVAE, and 0 for MoPoE. Conditional PolyMNIST coherence is 1, tying CMVAE. On MST, unconditional coherence is 2 versus 3 for MoPoE, and conditional coherence is 4 versus 5 for mmJSD and 6 for MoPoE. For image quality, PolyMNIST unconditional FID is 7, better than CMVAE at 8 and MVAE at 9; PolyMNIST conditional FID is 0, better than CMVAE at 1; and CUB conditional FID is 2, versus 3 for CMVAE, 4 for MVEBM, and 5 for MMVAE+.
The scalability claim is most explicit on ShapeNet Cars, where 16 views are treated as modalities. ShaLa reports PSNR 6 and SSIM 7, compared with 8 for MMVAE+ and 9 for CMVAE. Against task-specific baselines, it is reported as competitive with PixelNeRF (0), EG3D (1), RenderDiffusion (2), and SyncDreamer (3). The ablations are equally diagnostic: conditioning the diffusion prior on fused 4 yields PolyMNIST unconditional/conditional coherence of 5, versus 6 without 7; a larger diffusion model improves PolyMNIST unconditional FID from 8 to 9; and concatenation plus MLP outperforms summation and gated fusion on conditional coherence.
The paper’s practical position is that ShaLa differs from MVAE, MMVAE, MoPoE, mmJSD, MVTCAE, MMVAE+, MVEBM, and CMVAE by jointly modifying posterior construction and prior modelling. Its contribution is therefore not merely a stronger decoder or a larger latent, but a specific decomposition: deterministic multimodal fusion for the approximate posterior, followed by a conditional latent diffusion model that matches the aggregated posterior and can condition on available modalities.
4. “ShaLa” as an occasional misspelling of SHELA
In survey astronomy, “ShaLa” is not a distinct program in the cited literature but an occasional misspelling of SHELA, the Spitzer/HETDEX Exploratory Large-Area survey. SHELA is a deep, wide-field multiwavelength program in SDSS Stripe 82 designed to study galaxy evolution over 00–01m. The field covers approximately 02 deg03, lies within the HETDEX footprint, and combines DECam 04 imaging with Spitzer/IRAC 05 and 06m data; the IRAC component was first released as a post-cryogenic Spitzer survey, and a later catalog paper presented the DECam plus forced-photometry IRAC catalogs (Wold et al., 2018, Papovich et al., 2016, Layana-Astudillo et al., 23 Jun 2026).
The 2018 catalog paper presents 07-selected DECam 08 catalogs over 09 deg10 of the overall field, using a single inverse-variance-weighted 11 detection image for SExtractor double-image photometry. The exclusion of 12 and 13 from the detection image is motivated by not penalizing high-14 dropouts in source finding. Images within each tile are PSF-matched to the worst-seeing band so that a single fixed aperture encloses the same fraction of a point source’s flux across 15. The catalogs reach 16 depths of approximately 17 AB mag for point sources in apertures enclosing about 18 of the total flux, with 19 completeness at 20 and 21 completeness at 22 for 23-selected point sources. Fluxes are placed on a uniform AB system in nJy with zero-point 24, corresponding to
25
Astrometric recalibration to SDSS applies typical offsets of about 26 mas with 27 scatter about 28 mas. Photometric zero points are derived per tile and band through both an F0-star method and linear color relations to SDSS colors; for 29, the difference 30 is reported as 31 mag, while comparisons to DECaLS DR5 and DES DR1 show median zero-point offsets 32 mag. A 33 systematic flux error is added in quadrature to account for zeropoint uncertainties and differences between sky-aperture and simulation-based error estimates.
A central technical component is forced IRAC photometry with The Tractor. The motivation is the coarse IRAC PSF of approximately 34 and the resulting heavy blending, with at least 35 of DECam positions having a neighbor within 36. The Tractor uses DECam positions and morphology as priors, fits 37 IRAC cutouts with point-source, exponential, or de Vaucouleurs profiles convolved with the empirical PRF, and uses a two-pass optimization in which distant neighbors are first modeled or masked and then the target plus close neighbors are fitted simultaneously. The output includes IRAC fluxes, errors, model code (38 for PSF, 39 for exponential, 40 for de Vaucouleurs), reduced 41, log-likelihood, and flags. About 42 of sources are best fit with resolved profiles; among the resolved subset, about 43 prefer exponential and about 44 de Vaucouleurs. For isolated sources, comparison with the original IRAC catalog gives a median offset of about 45 mag for 46, whereas blended sources show larger offsets of about 47 mag, interpreted in the paper as improved deblending.
The survey’s science utility is illustrated through number counts and photometric redshifts. Photometric redshifts are computed with EAZY using 48IRAC fluxes, requiring at least five valid fluxes and applying a 49-band prior where available. Against SDSS spectroscopy, the spectroscopic sample has mean 50, median 51, 52, and a 53 outlier fraction of about 54. The paper also states that using all seven bands yields 55 for 56, with the 57 band improving 58 and IRAC, plus to a lesser extent 59, improving 60.
The earlier IRAC release characterizes the warm Spitzer component alone. It covers roughly 61 deg62 with three epochs separated by approximately 63–64 months, reaches 65 limiting sensitivities of 66Jy at both 67 and 68m for 69 circular apertures, and is 70 and 71 complete at weighted-sum detection-image magnitudes 72 and 73 AB, respectively. The synergy target is HETDEX, which within the overlap is expected to provide about 74 Ly75 emitters at 76 and an additional about 77 [O II] emitters at 78.
A further astronomy use of the SHELA field appears in the ODIN narrowband LAE survey. There, SHELA is one of seven ODIN regions and is observed with DECam narrowbands N419 and N501 and broadbands 79 and 80 over an effective area of about 81 deg82. The analysis focuses on the efficiency of a hybrid weighted double-broadband continuum estimator, using
83
and
84
with selection thresholds 85 mag and 86 mag together with 87 \AA. At typical SHELA depths of about 88 AB mag in N419/N501 and about 89 AB mag in 90 and 91, the paper finds that broadband data roughly one magnitude deeper than the narrowband recover nearly 92 of LAEs, whereas equal-depth broadband and narrowband data recover only about 93. DESI validation reports confirmation rates of about 94, 95, and 96 at 97, 98, and 99, respectively.
5. ShaLa/ShaneAO as a sodium laser guide star adaptive-optics system
In the instrumentation literature, ShaLa refers to the sodium laser guide star adaptive-optics facility at the Lick Observatory Shane 3-m telescope, comprising the ShaneAO adaptive-optics relay and the Shane Adaptive Red Camera and Spectrograph (ShARCS). The system operates behind the 00-m primary at Cassegrain focus and is designed for diffraction-limited IR science from approximately 01–02m, with the as-built configuration covering 03–04m and provision to extend shortward (Gavel et al., 2014).
The AO architecture is a sodium LGS system tuned to the Na D2 line at 05 nm, with both LGS and NGS modes. It uses a woofer–tweeter deformable-mirror configuration: an ALPAO 52-element high-stroke woofer with 06m stroke handling low-order modes including fast tip–tilt, and a Boston Micromachines KILO-DM tweeter with 07 actuators for high-order correction. The abstract characterizes the correction bandwidth as “full dynamic range correction from tip/tilt to 16 cycles across the pupil,” and the paper relates this to the MEMS actuator density and wavefront-sensor sampling. Spatial-frequency control is therefore partitioned between stroke-limited low-order correction on the woofer and higher-order, lower-amplitude correction on the tweeter.
Wavefront sensing is performed with a variable-sampling Shack–Hartmann WFS on a Lincoln Labs CCID66 detector with 08 pixels and 09–10 e11 read noise at up to 12 kHz. Two samplings are available: 8-across mode, corresponding to approximately 13 cm subapertures at the primary, and 15-across mode, conventionally referred to as “1614,” corresponding to approximately 15 cm subapertures. A separate Marconi CCD39 tip–tilt sensor provides 16 pixels, 17 e18 noise, up to 19 kHz operation, 20/pixel scale, and a 21 instantaneous field scanned over a 22 acquisition field. The centroiding law is explicitly given as
23
with a practical regularization choice 24.
The science instrument ShARCS has a pixel scale of 25/pixel over a 26 diameter AO-corrected field of view. It supports imaging on a Hawaii-2RG detector, spectroscopy at 27 with a 28 slit and a planned upgrade to 29, coronagraphy, and polarimetry. The paper gives diffraction-limited scales for the 30-m aperture using 31: about 32–33 in Y/J, about 34 in H, and about 35 in K.
Several engineering details are emphasized because they determine practical sensitivity. Enhanced broadband protected-silver coatings increase throughput in both science and WFS paths; a cold pupil stop and baffling reduce thermal background; a fixed 36 field stop and a blackened disk suppress Rayleigh backscatter to sky level; and the opto-mechanical bench is designed to be exceptionally stiff for multi-hour stability. The stated flexure goals are to hold imaging within the diffraction limit for at least 37 hour and spectroscopy within half the slit width (38) for at least 39 hours.
Commissioning results establish the instrument’s operating regime. First-light PSFs show clear Airy rings, and the paper reports an H-band Strehl of approximately 40 relative to the internal calibrator. Using the Maréchal approximation,
41
the paper interprets 42 at H as 43 nm RMS residual wavefront error. In LGS mode, the system closed the loop in 1644 mode at 45 Hz on two good-seeing nights and operated robustly in 846 mode under average to poor seeing. The authors state that routine 1647 operation is expected with the higher-return fiber laser. Sensitivity is reported as approximately 48 to 49, and the combination of high Strehl, lower background, and improved throughput corresponds to an approximately 50 improvement in exposure time to reach a given point-source SNR relative to the prior IRCAL-based system.
The paper positions ShaneAO as a pathfinder for next-generation AO through a specific set of design choices: woofer–tweeter control without a separate steering mirror, switchable WFS sampling, robust low-flux centroiding, throughput optimization through coatings, and flexure control sufficient for faint-object IR spectroscopy.
6. Conceptual distinctions and recurring themes
The most common misconception is that ShaLa names a single method or collaboration. In the cited literature, it does not. SHALA-LLM is an LLM-alignment framework built around annotator distributions and GRPO; multimodal ShaLa is a two-stage latent-variable generative model with a conditional diffusion prior; SHELA is a survey name in extragalactic astronomy, with “ShaLa” only an occasional misspelling; and ShaLa/ShaneAO is an adaptive-optics facility centered on a sodium laser guide star and ShARCS (Wu et al., 3 Jun 2026, Cui et al., 24 Aug 2025, Wold et al., 2018, Gavel et al., 2014).
The two ML usages do share a structural feature: both replace a simpler collapsed target with a richer distributional object. SHALA-LLM aligns to empirical annotator distributions rather than majority labels, while multimodal ShaLa replaces a fixed Gaussian latent prior with a learned diffusion prior fitted to the aggregated posterior. This suggests a common methodological intuition—retaining heterogeneity rather than suppressing it—but the papers present the systems independently and for different problem classes.
The astronomy usages differ again. SHELA is an observing program whose value derives from area, depth, multiwavelength coverage, catalog construction, forced photometry, and spectroscopic synergy with HETDEX. ShaneAO is an instrumentation platform whose value derives from wavefront correction, throughput, background control, and mechanical stability. Even where the same string appears, the objects of study are fundamentally different: galaxies and large-scale structure in one case, optical turbulence and diffraction-limited imaging in the other.
For technical reading, the disambiguating cues are straightforward. References to GRPO, JSD, ChaosNLI, GoEmotions, or Qwen2.5-Omni-7B identify SHALA-LLM. References to VAEs, diffusion priors, PolyMNIST, CUB, or ShapeNet identify multimodal ShaLa. References to Stripe 82, DECam, IRAC, HETDEX, or ODIN identify SHELA. References to sodium guide stars, ShARCS, woofer–tweeter DMs, Shack–Hartmann sensing, or Strehl identify ShaneAO. In practice, correct interpretation depends entirely on domain context rather than on the string “ShaLa” itself.