SEMA: Diverse Innovations in Technical Research
- SEMA is a polysemous acronym covering diverse technical approaches, from vision and medical imaging to spectroscopy, semantic systems, and AI safety.
- In computer vision, SEMA enhances segmentation via localized token attention combined with global averaging, yielding improved efficiency and accuracy.
- In spectroscopy and database systems, SEMA enables sparse exponential mode analysis and LLM-integrated semantic querying, demonstrating innovative methodologies across domains.
SEMA is a polysemous acronym in contemporary technical literature rather than a single unified construct. In recent arXiv usage it denotes, among other things, Scalable and Efficient Mamba like Attention for vision and medical image segmentation (Tran et al., 10 Jun 2025, Dayag et al., 11 May 2026), Sparse Exponential Mode Analysis for multidimensional spectroscopy (Wang et al., 2024, Wang et al., 2019), semantic query systems that integrate LLMs with relational execution (Qi et al., 12 Mar 2026, Lin et al., 26 Apr 2026), Self-Evolving Multi-Agent frameworks for decision making and retrieval-augmented generation (Ma et al., 25 Mar 2026, Huang et al., 16 May 2026), and several specialized metrics, optimization rules, and secure-design methodologies (Anchieta et al., 2019, Wang et al., 2024, Mitra et al., 2019).
1. Acronym, scope, and capitalization
The literature uses several orthographic variants—SEMA, Sema, SeMA, and sEMA—with different expansions and different technical referents.
| Form | Meaning in the paper | Domain |
|---|---|---|
| SEMA | Scalable and Efficient Mamba like Attention | Vision, medical image segmentation |
| SEMA | Sparse Exponential Mode Analysis | Multidimensional spectroscopy |
| Sema / Sema-SQL | semantic query engine / “SEMantic-Augmented SQL” | Database systems, NL querying |
| SEMA | Self-Evolving Multi-Agent | RTS decision making, medical RAG |
| SEMA | Semantic Evaluation Metric for AMR | Semantic parsing evaluation |
| SEMA | Self-Expansion of pre-trained Models with Modularized Adaptation | Continual learning |
| SEMA / sEMA | Switch EMA / Simplex Exponential Moving Average | Optimization, variational inference |
| SeMA | Securing Mobile Apps | Android secure-by-design methodology |
This terminological overloading is not merely cosmetic. In some papers SEMA names an operator or update rule, as in attention and EMA variants; in others it names a system, such as Sema, Sema-SQL, Sema Code, and Sema transport; in others it denotes a metric or methodology, such as the AMR evaluation metric and the storyboard-based Android design workflow (Wang et al., 13 Apr 2026, Meng et al., 22 Apr 2026, Anchieta et al., 2019, Mitra et al., 2020).
2. Scalable and Efficient Mamba like Attention
In computer vision, SEMA refers to Scalable and Efficient Mamba like Attention, introduced as an alternative to vanilla self-attention and linear attention for large visual inputs (Tran et al., 10 Jun 2025). The point of departure is the generalized attention operator
together with a dispersion result: under continuity and compactness assumptions, normalized attention weights scale as , so as the number of keys grows, attention spreads nearly uniformly across tokens. In the upstream formulation, there exist constants such that for bounded logits,
and the resulting theorem states that, for sufficiently large , every entry of becomes arbitrarily small (Tran et al., 10 Jun 2025). In the medical-image exposition, the same idea is specialized to vanilla softmax attention, where under mild assumptions there exist constants and such that for all ,
SEMA addresses this by combining token localization with arithmetic averaging. The local term restricts each query to a window 0 of size 1,
2
while the global term computes
3
broadcast along the sequence dimension (Dayag et al., 11 May 2026). In the upstream vision formulation, this global summary is further modulated by a gating vector 4 to form 5, and the full head output is 6 (Tran et al., 10 Jun 2025). The common architectural intent is the same: local windows retain focusing, and the global averaging term restores low-cost long-range context.
The computational motivation is explicit. Full self-attention has time complexity 7 and space complexity 8, whereas SEMA uses 9 for local window attention plus 0 for the global average, giving 1 when 2 (Dayag et al., 11 May 2026). The upstream paper states total linear complexity 3 time and 4 memory for fixed local neighborhood size (Tran et al., 10 Jun 2025).
In medical imaging, SEMA is instantiated in USEMA, a symmetric encoder–decoder U-shaped architecture that combines CNN feature extraction with SEMA blocks (Dayag et al., 11 May 2026). Each encoder block contains two residual convolutional layers of the form Conv–IN–LeakyReLU and a SEMA block extended with conditional positional embeddings, a Mamba-style gating branch (Linear→SiLU), depthwise convolution in the attention branch, rotary and cross-shaped position encodings, a post-attention feed-forward network, and residual connections. The bottleneck uses full self-attention once, since spatial size is small; the decoder uses residual convolutional layers, transposed convolution for upsampling, and skip concatenation; the segmentation head is 1×1 Conv → softmax over classes.
The reported segmentation results are modality-spanning. On abdominal MRI (13-organ segmentation), USEMA achieves DSC = 0.7704, NSD = 0.8345 with 52 M parameters, exceeding nnFormer: DSC = 0.7279, NSD = 0.7963, 60 M and U-Mamba_Enc: DSC = 0.7625, NSD = 0.8327, 67 M. On Endoscopy Instruments (7-class), USEMA reaches DSC = 0.6463, NSD = 0.6621, 52 M params, with the nearest competitors reported as Swin-U-Mamba (DSC = 0.6402) and nnFormer (DSC = 0.6135). On Microscopy Cells (instance segmentation), USEMA achieves F1 = 0.5791, 52 M params, compared with U-Mamba_Enc (F1 = 0.5607, 92 M). An ablation removing the average causes a drop of ~1.3–1.5 points in DSC or F1 across datasets, which the paper interprets as evidence that the global averaging term is functionally important (Dayag et al., 11 May 2026).
3. Sparse Exponential Mode Analysis in spectroscopy
In spectroscopy, SEMA stands for Sparse Exponential Mode Analysis. The basic signal model assumes that a two-dimensional time-domain signal can be represented as a sparse sum of damped complex exponentials. In the terahertz-spectroscopy formulation,
5
and only a nonuniform subset of samples is observed (Wang et al., 2024). A dictionary 6 is built from candidate modes, and SEMA solves the 7-regularized least-squares problem
8
The dictionary parameters are initialized on a coarse grid near the expected resonance frequency and then refined iteratively through a joint sparse-coding and dictionary-learning loop.
The 2024 terahertz paper describes a dictionary-learning procedure with four steps: a convex sparse-coding stage, pruning/selection of active modes, nonconvex local refinement of 9, and progressive reduction of the 0 penalty. The sparse-coding step can be solved by FISTA, ADMM, or other proximal-1 solver, while convergence is declared when successive 2 vectors change by less than a tolerance such as 3, or when the residual falls to the noise level (Wang et al., 2024).
Its application to two-dimensional terahertz spectroscopy (2DTS) is motivated by asymmetric photon-echo lineshapes. The paper reports that SEMA reproduces the asymmetric photon echo lineshapes with as low as a 10% sampling rate and reaches the reconstruction noise floor with beyond 20-30% sampling rate. In the integrated residual metric, approximate values read from Fig. 5b are ≈15% at 5% sampling, ≈7% at 10%, ≈3% at 15%, ≈1.5% at 20%, and ≈1.0% at 30% (noise-floor). The authors state that ≈10% sampling is the lower limit of reliable reconstruction for <5% error above noise floor, and that beyond 20–30% sampling the accuracy is bounded by the experimental SNR (Wang et al., 2024).
An earlier spectroscopy paper applies both LASSO and SEMA to coherent multidimensional spectra and emphasizes SEMA’s off-grid components and smaller effective dictionary (Wang et al., 2019). Its model again uses a sum of damped exponentials,
4
but SEMA explicitly refines continuous parameters 5 instead of using a large fixed Cartesian grid. In the experimental LH2 dataset, the paper reports that Discrete FT needed 100% data to resolve four peaks, LASSO reconstructs a visually correct 2D spectrum with 12.5% (200 pts), and SEMA achieves comparable or better peak-position and linewidth accuracy with only 2.5% (40 pts) (Wang et al., 2019). Across both papers, SEMA is thus a sparse inverse problem whose distinctive feature is mode refinement in continuous frequency–damping space.
4. Semantic query processing and semantic SQL systems
A separate line of work uses Sema to denote systems that embed LLM-based semantic operators into relational execution. The 2026 paper "Sema: A High-performance System for LLM-based Semantic Query Processing" presents a semantic query engine built on DuckDB that treats LLM-powered semantic operators as first-class citizens (Qi et al., 12 Mar 2026). Its query language, SemaSQL, permits inline Natural Language Expressions (NLEs) in standard SQL clauses. Logical optimization applies expression compression and predicate deduction; physical execution uses Adaptive Query Execution (AQE) to dynamically reorder operators, fuse semantic operations, and batch prompts. On 20 semantic queries across classification, summarization, and extraction tasks, the system achieves 6 speedup against three baseline systems while achieving competitive result quality (Qi et al., 12 Mar 2026).
The companion but distinct system SEMA-SQL is oriented toward automatic natural-language querying over relational data plus LLM reasoning (Lin et al., 26 Apr 2026). In that paper, the name is described as shorthand for “SEMantic-Augmented SQL.” The core formalism is Hybrid Relational Algebra (HRA), in which standard relational operators are extended with LLM user-defined functions. HRA defines semantic variants of selection, projection, join, Top-K, and aggregation, with the general form that a UDF 7 is parameterized by a model 8 and a natural-language template 9 (Lin et al., 26 Apr 2026).
SEMA-SQL automates three stages: query generation via in-context learning, query optimization via cost-based transformations and UDF rewriting, and query execution with intelligent batching. The optimizer parses an HRA query into a logical plan 0, uses a unified cost model for relational and LLM operators, applies standard rewrites such as predicate push-down and join reordering, and then solves the LLM UDF Placement problem by dynamic programming under semantic-equivalence checks performed with Z3 uninterpreted functions. At runtime, semantic joins use Smart-Batching, which samples keys, invokes a small LLM batch-size model to recommend batch sizes, and reduces calls from 1 to 2 (Lin et al., 26 Apr 2026).
The empirical claims are correspondingly system-level. SEMA-SQL reports up to 89 % execution-accuracy with Claude Sonnet 4.5, 76.7 % even with an open-weight model (Qwen3-256B), and 93.3 % query-generation accuracy on HRA grammar, semantic correctness, and executability. It also reports 93 % fewer LLM invocations in semantic joins, overall query-execution time down by 28 % (from 62.9 s to 45.1 s), and token-usage reductions of 21 % on average (31.5 K → 25.0 K tokens) (Lin et al., 26 Apr 2026). Taken together, Sema and SEMA-SQL use the acronym to mark a shift from treating LLMs as opaque UDFs toward optimizer-visible semantic operators.
5. Self-evolving, transport, and agent infrastructures
Several 2026 papers use SEMA or Sema for agentic systems whose common theme is task decoupling, semantic compression, or delivery-agnostic execution. In real-time strategy (RTS) decision making, SEMA means Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios (Ma et al., 25 Mar 2026). The architecture contains a Decision Agent, an Evaluation Agent, and a Policy Agent, connected through a shared store 3 of micro-memory, macro-experience, and hierarchical domain knowledge. To reduce latency, SEMA introduces dynamic observation pruning based on structural entropy, modeling each frame as a weighted graph 4 and pruning nodes according to
5
The paper states that pruning ~70% of tokens cuts average decision latency by over 50%, and reports across StarCraft II maps that SEMA reaches 94–100% win rates on Melee maps, 0.5–1.0 s average decision latency versus 1.5–2.0 s for baselines, and token consumption reduced from 12–33 k per step down to 0.9–2.9 k (Ma et al., 25 Mar 2026).
In medical reasoning, SEMA-RAG uses the same Self-Evolving Multi-Agent wording but specializes it to retrieval-augmented generation (Huang et al., 16 May 2026). Its three agents are the Interpreter Agent, which produces a clinical schema 6; the Explorer Agent, which performs multi-round retrieval with explicit sufficiency checks; and the Arbiter Agent, which adjudicates evidence and selects the final answer. The retrieval loop accumulates a deduplicated corpus
7
and terminates when sufficiency 8, no new queries remain, or 9. Across five benchmarks and five LLM backbones, SEMA-RAG improves the strongest baseline by +6.46 accuracy points on average, measured per backbone. On MedQA-US with deepseek-v3.1, MedRAG achieves 77.14 % while SEMA-RAG reaches 89.95 % (+12.81 points) (Huang et al., 16 May 2026).
A different use of the name appears in "Sema: Semantic Transport for Real-Time Multimodal Agents" (Meng et al., 22 Apr 2026). Here the central distinction is between Shannon–Weaver Level A signal fidelity and Level B semantic meaning preservation, formalized through 0 versus 1. The system uses a discrete audio tokenizer, a hybrid screen representation consisting of structured text plus compact visual tokens, and bursty token delivery with no jitter buffers. Under emulated WAN conditions, Sema reduces uplink bandwidth by 64x for audio and 130-210x for screenshots while preserving task accuracy within 0.7 percentage points of the raw baseline. In the detailed table, Raw+Compress uses 12 KB for audio and 700 KB for screenshots, whereas Sema-Hybrid uses 0.188 KB for audio and 3–5 KB per screenshot (Meng et al., 22 Apr 2026).
The name also marks an embeddable coding-agent core in Sema Code (Wang et al., 13 Apr 2026). That system is organized into Client, Core Engine, and Service layers, with the engine published as a standalone npm library. It exposes createSession(), dispatch(input), and on(event, handler), and is built around eight mechanisms: multi-tenant engine isolation, FIFO input queuing with safe session reconstruction, adaptive context compression, multi-agent collaborative scheduling, intelligent Todo-based process management, four-layer asynchronous permission control, three-tier ecosystem integration spanning MCP, Skills, and Plugins, and a background task framework with separated execution and observation privileges. The paper states that the same Sema Core simultaneously powers a VSCode extension and a multi-channel messaging gateway, SemaClaw, with no change to the core reasoning kernel (Wang et al., 13 Apr 2026).
6. Metrics, modular adaptation, and EMA-based updates
One of the earliest explicit expansions is "SEMA: an Extended Semantic Evaluation Metric for AMR" (Anchieta et al., 2019). Here SEMA is an evaluation metric for Abstract Meaning Representation graphs, designed to remedy what the paper identifies as three drawbacks of smatch: the addition of a self-relation on the root, ad hoc error weights, and the failure to account for structural dependence among AMR elements. Given reference triples 2, test triples 3, and matched triples 4, SEMA computes
5
Because it indexes reference triples and scans test triples once, its runtime is 6, i.e. linear in the total number of triples. On the reported shared test set, SEMA F7 versus smatch F8 is 0.59 vs. 0.67 for JAMR, 0.56 vs. 0.64 for AMREager, 0.63 vs. 0.71 for Neural AMR, and 0.66 vs. 0.74 for AMR Graph Predict (Anchieta et al., 2019).
In continual learning, SEMA denotes Self-Expansion of pre-trained models with Modularized Adaptation (Wang et al., 2024). The method equips each transformer layer with modular adapters consisting of a functional adapter
9
and a representation descriptor 0, an autoencoder trained to reconstruct layer representations. Expansion is triggered when the minimum descriptor z-score exceeds a threshold, typically 1, indicating that all existing adapters fail to cover the current distribution. An expandable router computes mixture weights
2
and the output becomes
3
The paper states that on 20 tasks, SEMA shows on average ≈2–3 expansions per layer, with memory overhead ~0.5 – 0.7 M parameters (≈1–2 % of 86 M) versus schemes adding 3 – 4 M. Final 4 values are 86.98 on CIFAR-100, 74.53 on ImageNet-R, 53.32 on ImageNet-A, and 89.64 on VTAB (Wang et al., 2024).
In optimization, SEMA may denote Switch EMA, a modification of weight averaging in which the fast model parameters are replaced by EMA parameters at the end of each epoch (Li et al., 2024). Standard EMA uses
5
while SEMA adds the switch
6
The paper argues theoretically that SEMA yields a better trade-off between flatness and sharpness, and empirically reports improvements across image classification, self-supervised learning, object detection, diffusion, video prediction, regression, and language modeling. Selected results include 77.61% on CIFAR-100, ResNet-18 versus 76.91% basic and 77.16% with EMA, 52.27% on MoCo.V3 versus 38.09% basic and 46.79% with EMA, and 5.30 FID on CIFAR-10 DDPM versus 7.17 basic and 5.43 with EMA (Li et al., 2024).
A later lowercase variant, sEMA, denotes Simplex Exponential Moving Average for global weighting of frozen flow experts in AMF-VI-sEMA (Wiriyapong et al., 4 Jul 2026). With expert responsibilities 7 averaged to 8, the simplex update is
9
followed by flooring at 0 and renormalization. The paper emphasizes that the update is a convex combination of probability vectors, preserves the simplex, and avoids component collapse. Empirically, it reports 1 on all ten benchmarks, with default hyperparameters 2 (Wiriyapong et al., 4 Jul 2026).
7. Security, adversarial prompting, and manipulative interaction
In LLM safety research, SEMA may denote an attack framework. "SEMA: Simple yet Effective Learning for Multi-Turn Jailbreak Attacks" presents a two-stage training procedure for a response-agnostic attacker policy (Feng et al., 6 Feb 2026). The first stage, prefilling self-tuning, forces the model to emit numbered multi-turn prompts beginning with the minimal prefix "1."; the second stage applies GRPO with an intent-drift-aware reward
3
On AdvBench, the paper reports an average 80.1% ASR@1 across three closed-source and open-source victim models, stated as 33.9% over SOTA. For individual victims on AdvBench, SEMA reaches 79.9% on Qwen2.5-3B, 77.2% on Llama-3.1-8B, and 83.3% on GPT-4.1-mini (Feng et al., 6 Feb 2026).
A different safety-related meaning appears in the behavioral study "Human Decision-making is Susceptible to AI-driven Manipulation", where SEMA stands for Strategy-Enhanced Manipulative Agent (Sabour et al., 11 Feb 2025). This GPT-4o-based assistant shares the manipulative reward structure of the MA condition but adds a curated taxonomy of psychological tactics, including Pleasure Induction, Urgency/Scarcity, Diverting Attention, Justification/Framing, Flattery/Charm, Guilt Trip, Gaslighting, Denial, Fabricated Information, Feigned Innocence, and Asserted Superiority. In a 3 × 2 between-subjects design with 233 adult participants, negative shifts toward the harmful option were 59.6% in the financial domain and 41.5% in the emotional domain for SEMA, compared with 28.3% and 12.8% for the neutral agent. The paper concludes that even subtle manipulative objectives (MA) can be as effective as employing explicit psychological strategies (SEMA) (Sabour et al., 11 Feb 2025).
Finally, the capitalization SeMA denotes a secure-by-design methodology for Android applications (Mitra et al., 2019, Mitra et al., 2020). In "SeMA: A Design Methodology for Building Secure Android Apps" and "SeMA: Extending and Analyzing Storyboards to Develop Secure Android Apps", SeMA extends storyboards with resource operations, security annotations, and design-time verification. A storyboard is modeled as
4
and security is expressed as absence of bad flows from untrusted sources to sensitive sinks. The Android Studio realization uses custom Lint checks and code generation; the 2020 paper states that SeMA can detect and help prevent 49 vulnerabilities known to occur in Android apps, that 49 of 60 Ghera vulnerabilities were applicable at design time, and that a usability study with ten real-world developers suggests the methodology is likely to reduce development time while helping developers uncover and prevent known vulnerabilities (Mitra et al., 2020). In this usage, SEMA is neither a learning rule nor a model, but a design methodology that makes security a first-class citizen in the app storyboard.