GateProbe: Probing Techniques in Diverse Domains
- GateProbe is a set of gate-mediated probing techniques that enable system perturbation analysis across diverse research settings.
- It is applied in vision-language-action models, scanning gate microscopy, and silicon device probing, each with distinct metrics and observable effects.
- GateProbe also informs residual-stream interventions, aiding layer selection and transformer interpretability through precise gradient-based sensitivity measures.
Searching arXiv for papers relevant to "GateProbe" and the cited works. Searching arXiv for "GateProbe" and related probing papers. GateProbe is used in several distinct research settings to denote a gate-mediated probe that perturbs or interrogates a system. In Vision-Language-Action model analysis, GateProbe is a one-shot, gradient-based sensitivity metric that inserts a virtual scalar gate on each residual branch and ranks transformer blocks by contribution to downstream action loss within the Drop-Then-Recovery protocol (Sun et al., 26 Jun 2026). In scanning gate microscopy, GateProbe is the use of a conductive, biased tip as a local electrostatic gate that perturbs electron transport in a buried two-dimensional electron gas and enables conductance imaging across strongly and weakly invasive regimes (Steinacher et al., 2017). In silicon electronic devices, GateProbe is a localized single-electron quantum dot induced directly inside the device by the biased tip of a low-temperature scanning tunneling microscope, simultaneously short-range tunnel-coupled to a source reservoir and energy-controlled by a distant gate reservoir (Ng et al., 2020). A related transformer-interpretability literature does not use the name GateProbe, but “Geometric Evolution Maps” provides methodology directly relevant to any gating-based probing approach that operates on concept probes in the residual stream, especially for layer selection, intervention placement, and direction specificity (Henry, 25 May 2026).
1. Terminological scope
The term spans at least three operationally different probe classes and one closely related methodology. What unifies them is the use of a gate or gate-like intervention to expose latent structure; what differs is the substrate, the observable, and the perturbative model.
| Usage | Gate or probe mechanism | Primary observable |
|---|---|---|
| VLA model analysis | Virtual scalar gate on a residual branch | Action-loss sensitivity and post-removal recoverability |
| Scanning gate microscopy | Conductive biased tip creating in a 2DEG | , , and |
| Silicon STM device probing | Tip-induced single-electron quantum dot inside the device | Resonant tunneling, lever arms, field mapping, defect sensing |
| Residual-stream concept intervention | Settled concept direction chosen after rotation ceases | Separation suppression under directional ablation |
The resulting literature should not be collapsed into a single definition. In the VLA setting, GateProbe is an activation-space importance metric for structured pruning and recoverability analysis. In mesoscopic transport, it is a local electrostatic perturbation whose weak-limit response can be tied to properties of the unperturbed system. In atomic-scale silicon devices, it is a movable, gate-controllable single-electron spectroscopic element embedded within the device. The residual-stream work suggests a further extension: gate-based interventions can depend critically on where a representation has geometrically settled, rather than merely where a scalar separation score peaks (Sun et al., 26 Jun 2026, Steinacher et al., 2017, Ng et al., 2020, Henry, 25 May 2026).
2. GateProbe as a virtual-gate sensitivity metric in VLA models
In "Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?" GateProbe is defined as a one-shot, gradient-based sensitivity metric that operates in activation space to quantify each transformer block’s contribution to the downstream action loss. Each droppable transformer block is written in residual form,
and GateProbe inserts a virtual scalar gate on the residual branch,
Setting is equivalent to dropping the block, whereas recovers the original model.
The importance score is the expected absolute sensitivity of the downstream task loss to that gate,
By the chain rule,
0
with 1. The appendix also writes the layerwise score as
2
The paper interprets this as a first-order Taylor approximation of the loss change when scaling a residual contribution to zero:
3
Larger 4 indicates a larger instantaneous loss increase under removal, so the block is deemed more important and is preferentially kept (Sun et al., 26 Jun 2026).
The implementation is explicitly hook-based rather than architectural. No actual parameters are added. Forward pre-hooks at each block’s input normalization layer cache 5 and 6, and 7 is marked with retain_grad(). One forward pass computes 8; one backward pass yields 9; the algorithm then accumulates
0
over calibration batches, and sets the final score by averaging over 1 batches. The ranking criterion is descending importance, with lower-scored blocks removed first. This is presented as Algorithm 1, “Importance Profiling,” and its measured cost on 2 with 3 calibration batches of batch size 4 on one H200 GPU is 5, compared with 6 for IGIA, 7 for Fisher, 8 for Hessian trace, 9 for CosSim, 0 for PPL, 1 for Magnitude, and 2 for Taylor because of CPU accumulation overhead (Sun et al., 26 Jun 2026).
3. Drop-Then-Recovery, recoverability, and empirical asymmetry
Within Drop-Then-Recovery, GateProbe is used in Stage 1 to select which blocks to remove. Given a target drop count 3, the method removes the 4 least important blocks, physically short-circuiting the residual connection 5 and discarding parameters 6. Stage 2 then fine-tunes the reduced model against the downstream action objective,
7
with recoverability measured by post-recovery Success Rate on evaluation suites such as LIBERO, LIBERO-Plus, and RoboTwin 2.0.
The central empirical result is a strong asymmetry across pathways. Language backbones are described as highly redundant for standard robotic manipulation tasks, whereas vision and action pathways are substantially less tolerant to removal. On LIBERO, removing half of the language blocks improves OpenVLA-OFT from 8 to 9 under the same downstream fine-tuning budget, and retaining only two language blocks still recovers baseline-level performance at 0. For 1, the corresponding values are 2 when half the language layers are removed, and 3 when only two language blocks are kept. By contrast, vision and action compression degrade performance much more severely: on 4, Vision Drop Half yields 5, Vision Keep 2 yields 6, and Action Keep 2 yields 7. Under FLOPs-matched training on 8, Drop-12, which keeps 9 of 0 language blocks, reaches 1, exceeding the 2 baseline; even Drop-17, which keeps 3 block, recovers to 4 (Sun et al., 26 Jun 2026).
Against alternative importance metrics, GateProbe is reported as best or second-best, with its advantage growing under aggressive compression. On 5 across four drop levels, GateProbe averages 6 at Drop-9, 7 at Drop-12, 8 at Drop-16, and 9 at Drop-17. The paper notes that at Drop-16 it exceeds weaker baselines by as much as 0, and at Drop-17 by as much as 1. The comparison set includes parameter-space Taylor, IGIA, Fisher, Hessian trace, activation-space CosSim, PPL, and Magnitude. The stated rationale for preferring GateProbe is that it couples each block’s residual contribution directly to downstream sensitivity, requires only standard backpropagation, and is explicitly aligned with the action-learning loss rather than with static similarity or parameter magnitude (Sun et al., 26 Jun 2026).
The real-robot industrial results qualify the apparent redundancy of language depth. On an xArm 850 warehouse parcel-sorting setup, large language drops preserve near-baseline performance in near-training conditions: in Env 1, Baseline 2, Drop-9 3, Drop-16 4; in Env 2, Baseline 5, Drop-9 6, Drop-16 7. Under distribution shifts such as lighting changes, novel objects, and container changes, heavily dropped models degrade more than the full model. A common misconception would be to read high recoverability on LIBERO as evidence that language capacity is generally unnecessary; the reported out-of-distribution results instead indicate that redundancy is benchmark- and distribution-dependent. The paper’s limitations also emphasize that GateProbe is a first-order approximation, may miss higher-order block interactions, and can show increased variance with extremely small calibration sets (Sun et al., 26 Jun 2026).
4. GateProbe in scanning gate microscopy
In "Scanning gate experiments: from strongly to weakly invasive probes," GateProbe refers to the use of a conductive, biased tip as a local electrostatic gate that perturbs electron transport in a buried two-dimensional electron gas. The experiment uses an open resonator fabricated in a high-mobility GaAs/AlGaAs 2DEG located 8 below the surface, with density 9, mobility 0, and temperature 1. A quantum point contact with lithographic gap 2 lies at the bottom of the scan area. A semicircular cavity gate of radius 3 and opening angle 4, centered at the QPC, depletes the 2DEG below it for 5. The working point is 6, placing the QPC on the third spin-degenerate plateau, 7. The tip is scanned 8 above the surface and the two-terminal linear conductance map
9
is recorded with 0 and lock-in detection.
The tip voltage is calibrated through a dimensionless tip strength,
1
where the least-invasive voltage is 2 and the tip begins to deplete the 2DEG at 3, so that 4 there. The sample has 5, and the tip potential is written
6
For 7, COMSOL indicates an approximately Lorentzian profile; for 8, a Gaussian tail better describes the potential. The appendix uses the Lorentzian example
9
whereas the numerical transport simulations adopt a Gaussian tip with width parameter 0 to suppress long-range tails.
The paper’s central distinction is between strongly invasive and weakly invasive GateProbe operation. In the strongly invasive regime, 1, the tip induces a depletion disk and acts as a movable hard wall. With 2, branched electron flow appears as strong thin features in 3 maps; once the cavity is formed, branch patterns disappear and conductance modulations spread over the cavity area with characteristic 4 scale. In the weakly invasive regime, 5, the tip cannot efficiently backscatter through the QPC when 6, and once the cavity is formed the map develops rich spatial structures inside the cavity region through gentle lensing rather than hard reflections. Near 7, the spatial pattern becomes insensitive to tip strength while the amplitude scales linearly with 8; the paper presents this as the hallmark of the perturbative regime.
The perturbative theory uses the first-order conductance correction
9
with
00
and the standard Landauer expression
01
Within the weak regime, the amplitude of the SGM response scales linearly with 02, and a correlation analysis in simulation shows that the full response remains accurately predicted by first order up to 03, corresponding through calibration to 04. Inside this window, changing 05 rescales the amplitude without modifying the spatial pattern, so 06 is determined by the unperturbed reflection and transmission matrices and the unperturbed scattering states.
The paper quantifies invasiveness using a characteristic length scale 07 and a modulation amplitude 08. From the one-dimensional power spectral density
09
it fits
10
defines
11
and finds that 12 peaks near 13 at approximately 14 before decreasing toward 15, with measured 16. The perturbative regime is thus characterized by maximal 17, minimal 18, and linear amplitude scaling. The maximum 19 is disorder-limited and comparable to the disorder correlation length 20. The practical guidance is correspondingly explicit: identify 21 from minimal 22 and maximal 23, operate within 24, avoid 25 if an interpretation in terms of the unperturbed system is desired, and treat large positive 26 with caution because screening charges in the doping plane complicate the response (Steinacher et al., 2017).
5. GateProbe as a tip-induced single-electron probe in silicon
In "Scanned single-electron probe inside a silicon electronic device," GateProbe is realized by inducing a localized quantum dot directly inside a working multi-terminal silicon device with the biased tip of a low-temperature STM. A negative sample bias 27 bends the silicon bands downward locally under the tip and forms a confinement potential that traps an electron beneath the hydrogen-terminated silicon surface. The dot is centered under the tip and therefore follows the tip laterally with sub-nanometer precision. The source reservoir is an Sb-doped 28 region that supplies electrons to the dot at rate 29 when the dot level aligns with the source chemical potential; the dot then empties to the tip at rate 30. A separate Sb-doped 31 gate reservoir, approximately 32 away across an undoped/p-type channel, shifts the dot level electrostatically via 33.
The transport signature is resonant single-electron tunneling. A resonant step in 34, or peak in 35, appears when the dot level aligns with the source reservoir, and the current through a single discrete level is
36
The experiment is operated in the regime 37, so the measured peak height primarily reflects 38. This was verified by varying the tip height by 39–40 at fixed lateral position, which left the peak height nearly unchanged. As the tip is moved toward the source by only a few nanometers, the QD–source separation decreases and 41 increases exponentially. The measured peak-current increase between 42 and 43 follows
44
with best-fit 45. Using the overlap model described in the supplementary material gives a QD wavefunction decay length
46
The WKB expression
47
is used as the tunneling picture behind the effective position-dependent barrier (Ng et al., 2020).
The electrostatics are expressed through capacitances 48, 49, 50, and 51, with total
52
and lever arms 53. The dot level shifts as
54
In the STM biasing configuration, the effective bias lever arm is
55
From the spatially resolved spectroscopy, the dot resonance in 56 shifts by approximately 57 as 58 increases by 59, and field-based calibration yields 60. Independent fits to a single-level tunneling model give 61 as 62 increases from 63 to 64. In the stability diagram, the resonance slope is 65 for 66, which with 67 gives a gate lever arm
68
The capacitance ratios extracted in the supplementary material are
69
These values show that the source dominates the dot’s self-capacitance, but the lithographic gate still provides substantial capacitive control even though the dot is only approximately 70 from the metallic tip.
The GateProbe is also used as a local electrometer. During spatial scans with 71 and 72 near resonance, the planar electric field between source and gate is estimated as
73
giving approximately 74. More generally, once 75 is calibrated, local electric fields can be mapped from resonance shifts through
76
When the moving dot passes near localized charges, its level shifts by Coulomb interaction, producing spatially localized distortions of the resonance. The reported examples include a step edge and a doubly charged dangling bond; approaching a negative charge requires more negative 77 to maintain resonance, allowing both defect polarity and location to be identified with atomic-scale precision.
The paper positions this GateProbe against scanning single-electron transistor microscopy and scanning gate microscopy. Unlike those approaches, where interaction is purely capacitive and long-ranged, the silicon GateProbe achieves short-range tunnel coupling between the probe dot and the device source reservoir while retaining sizable gate control, with 78 and 79. The limitations are equally explicit: the probe necessarily perturbs the local potential through tip-induced band bending, can hybridize with localized states in heavily doped regions, and requires cryogenic temperature and UHV. Within those constraints, it provides atomic-scale spatial resolution, quantitative tunnel-coupling control, and in-device electrometry (Ng et al., 2020).
6. Relation to residual-stream concept probing: Geometric Evolution Maps
"Geometric Evolution Maps: Extracting Stable Concept Probes from Transformer Residual Streams" does not mention GateProbe by name. The paper is nevertheless directly relevant to any gating-based probing approach that operates on concept probes in the residual stream, including layer selection, ablation or intervention placement, and direction specificity. Its starting point is that a concept probe is a direction vector in residual-stream activation space that discriminates between sentences expressing a concept versus matched sentences not expressing that concept. The probe at layer 80 is the L2-normalized difference between class centroids,
81
using last-token activations from the post-MLP residual output. The Fisher-normalized separation score is
82
The paper defines a Concept Allocation Zone as the contiguous layer interval containing the primary separation event, from above-noise onset through the peak and back toward a floor.
The key geometric claim is that concept directions rotate substantially during assembly and do not settle into a stable direction until a characteristic handoff layer after the CAZ. Rotation is quantified via adjacent-layer directional similarity
83
and angular velocity
84
Entry-to-exit cosine within the CAZ is
85
Across 86 architectures and 87 concepts, mean EEC is 88 and median EEC is 89; 90 of pairs have EEC 91, and 92 have EEC 93. The paper interprets this as showing that directions at CAZ entry are poor predictors of settled directions at CAZ exit. The handoff layer is defined as the first post-CAZ layer after rotation ceases under the threshold 94:
95
The handoff cosine 96 has mean 97 and median 98, which the paper presents as evidence that the settled probe direction is typically stable through to the final layer (Henry, 25 May 2026).
For intervention, the paper uses directional ablation at the extraction layer,
99
and measures retained percentage of separation. GEM compares the probe extracted at the handoff layer against the probe extracted at the peak layer. Across 00 concept-model pairs, GEM-extracted probes are at least as precise as peak-layer probes in 01 trials 02 and strictly outperform in 03 04. Trial-level Wilcoxon on 05 non-ties gives 06, and model-level Wilcoxon signed-rank gives 07, 08, 09 one-sided; excluding gpt2 yields 10, 11. The architecture split is pronounced: MHA models favor the handoff in 12 trials 13, whereas GQA models favor the handoff in 14 trials 15.
The paper also gives practical guidance that maps directly onto GateProbe-style intervention design. The default ablation width is 16 consecutive layers starting at 17, but if 18 the near-final rule sets 19 to avoid contamination by unembedding-preparation layers. This rule is triggered in 20 cases 21 and improves probe quality in 22 triggered cases 23 with mean gain 24 percentage points; the overall mean across all 25 pairs is 26 points. A direction-specificity control compares concept-direction ablation against 27 random unit vectors per pair, giving mean concept-direction reduction 28 versus mean random-direction reduction 29, median specificity ratio 30, median z-score 31, and 32 pairs 33 in which the concept direction beats all 34 random seeds. The practical implication is narrow but important: gate-based probing in residual streams should target a settled direction at the handoff layer rather than a rotating peak-layer direction or an arbitrarily late layer. The stated caveats are that 35 is empirically set without a formal sensitivity analysis, late handoffs are common at 36, shallow models can fail near the unembedding, some concepts may never settle, and sliding-window attention variants can violate depth-matched expectations (Henry, 25 May 2026).