ILNet: Diverse Architectures in Machine Learning
- ILNet is an acronym used for various machine learning architectures, each tailored to specific tasks such as infrared detection, trajectory prediction, and object localization.
- The infrared ILNet employs a U-shaped encoder–decoder with Interactive Polarized Orthogonal Fusion, Dynamic One-Dimensional Aggregation, and Representative Block to enhance small target detection.
- Other ILNet variants incorporate inverse learning attention for multi-agent forecasting, localization-quality supervision for semi-supervised detection, and interpretable rule-based logic for classification.
ILNet is a reused acronym in recent machine-learning literature rather than a single, unified architecture. In arXiv publications, it denotes at least three distinct named models—an infrared low-level network for salient infrared small target detection, a trajectory prediction architecture with Inverse Learning attention, and an “Improving Localization net” for semi-supervised object detection—while related work also uses ILNet/ILN for inertial localization networks and for an interpretable logical network formulation built from AND/OR/NOT concepts (Li et al., 2023, Zeng et al., 9 Jul 2025, Rossi et al., 2022, Zhang et al., 21 Jul 2025, Perreault et al., 11 Aug 2025).
1. Nomenclature and major uses
The acronym has been expanded differently across subfields, and the resulting models address different data modalities, objectives, and inductive biases. In computer vision, ILNet may refer to a salient infrared small target detector that emphasizes low-level cues, or to a trajectory forecasting model that performs inverse temporal reasoning over multi-agent interactions. In semi-supervised detection, “IL-net” abbreviates “Improving Localization net” and denotes an auxiliary localization-quality classifier integrated into a Mean Teacher pipeline. Related literature further uses ILNet as a general inertial localization network concept, and as a shorthand for an interpretable logical neural network architecture (Li et al., 2023, Zeng et al., 9 Jul 2025, Rossi et al., 2022, Zhang et al., 21 Jul 2025, Perreault et al., 11 Aug 2025).
| Name in literature | Domain | Defining components |
|---|---|---|
| ILNet | Salient infrared small target detection | IPOF, DODA, RB |
| ILNet | Multi-agent trajectory prediction | IL Attention, DAS |
| IL-net | Semi-supervised object detection | IoU classification head, pseudo-label filtering |
| RepILN | Inertial localization | RepBlock, TSSA, SA-GCU |
| ILNet as instantiated in Neural Logic Networks | Interpretable classification | AND/OR/NOT concepts, DNF rules |
A common source of confusion is that these models do not share a common architecture despite the shared acronym. This suggests that “ILNet” functions primarily as a field-local naming convention whose meaning must be resolved from context.
2. Infrared low-level network for salient infrared small target detection
In "ILNet: Low-level Matters for Salient Infrared Small Target Detection" (Li et al., 2023), ILNet is an infrared low-level network for infrared small target detection (SIRST). The method is motivated by the observation that typical targets are smaller than about pixels, are low-contrast due to low signal-to-clutter ratio, and have weak color and texture cues. Because high-level semantics are seldom present, repeated down-sampling and abstraction in deep CNN layers cause target signals to attenuate or vanish in deeper layers; the paper terms this phenomenon deep abatement. The model therefore reframes SIRST as salient object detection of intensity-salient micro-regions rather than semantic segmentation of meaningful objects.
The network adopts a U-shaped encoder–decoder architecture built with ReSidual U-blocks as in Net. The encoder extracts multi-stage features , and the decoder produces multi-stage outputs . At each stage, an Interactive Polarized Orthogonal Fusion module bidirectionally fuses aligned encoder and decoder features. The fusion is “polarized” because it separates spatial and channel branches, “orthogonal” because those branches operate on complementary axes, and “interactive” because each branch uses both and to compute attention or gating. The module output is
Inside IPOF, ILNet inserts Dynamic One-Dimensional Aggregation layers, designed to adapt the depth of lightweight 1D convolutions to the stage-wise embedding dimension. The empirical mapping is
with in all experiments. The stated role of DODA is to avoid underfitting high-channel stages and overfitting low-channel stages while keeping aggregation low-cost.
After stage-wise decoding, ILNet uses a Representative Block to aggregate decoder outputs globally and to enhance deep outputs using shallow outputs, which carry more low-level detail. The enhancement factor is
and the final segmentation map is
0
The paper describes RB as “ensemble learning”-inspired because it dynamically allocates weights for shallow and deep layers.
Training uses deep supervision with binary cross entropy at each decoder stage. No IoU, focal, or explicit orthogonality losses are used; BCE is the only training loss, with weight decay 1 as regularization and BN/LN inside modules. Images are resized to 2; training uses Adan with initial learning rate 3, batch size 4, AMP, and 5 epochs in PyTorch 1.10.0 on NVIDIA Jetson AGX Xavier. The paper reports three scales: ILNet-S, ILNet-M, and ILNet-L.
Quantitatively, ILNet-L reports 6 IoU, 7 nIoU, 8 9, and 0 1 on NUAA-SIRST; on IRSTD-1K it reports 2 IoU, 3 nIoU, 4 5, and 6 7. The paper states that ILNet-L surpasses ISNet on nIoU and reduces false alarms substantially on both datasets. Ablations show that each of IPOF, DODA, and RB helps, that full-stage IPOF fusion improves target-level metrics with small overhead, and that shallow-to-deep enhancement is decisively better than deep-to-shallow enhancement. ILNet-S is reported at approximately 8M parameters and approximately 9 GFLOPs, which the paper characterizes as suitable for edge deployment. Visual analysis attributes clearer target boundaries, fewer miss detections, and fewer false alarms to the low-level-centric design, and the paper states that gains are more pronounced on the larger IRSTD-1K dataset (Li et al., 2023).
3. ILNet for multi-agent trajectory prediction with Inverse Learning attention
In "ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capture" (Zeng et al., 9 Jul 2025), ILNet is a multi-agent motion forecasting model for interaction scenarios. The method takes 0 interacting agents observed for 1 steps and predicts 2 future modes 3 over 4 steps, together with probabilities 5. The central motivation is that factorized attention over temporal and agent axes is efficient but static and forward-only, so it captures only obvious and immediate behavioral intentions and lacks explicit spatio-temporal coordination across neighboring moments.
The model introduces Inverse Learning Attention and Dynamic Anchor Selection. The encoder first embeds agent motion, shape, category, and relational edge features, together with an HD-map graph. Mode queries interact with the map via multi-head graph cross-attention, and then pass through three attention layers: Ego-Agent Temporal Attention, Agent Future Attention, and Agent History Attention. The future-attention step conditions the current moment on interacting agents at 6 inside the observed history window; the history-attention step then inversely reasons back to 7. The resulting “proposed intention” is fused as
8
The paper explicitly distinguishes this from inverse reinforcement learning: the “inverse” step concerns temporal information flow within the observation window rather than reward recovery.
After IL Attention, ILNet applies repeated factorized graph self-attention blocks over agents, historical time, and modes. Proposal trajectories are then refined by Dynamic Anchor Selection, which learns trajectory change keypoints per mode from local correlations across history, mode, and future-time axes. Historical and proposal trajectories are embedded, local 9D correlations are extracted with lightweight Conv2D blocks, and an MLP with sigmoid predicts normalized anchor positions. These anchors are used to reparameterize proposal trajectories into anchor-centered polar coordinates for a second refinement stage. The final output is
0
Training uses winner-takes-all mode selection, Huber regression loss on both proposal and final predictions, and a cross-entropy loss on final mode probabilities. The paper reports 1, 2 heads, 3, cosine learning-rate scheduling, weight decay 4, 5 epochs, and training on 6 RTX 4090. On INTERACTION, the model is evaluated with minJointADE@6 and minJointFDE@6; on Argoverse it reports minADE@6, minFDE@6, Miss Rate@6, and Brier-minFDE@6, together with diversity metrics on validation.
The reported test-set results are state-of-the-art within the paper’s comparison set. On Argoverse, ILNet reports minFDE6 7, MR6 8, B-minFDE6 9, minADE6 0, and approximately 1M parameters. On INTERACTION, it reports minJointFDE6 2 and minJointADE6 3; the paper states that this improves over HPNet by 4 FDE and 5 ADE with fewer parameters in that setup. Ablations on INTERACTION validation show that inverse modeling with FA then HA yields 6 FDE/ADE, compared with 7 for the TA-only baseline, and adding DAS yields 8. DAS adds only 9M parameters on INTERACTION and 0M on Argoverse, with small latency increases. The paper further reports improved robustness under randomly masked history and stronger gains in complex scenarios such as intersections and roundabouts (Zeng et al., 9 Jul 2025).
4. IL-net for semi-supervised object detection
In "Improving Localization for Semi-Supervised Object Detection" (Rossi et al., 2022), IL-net stands for Improving Localization net and is integrated into a Mean Teacher or Unbiased Teacher semi-supervised object detection pipeline. The setting maintains a Student detector and an EMA-updated Teacher. The Teacher predicts pseudo-labels on weakly augmented unlabeled images, and the Student is trained on labeled data and on strongly augmented unlabeled data using those pseudo-labels. The paper argues that standard pseudo-labeling by confidence thresholding is insufficient because confidence is not strictly tied to localization uncertainty.
The empirical motivation is explicit. The paper reports that pseudo-boxes with IoU 1 represent about 2 of all pseudo-boxes but contribute to more than 3 of classification errors. It also reports that unsupervised regression loss contributes 4–5 of the total loss, while unsupervised classification contributes at most 6. IL-net addresses this by adding an auxiliary localization classification task that predicts whether a box is high quality with respect to IoU. The head is attached to the ROI stage of Faster R-CNN with FPN and ResNet-50, and computes
7
where 8 is the shared ROI feature, 9 contains class scores, and 0 contains box regression deltas. The corresponding loss is focal loss,
1
with focusing parameter 2.
The total Student loss is written as
3
with supervised and unsupervised decompositions
4
For supervised IoU targets, proposals are foreground if 5, and are labeled high-quality when 6 with 7. During pseudo-label generation, Teacher boxes are filtered first by the localization-quality threshold 8 and then by the class-confidence threshold retained from Unbiased Teacher:
9
with 0. The supervised and unsupervised branches otherwise follow the standard UT protocol, including weak augmentation by random horizontal flip and strong augmentation by color jittering, grayscale, Gaussian blur, and cutout patches.
The training setup uses COCO 2017 with 1 labeled images, validation on minival, 2 iterations, 3 Tesla P100 GPUs, and SGD with learning rate 4, momentum 5, and weight decay 6. The paper sets 7 and finds the best performance at 8. Under this setting, the full ILNet configuration reports AP 9, AP50 0, AP75 1, AP2 3, AP4 5, and AP6 7, versus the Unbiased Teacher baseline at AP 8, AP50 9, AP75 00, AP01 02, AP03 04, and AP05 06. The reported gain is 07 AP. Ablations further state that the IoU head alone improves AP by about 08 to 09, that IoU-based filtering adds a smaller additional gain, that 10 is the best training threshold, and that overly large 11 harms performance (Rossi et al., 2022).
5. Related acronymic extensions: inertial localization and interpretable logic
The inertial localization literature uses ILNet or ILN in a broader class sense rather than as the exact title of the 2023 infrared model or the 2025 forecasting model. "RepILN: Reparameterized Inertial Localization Network" states that ILNet is a general class of inertial localization networks that map IMU streams to trajectories, and presents RepILN as a reparameterized ILNet for IoT constraints (Zhang et al., 21 Jul 2025). The backbone contains eight RepILN Blocks across four stages, where each block consists of a multi-branch RepBlock followed by SA-GCU. During training, the RepBlock computes
12
using 13D convolutions with kernel sizes 14 and 15; at inference, branches are structurally reparameterized into a single 16-kernel convolution with folded BN parameters. Long-range temporal dependencies are modeled by Temporal-Scale Sparse Attention, and fused with local fine-grained features through the Sparse Attention Gated Convolutional Unit. Training predicts velocity with mean squared error and reconstructs position by discrete integration. On RoNIN, RIDI, RNIN-VIO, and TLIO, the paper reports lower ATE and RTE than RoNIN-ResNet; for example, on RoNIN it reports ATE 17 versus 18 and RTE 19 versus 20, together with a 21 parameter reduction relative to RoNIN-ResNet in the train model and approximately 22 in the deploy model.
A distinct use appears in "Neural Logic Networks for Interpretable Classification," where ILNet is described as an Interpretable/Logical Neural Network instantiated by AND, OR, and NOT operations over human-understandable concepts (Perreault et al., 11 Aug 2025). In that formulation, the network learns a disjunctive normal form program composed of an AND layer of rules and an OR output layer, with signed weights indicating whether a concept or its negation is necessary or sufficient for a higher-level concept. The differentiable forward equations are
23
for AND concepts, and
24
for OR concepts. The method adds biases 25 and 26 to account for unobserved necessary and sufficient conditions, uses factorized IF-THEN rule modules for categorical and continuous inputs, and applies discretization, retraining, pruning, and coverage-based bias adjustment after gradient-based learning. The reported empirical results include 27 F1 on tic-tac-toe with exactly 28 rules of size 29, approximately 30 F1 on Chess (KRKPA7), approximately 31 F1 on Monk2, and approximately 32 F1 on the Kidney dataset, together with interpretable extracted rules (Perreault et al., 11 Aug 2025).
6. Comparative themes and disambiguation
Across these papers, the shared acronym conceals markedly different methodological commitments. The infrared ILNet emphasizes low-level saliency preservation and shallow-to-deep enhancement; the trajectory-prediction ILNet emphasizes inverse temporal reasoning and learned anchor refinement; IL-net for semi-supervised detection emphasizes auxiliary localization-quality estimation and pseudo-label filtering; RepILN emphasizes structural reparameterization, sparse temporal attention, and compact inference on IMU streams; the logical ILNet formulation emphasizes explicit rule structure, signed logical weights, and post hoc rule extraction (Li et al., 2023, Zeng et al., 9 Jul 2025, Rossi et al., 2022, Zhang et al., 21 Jul 2025, Perreault et al., 11 Aug 2025).
A common misconception is therefore to treat ILNet as a single lineage. The literature instead uses the acronym for several unrelated architectures spanning infrared vision, autonomous-driving forecasting, semi-supervised detection, inertial navigation, and interpretable classification. This suggests that precise identification requires the paper title, expansion of “IL,” and application domain rather than the acronym alone.
A plausible implication is that the recurrence of the name reflects a shared design preference for problem-specific inductive structure rather than any shared implementation. In the surveyed works, that structure takes the form of low-level IR feature preservation, future-to-history intention inference, localization-quality supervision, hardware-friendly single-path deployment, or explicit DNF logic. The term “ILNet” is therefore best understood as a polysemous label whose technical meaning is entirely context dependent.