Papers
Topics
Authors
Recent
Search
2000 character limit reached

Multi-Granular Discretization (IG-MD)

Updated 6 July 2026
  • Multi-Granular Discretization (IG-MD) is a dual framework that treats discretization via a geometric OT–IG approach for transport cost analysis and a multi-resolution method for intrusion detection.
  • In the OT–IG formulation, discretization is encoded using second-moment matrices, Jacobian projections, and Frobenius decompositions to precisely quantify transport-information cost.
  • The intrusion detection approach uses multi-granular Gaussian tokenization to generate coherent symbolic patterns, enhancing interpretability and improving detection accuracy.

to=arxiv_search 日日啪 񎔈json {"query":"id:(Yuge, 19 May 2026) OR id:(Chung et al., 16 Jul 2025)","max_results":5}

to=search_arxiv 公众号天天中彩票 ացնում 的天天彩票 天天中彩票中 Multi-Granular Discretization (IG-MD) is an arXiv label currently used for two distinct discretization-centered frameworks. In one usage, IG-MD denotes a geometric treatment of discretization-induced transport-information cost, where discretization of a continuous support is encoded by the second-moment matrix of a cell ω\omega and analyzed through the correspondence between optimal transport (OT) and information geometry (IG), including the rank-deficient case (Yuge, 19 May 2026). In the other, IG-MD denotes a multi-resolution symbolic encoding for Interpretable Generalization in intrusion detection, where each continuous feature is represented at several Gaussian-based resolutions and supplied to a coherent-pattern rule learner (Chung et al., 16 Jul 2025). The shared acronym therefore names two technical programs with different state spaces, objectives, and evaluation criteria.

1. Scope and terminological usage

Recent arXiv usage assigns the name IG-MD to two formulations that both revolve around discretization but do so in different mathematical settings. The first treats discretization as a geometric operation on continuous probability distributions and studies the induced transport-information cost under identifiable and rank-deficient parametrizations. The second treats discretization as a preprocessing and representation mechanism for explainable intrusion detection, where multiple symbolic resolutions are used to improve rule quality and preserve auditability (Yuge, 19 May 2026, Chung et al., 16 Jul 2025).

Paper Domain Core object
(Yuge, 19 May 2026) OT–IG geometry Second-moment matrix MxM_x and observable/unobservable cost decomposition
(Chung et al., 16 Jul 2025) Explainable intrusion detection Multi-granular Gaussian-based tokens for continuous features

The distinction is substantive. In the OT–IG formulation, the key objects are support coordinates xRfx \in \mathbb{R}^f, Jacobians J=x/θJ = \partial x/\partial \theta, covariance matrices, Frobenius projections, and Fisher metrics. In the intrusion-detection formulation, the key objects are symbolic tokens, coherent normal and anomalous patterns, frequency-and-length weighted scores, and deterministic decision rules. A plausible implication is that “multi-granular” should be read contextually: in one case it concerns support-space geometry across scales or resolutions of ω\omega; in the other it concerns multiple Gaussian-based discretization precisions for feature values.

2. Support-space geometry and the OT–IG correspondence

In the geometric formulation, discretization begins with a continuous ff-dimensional support with coordinates xRfx \in \mathbb{R}^f and a discretization obtained by translating a bounded convex set ωRf\omega \subset \mathbb{R}^f. Let uu denote the local coordinate in ω\omega whose mean over MxM_x0 vanishes. The fundamental geometric object is the second-moment matrix

MxM_x1

where MxM_x2 denotes the volume of MxM_x3. Under this definition, MxM_x4 and MxM_x5 (Yuge, 19 May 2026).

When parameters MxM_x6 on the statistical manifold are directly identifiable with the support coordinates MxM_x7 in the precise sense that MxM_x8, the discretization cost at vanishing discretization scale MxM_x9 is characterized by the correspondence between OT and IG, yielding the exact formula

xRfx \in \mathbb{R}^f0

Here, xRfx \in \mathbb{R}^f1 denotes the Fisher metric associated with support-coordinate variations, xRfx \in \mathbb{R}^f2 and xRfx \in \mathbb{R}^f3 are nearby continuous distributions, and xRfx \in \mathbb{R}^f4 is the probability density for infinitesimal parameter variation xRfx \in \mathbb{R}^f5. The left-hand side xRfx \in \mathbb{R}^f6 is the OT-measured discretization cost; the right-hand side is twice the expected KL divergence between nearby continuous distributions under xRfx \in \mathbb{R}^f7 (Yuge, 19 May 2026).

This identifiable case directly ties the transport metric, through the xRfx \in \mathbb{R}^f8-Wasserstein structure, to the Fisher metric on the statistical manifold. The formulation treats discretization-induced distortion as extrinsic to IG alone, but still expressible as a precise transport-information quantity once the parameter–support identifiability condition is satisfied. Multi-granular discretization enters here through the geometry of xRfx \in \mathbb{R}^f9: varying the discretization cell across scales or resolutions modifies J=x/θJ = \partial x/\partial \theta0, and therefore modifies the total cost J=x/θJ = \partial x/\partial \theta1.

3. Rank-deficient parametrizations, Frobenius projection, and hidden transport sectors

The geometric framework is extended to general parametrizations J=x/θJ = \partial x/\partial \theta2 with local displacement map on the support space J=x/θJ = \partial x/\partial \theta3 and Jacobian J=x/θJ = \partial x/\partial \theta4. Given a covariance matrix J=x/θJ = \partial x/\partial \theta5 for parameter fluctuations, the induced covariance on the support is

J=x/θJ = \partial x/\partial \theta6

The observable covariances form the linear subspace

J=x/θJ = \partial x/\partial \theta7

If J=x/θJ = \partial x/\partial \theta8 is rank-deficient, then J=x/θJ = \partial x/\partial \theta9, meaning not all second-moment matrices on support space can be represented through parameter fluctuations. Consequently, the transport-information correspondence ω\omega0 cannot generally be reconstructed under such parametrizations, because certain physical displacements on the support are invisible to ω\omega1-variations (Yuge, 19 May 2026).

To address this, the framework introduces an orthogonal decomposition under the Frobenius inner product ω\omega2. One writes

ω\omega3

where ω\omega4 is the projection onto ω\omega5 and ω\omega6 is the orthogonal complement. Orthogonality is defined by

ω\omega7

This implies

ω\omega8

and therefore ω\omega9 and ff0 are indistinguishable via quadratic forms induced by ff1:

ff2

The projection operator is defined through the Moore–Penrose pseudoinverse:

ff3

and the Frobenius-orthogonal projection map ff4 is

ff5

The observable and unobservable components are thus

ff6

with ff7. Positive semidefiniteness is preserved: if ff8, then ff9.

Because discretization geometry is intrinsically a support-space property, the total transport cost is physically invariant to parametrization. Under rank-deficient parametrization, however, the cost admits the decomposition

xRfx \in \mathbb{R}^f0

where xRfx \in \mathbb{R}^f1 and xRfx \in \mathbb{R}^f2 with a common proportional constant. The first term is reconstructable from xRfx \in \mathbb{R}^f3-induced fluctuations, while the second is physically present but unobservable under the chosen parametrization. A common misconception is that rank deficiency destroys the total discretization cost; the framework instead states that rank deficiency breaks the standard IG interpretation of that cost, while preserving the invariant total xRfx \in \mathbb{R}^f4 (Yuge, 19 May 2026).

4. Multi-resolution Gaussian tokenization for Interpretable Generalization

In the intrusion-detection formulation, IG begins with labeled flows xRfx \in \mathbb{R}^f5 with binary labels xRfx \in \mathbb{R}^f6. Each xRfx \in \mathbb{R}^f7 is mapped into a set of symbolic attribute-value tokens. For categorical and ordinal features, the token is the literal category. Pattern discovery proceeds within each class by forming pairwise intersections of token sets: for Normal flows xRfx \in \mathbb{R}^f8, the intersection of every pair xRfx \in \mathbb{R}^f9 yields candidate normal patterns; for Anomalous flows ωRf\omega \subset \mathbb{R}^f0, the same process yields candidate anomalous patterns. A candidate pattern ωRf\omega \subset \mathbb{R}^f1 is coherent for class ωRf\omega \subset \mathbb{R}^f2 if and only if ωRf\omega \subset \mathbb{R}^f3 never appears as a subset in any instance of the opposite class ωRf\omega \subset \mathbb{R}^f4. The surviving sets are the Coherent Normal Patterns (CNP) and Coherent Anomalous Patterns (CAP), each stored with its absolute frequency ωRf\omega \subset \mathbb{R}^f5 and length ωRf\omega \subset \mathbb{R}^f6 (Chung et al., 16 Jul 2025).

IG-MD replaces the single discretization used for continuous features with multiple granularities. For each continuous feature ωRf\omega \subset \mathbb{R}^f7, the method estimates

ωRf\omega \subset \mathbb{R}^f8

then standardizes values by

ωRf\omega \subset \mathbb{R}^f9

Let uu0 be the set of granularities, operationalized as a precision set uu1. At granularity uu2, with step size uu3, the discretization mapping is

uu4

Each discretized value is stored as a token that concatenates feature name or index, the granularity tag uu5, and the rounded uu6 value. Distinct granularities remain distinguishable, so the pattern miner can discover rules that mix resolutions (Chung et al., 16 Jul 2025).

The same construction can be expressed through uniform uu7-interval bins of width uu8, with boundaries

uu9

The paper also records optional Gaussian-threshold variants based on ω\omega0 or Gaussian quantiles ω\omega1, while stating that the published implementation uses the ω\omega2-rounding formulation.

Once tokenization is complete, IG’s pairwise-intersection miner operates unchanged. At inference, an instance ω\omega3 is scored by

ω\omega4

In the multi-granular form,

ω\omega5

Labeling then follows three deterministic rules, in order: score dominance, a double-zero safeguard, and a statistical deviation guard-band based on ω\omega6. The framework preserves missing values as the literal token NaN, and it applies an anti-contradiction filter that removes any pair of instances whose entire symbolic representations are identical but carry opposite labels (Chung et al., 16 Jul 2025).

5. Computational procedure, complexity, and empirical behavior

The end-to-end IG-MD pipeline in intrusion detection consists of preprocessing, multi-granular tokenization, coherent pattern mining, guard-band estimation, and inference. Preprocessing relabels non-Normal classes as Anomalous, preserves missing values as NaN tokens, and estimates ω\omega7 for each continuous feature. Tokenization then emits ω\omega8 for each continuous feature and granularity, appends categorical and ordinal tokens as-is, and applies the anti-contradiction step. Pattern mining forms pairwise intersections separately in the Normal and Anomalous subsets, records pattern frequencies, and removes any pattern that violates coherence across classes. Inference rebuilds the token set for a test instance, computes ω\omega9 and MxM_x00, and applies the three deterministic rules (Chung et al., 16 Jul 2025).

The reported computational complexity is explicit. Let MxM_x01 be the number of samples; let MxM_x02 be the feature count; and let MxM_x03 be the number of granularities. Tokenization is MxM_x04 for numeric features, plus MxM_x05 for categorical features. With MxM_x06 and MxM_x07 denoting class sizes and MxM_x08 tokens per instance, pairwise intersections are MxM_x09. Coherence filtering depends on subset containment checks; inference is naively MxM_x10 subset checks and can be accelerated with token-to-pattern indexing (Chung et al., 16 Jul 2025).

The empirical evaluation covers NSL-KDD, UNSW-NB15, and UKM-IDS20. For the IG baseline, using only MxM_x11 training data, the reported performance is approximately MxM_x12 (Precision/Recall/AUC) on NSL-KDD, MxM_x13 on UNSW-NB15, and MxM_x14 on UKM-IDS20. Recall saturates at MxM_x15 with modest training fractions, such as MxM_x16–MxM_x17 on UNSW-NB15 and MxM_x18–MxM_x19 on UKM-IDS20 (Chung et al., 16 Jul 2025).

Replacing IG’s discretizer with multi-granular MxM_x20-rounding yields the reported UKM-IDS20 gains. Across all nine train–test splits, precision improves by MxM_x21 percentage points while recall remains approximately equal to MxM_x22. For MxM_x23 (MxM_x24 train), precision rises from MxM_x25 to MxM_x26; for MxM_x27, from MxM_x28 to MxM_x29. Average precision increases from MxM_x30 to MxM_x31. AUC stays in MxM_x32–MxM_x33. Error rate at MxM_x34 drops from MxM_x35 to MxM_x36 (MxM_x37 relative reduction), with one misclassification in MxM_x38 flows versus one in MxM_x39 previously. The paper describes the mechanism as a lightweight ensemble over granularities: the coarse layer rapidly flags deviations, while the fine layer refines ambiguous cases (Chung et al., 16 Jul 2025).

6. Interpretability, misconceptions, limitations, and prospective directions

Interpretability is central in the intrusion-detection formulation. Because bins are defined in standardized Gaussian units and the granularity tag is explicit in each token, rules remain auditable at the level of feature-value conditions. The paper gives an illustrative rule:

  • IF duration_z at coarse granularity MxM_x40 is in MxM_x41, i.e., MxM_x42, AND
  • bytes_out_z at fine granularity MxM_x43 is in MxM_x44, i.e., MxM_x45,
  • THEN label Anomalous, with the rule lying in CAP and having MxM_x46 and MxM_x47 (Chung et al., 16 Jul 2025).

A worked discretization example uses a feature “packet_rate” with MxM_x48 packets/s, MxM_x49, and observed value MxM_x50. Then MxM_x51; at MxM_x52, MxM_x53 and the corresponding MxM_x54-bin is MxM_x55; at MxM_x56, MxM_x57 and the corresponding MxM_x58-bin is MxM_x59. This example makes explicit how the same value participates simultaneously in coarse and fine symbolic descriptions (Chung et al., 16 Jul 2025).

Two misconceptions are explicitly countered by the source materials. First, IG-MD in intrusion detection does not require features to be Gaussian; it uses MxM_x60 and MxM_x61 to standardize and define interpretable MxM_x62-based bins. Heavy tails or skew can be mitigated with robust estimators, winsorization, or monotone transforms. Second, in the OT–IG framework, rank-deficient parametrization does not erase the physical discretization cost; rather, it prevents full reconstruction of that cost as parameter-induced local indistinguishability, leaving an unobservable transport sector quantified by MxM_x63 (Chung et al., 16 Jul 2025, Yuge, 19 May 2026).

The limitations also differ by formulation. In the OT–IG setting, the framework assumes smooth mappings MxM_x64, existence of the Fisher metric MxM_x65 for support-coordinate variations, and the MxM_x66 discretization limit; the identifiability condition MxM_x67 is crucial for the full OT–IG correspondence. In the intrusion-detection setting, distribution shift and non-stationarity may require periodic re-estimation of MxM_x68 and MxM_x69; adding granularities increases tokens and candidate patterns; and extremely fine precisions on small datasets may overfit. The proposed future extensions likewise diverge: the OT–IG paper points to non-Euclidean supports, stochastic parametrizations, and adaptive multi-scale schemes where MxM_x70 varies to align with observable transport sectors defined by MxM_x71, while the intrusion-detection paper proposes adaptive granularity selection per feature, nonparametric discretization while preserving auditability, Gaussian mixtures for multimodal features, and automated hyperparameter tuning (Yuge, 19 May 2026, Chung et al., 16 Jul 2025).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Multi-Granular Discretization (IG-MD).