---
title: 'CRI.Z: Efficient Relative-Importance Measure'
url: https://www.emergentmind.com/topics/cri-z
type: topic
---

# CRI.Z: Efficient Relative-Importance Measure

CRI.Z is a computationally efficient relative-importance measure for variable ranking and filter-based selection, introduced as a variant of Comprehensive Relative Importance (CRI) in “Variable Selection Using Relative Importance Rankings” [2509.10853]. It is formulated for standardized linear-model settings, including \(p>n\), and uses a reduced singular value decomposition (SVD) of the predictor matrix to assign each predictor the explained variance captured in an orthogonal basis. In the paper’s formulation, CRI.Z is a parameter-free generalization of the CAR score to arbitrary \(X\), with substantially lower computational burden than General Dominance (GD) and lower memory cost than full CRI [2509.10853].

## 1. Conceptual position within relative-importance analysis

CRI.Z arises from the paper’s attempt to connect variable selection with relative importance (RI) analysis. The stated motivation is that RI measures incorporate both direct and combined effects of predictors, thereby addressing a key limitation of marginal correlation, which ignores dependencies among predictors. Within this framework, GD, CRI, and CRI.Z are used not merely for post-hoc explanation but for predictor ranking before model creation [2509.10853].

The paper situates CRI.Z alongside two other RI measures. GD measures the average incremental contribution of a predictor to model fit, typically \(R^2\), across all possible submodels. CRI generalizes Relative Weights (RW) to arbitrary \(X\), including \(p>n\), by transforming correlated predictors to an orthogonal basis, allocating explained variance there, and reallocating it back to the original predictors. CRI.Z is derived from CRI by replacing the reallocation term with the identity, so that each predictor is assigned the explained variance captured in the orthogonal basis directly. This suggests that CRI.Z preserves the core orthogonalization logic of CRI while removing the computationally expensive reallocation step [2509.10853].

The resulting measure is positioned as the preferred RI score when \(p\) is large. The paper explicitly contrasts this with GD, which is computationally prohibitive beyond small \(p\), and with CRI, whose \(O(p^2)\) reallocation matrix can be heavy in large problems. In that sense, CRI.Z is not presented as a separate modeling paradigm, but as the efficient ranking component within an RI-based variable-selection pipeline [2509.10853].

## 2. Mathematical construction

The common preprocessing step is to center \(y\) and each column \(x_j\) of \(X\) to zero mean and scale them to unit \(\ell_2\) norm. Let the reduced SVD of the standardized predictor matrix be
\[
X = U_r S_r V_r^\top,
\]
with rank \(r\), \(U_r \in \mathbb{R}^{n \times r}\), \(S_r \in \mathbb{R}^{r \times r}\), and \(V_r \in \mathbb{R}^{p \times r}\) [2509.10853].

CRI is defined through two components. The vector
\[
v := V_r U_r^\top y \in \mathbb{R}^{p}
\]
contains the correlations, or loadings, of \(y\) in the orthogonalized latent coordinates, while
\[
A := V_r S_r V_r^\top \in \mathbb{R}^{p \times p}
\]
encodes how orthogonal components map back to original predictors. The CRI score vector is
\[
D(X) = \Big( (V_r S_r V_r^\top) \odot (V_r S_r V_r^\top) \Big) \Big( (V_r U_r^\top y) \odot (V_r U_r^\top y) \Big),
\]
where \(\odot\) denotes the Hadamard product [2509.10853].

CRI.Z removes the reallocation step entirely. Its definition is
\[
w_G^2 = (V_r U_r^\top y) \odot (V_r U_r^\top y),
\]
so that the predictor-specific score is
\[
\mathrm{CRI.Z}_j = \big([V_r U_r^\top y]_j\big)^2.
\]
The paper describes this as replacing the CRI reallocation term with the identity. A plausible implication is that CRI.Z can be read as the squared correlation of each original predictor with the orthogonalized representation of the response, without the subsequent redistribution imposed by CRI [2509.10853].

In the full-column-rank case with \(n>p\), CRI.Z reduces to Johnson’s minimal transformation and to the CAR score. The corresponding orthogonalization is
\[
Z = X (X^\top X)^{-1/2},
\]
with scores
\[
w = Z^\top y = (X^\top X)^{-1/2} X^\top y, \qquad
w^2 = [w_1^2, \ldots, w_p^2]^\top.
\]
This special case anchors CRI.Z in the earlier relative-weights and CAR literature while extending the construction to arbitrary \(X\) through SVD [2509.10853].

## 3. Algorithmic form and computational profile

The CRI.Z algorithm is deliberately minimal. After standardization, one computes the reduced SVD \(X = U_r S_r V_r^\top\), then forms
\[
u = U_r^\top y,
\qquad
v = V_r u,
\qquad
w^2 = v \odot v.
\]
The vector \(w^2\) is returned as the CRI.Z score vector [2509.10853].

The computational cost is dominated by the reduced SVD, with complexity \(O(n p \min(n,p))\). The subsequent multiplications require only \(O(p r)\) time and \(O(p r)\) memory. Because CRI.Z does not construct a \(p \times p\) reallocation matrix, it avoids the \(O(p^2)\) time and space costs that appear in CRI. It also avoids the exponential \(O(2^p)\) model-fitting burden of GD, which requires enumeration of all submodels and is described as feasible only for small \(p\) [2509.10853].

This computational profile is central to the method’s intended use. The paper explicitly recommends CRI.Z when \(p\) is large and especially when \(p \gg n\), where reduced-SVD computation remains feasible because \(r \le n\). The method is also described as parameter-free, in contrast to CAR’s shrinkage-based workaround for arbitrary \(X\), because CRI.Z requires no covariance shrinkage or tuning [2509.10853].

The implementation guidance is correspondingly simple. The repository implements CRI and CRI.Z in R, while GD and CAR are obtained from third-party packages, specifically `relaimpo` and `care`. The paper also notes that CRI.Z can be implemented directly with base R SVD [2509.10853].

## 4. Use in ranking and filter-based selection

The intended workflow is to compute CRI.Z scores, rank predictors in descending order, and then select variables by a filter rule before fitting the final model. The paper describes two main selection strategies. The first is a top-\(k\) rule, in which \(k\) is chosen by validation or cross-validation. The second is thresholding, in which variables are retained when \(w_G^2\) exceeds a data-dependent threshold such as an elbow in the scree of scores [2509.10853].

The downstream model is then fit on the selected variables. Two variants are emphasized. “LS-RI” denotes least squares on the selected set, and “Ridge-RI” denotes ridge regression on the selected set. The paper recommends LS-RI for interpretability and Ridge-RI for predictive accuracy, particularly when predictors are correlated or \(p/n\) is high. It also recommends validation for choosing both \(k\) and the ridge penalty \(\lambda\) [2509.10853].

The method is especially motivated by settings involving correlated clusters, suppressors, or weak predictors. The paper states that CRI.Z orthogonalizes \(X\) and scores variables by squared correlation in the orthogonal basis, which captures joint effects and mitigates suppression. As a result, variables with weak or zero marginal correlation can still receive large CRI.Z scores if they contribute in the orthogonalized space. The same logic is used to explain why RI-based methods can rank truly relevant variables more accurately than marginal correlation in the presence of multicollinearity [2509.10853].

The paper’s practical defaults are correspondingly conservative: always standardize inputs; use CRI.Z when \(p\) is large; choose the number of selected variables by validation; and prefer ridge when correlation is strong or \(p\) is large. This suggests that CRI.Z is best viewed as a ranking mechanism that is intentionally decoupled from the final predictive estimator [2509.10853].

## 5. Empirical behavior and comparative results

The empirical study is divided into ranking performance and predictive modeling. In the low-dimensional setting \(n=100, p=10\), all methods perform reasonably in an equicorrelated strong-signal example, though performance degrades as correlation increases. In the suppressor example, SIS fails, while GD and CRI slightly outperform CRI.Z; all RI measures remain robust. In the weak-predictor example, CRI.Z performs better than CRI under a weak signal, and SIS fails again [2509.10853].

In the high-dimensional “High-100” setting with \(n=100, p=1000\), SIS performs poorly in the suppressor and weak-predictor examples. CRI.Z, together with CAR, consistently outperforms CRI, particularly under higher correlations. The paper also notes that none of the methods perfectly recover all true predictors in the hardest cases, but RI measures remain more reliable than SIS [2509.10853].

For predictive modeling, the paper reports that LS-RI variants, especially LS-CRI.Z, achieve superior support recovery measured by F1-score in clustered-predictor scenarios with moderate or high correlation. The comparison set includes best subset, forward stepwise, lasso, and relaxed lasso. At low signal-to-noise ratio, lasso and relaxed lasso may achieve lower relative test error (RTE) because of shrinkage, but Ridge-CRI.Z closes and often surpasses this gap, outperforming in both F1 and RTE when \(\lambda\) is properly tuned [2509.10853].

In the high-dimensional experiments, LS-CRI.Z and LS-CAR emerge as the best RI variants and are described as robust and scalable. In clustered predictor scenarios, LS-RI variants achieve the highest F1-scores, while forward stepwise collapses under high correlation. Ridge-RI further improves RTE. The paper’s overall conclusion is that RI-based ranking, and CRI.Z in particular, is a powerful and competitive alternative to lasso-dominated selection pipelines, especially when predictor dependence is strong [2509.10853].

## 6. Theoretical interpretation, limitations, and scope of the label

The theoretical framing of CRI.Z is deliberately modest. GD is identified with the Shapley value for the cooperative game \(v(S)=R^2(y \cdot X_S)\), inheriting fairness axioms and additivity. CRI and CRI.Z, by contrast, rely on orthogonalization rather than submodel averaging. The paper states that, under orthonormal columns and standardized \(y\), the sum of CRI.Z scores approximates the explained variance in the orthogonal basis, but it does not claim exact equality for arbitrary \(X\). It also states that no formal consistency guarantees are provided; the case for the method is empirical rather than asymptotic [2509.10853].

The limitations are correspondingly specific. GD is computationally infeasible for moderate or large \(p\). CRI can introduce extra variability in very high-dimensional or highly correlated settings because of the full reallocation step. Lasso and relaxed lasso may be preferable at extremely low signal-to-noise ratio, where variance reduction dominates. In settings with purely uncorrelated predictors and sparse strong signals, SIS and lasso can be competitive, while CRI.Z remains competitive but not necessarily superior [2509.10853].

The label “CRI.Z” also appears in other arXiv contexts with different meanings. In “SDR-CIR: Semantic Debias Retrieval Framework for Training-Free Zero-Shot Composed Image Retrieval,” the string occurs as a shorthand for zero-shot composed image retrieval, written as “CRI.Z; ZS-CIR,” rather than as a variable-selection score [2602.04451]. In cosmic-ray transport literature, the notation can also be interpreted as the cosmic-ray ionization rate \(\zeta\), as discussed in the software paper on `criptic` and in the molecular-cloud ionization work CRIME [2207.13838] [1507.05127]. Within statistics and machine learning, however, CRI.Z refers specifically to the SVD-based RI ranking measure proposed in [2509.10853].

Source: https://www.emergentmind.com/topics/cri-z