---
title: 'RA-IPS: Robust Adversarial Inverse Propensity Score'
url: https://www.emergentmind.com/topics/robust-adversarial-inverse-propensity-score-ra-ips
type: topic
---

# RA-IPS: Robust Adversarial Inverse Propensity Score

Searching arXiv for the cited RA-IPS-related papers to ground the article.
Robust Adversarial Inverse Propensity Score (RA-IPS) is a robustness-oriented inverse propensity methodology whose meaning varies across adjacent research areas. In uplift modeling under unobserved confounding, RA-IPS is an adversarial reweighting method that optimizes inverse-propensity weights within a constrained uncertainty set around nominal propensities; in offline recommender learning under MNAR feedback, it denotes an adversarial learning procedure derived from a propensity-independent generalization bound; and, in a related but distinct line on robust IPW confidence intervals, the supplied RA-IPS description corresponds to a data-dependent coarsened-IPW estimator within the CIPW framework [2606.27114; 1910.07295; 2410.01658]. The common thread is not a single canonical estimator but the use of adversarial or data-dependent mechanisms to stabilize inverse propensity procedures when standard IPS or IPW is vulnerable to hidden bias, propensity misspecification, or extreme scores. This suggests a broader methodological motif rather than a single algorithm.

## 1. Terminological scope and research settings

Across the cited works, RA-IPS appears in three distinct observational-learning settings. In uplift modeling, the task is estimation of individual treatment effects (ITE) when each sample has observed covariates \(x_i\), an unobserved confounder \(u_i\), a binary treatment \(t_i\in\{0,1\}\), and an observed factual outcome \(y_i\). In offline recommender learning, the problem is explicit rating prediction from missing-not-at-random feedback with an unknown propensity matrix \(P\). In causal effect estimation with inaccurate propensities, the relevant object is an IPW estimator for \(\tau=\mathbb{E}[Y(1)-Y(0)]\) under unconfoundedness, but with sensitivity to additive errors in the propensity score and to extreme propensity scores [2606.27114; 1910.07295; 2410.01658].

| Setting | Core object | Robustness device |
|---|---|---|
| Uplift modeling under unobserved confounding | Inverse-propensity weights \(W=(w_1,\dots,w_N)\) | Adversarial optimization in an uncertainty set \(U\) |
| Offline recommender learning under MNAR feedback | Predictor \(h\) and critic \(\phi\) | Minimax discrepancy reduction between MNAR and uniform sampling |
| IPW with inaccurate propensities | Partition \((S,N)\) and coarse propensities \(e(S)\) | Data-dependent coarsening and fractional re-weighting |

The shared acronym can obscure substantive differences. In the uplift formulation, RA-IPS still depends on nominal propensities \(\tilde\pi(x)\) and perturbs their implied weights adversarially. In the recommender formulation, the stated objective is specifically to avoid a propensity estimation procedure. In the CIPW formulation, robustness is achieved by coarsening the covariate space rather than by an adversarial saddle point in the same sense.

## 2. Failure modes of standard IPS and IPW

In the uplift setting, the true treatment assignment mechanism is
\[
\pi(x_i,u_i)=P(t_i=1\mid x_i,u_i),
\]
whereas in practice one can only estimate the nominal propensity
\[
\tilde\pi(x_i)=P(t_i=1\mid x_i)=\int \pi(x_i,u)\,p(u\mid x_i)\,du.
\]
Under standard ignorability, IPS reweighting,
\[
\mathcal L_{\mathrm{IPS}}
= \frac1N\sum_{i=1}^N
\Bigl[
\tfrac{t_i}{\tilde\pi(x_i)}\,\ell\bigl(\mu_1(x_i),y_i\bigr)
+
\tfrac{1-t_i}{1-\tilde\pi(x_i)}\,\ell\bigl(\mu_0(x_i),y_i\bigr)
\Bigr],
\]
is an unbiased estimator of the ideal loss. When unobserved confounders \(u\) exist, \(\pi(x_i,u_i)\neq\tilde\pi(x_i)\) in general and the unbiasedness property no longer holds; only reweighting by the true propensity \(\pi(x_i,u_i)\) restores unbiasedness [2606.27114].

In offline recommender learning, the stated problem is “propensity contradiction.” Existing IPS-based methods can suffer significantly from propensity estimation bias, and many require some amount of missing-completely-at-random data to estimate the propensity accurately. The contradiction is that IPS is intended to learn from only missing-not-at-random feedback, yet becomes ineffective without MCAR data [1910.07295].

In IPW estimation of average treatment effects, the supplied CIPW analysis states that even if a single covariate has an \(\varepsilon>0\) additive error in the propensity score, the size of confidence intervals of IPW estimators and their variants can increase arbitrarily. It also states that, in the presence of extreme propensity scores close to \(0\) or \(1\), the rate at which those confidence intervals go to zero with \(n\) can be arbitrarily slow [2410.01658].

These three failure modes are technically different but structurally related: hidden confounding invalidates nominal IPS unbiasedness, propensity estimation bias destabilizes MNAR recommender training, and local propensity inaccuracies or extremes destabilize IPW confidence intervals.

## 3. RA-IPS in uplift modeling under unobserved confounding

The 2026 uplift formulation defines the true inverse-propensity weight for sample \(i\) as
\[
w_i=\frac{t_i}{\pi(x_i,u_i)}+\frac{1-t_i}{1-\pi(x_i,u_i)},
\]
with nominal counterpart
\[
\tilde w_i=\frac{t_i}{\tilde\pi(x_i)}+\frac{1-t_i}{1-\tilde\pi(x_i)}.
\]
To model deviation between true and nominal propensities, it assumes
\[
\pi(x,u)=\sigma\bigl(f(x)+g(u)\bigr),\quad |g(u)|\le \log\Gamma,\;\Gamma\ge 1.
\]
This yields per-sample bounds
\[
a_i \le w_i \le b_i,\qquad
a_i = 1+(\tilde w_i-1)\,\tfrac1\Gamma,\qquad
b_i = 1+(\tilde w_i-1)\,\Gamma.
\]
It also imposes the large-sample constraint
\[
\frac1N\sum_{i=1}^N(w_i-\tilde w_i)\overset{p}\longrightarrow 0,
\]
leading to the uncertainty set
\[
U=\Bigl\{W\in\mathbb R_+^N:\;
a_i\le w_i\le b_i,\;\forall i,\;
\frac1N\sum_{i=1}^N(w_i-\tilde w_i)\le \varepsilon_N
\Bigr\},
\]
where \(\varepsilon_N>0\) is chosen small and \(\varepsilon_N\to 0\) as \(N\to\infty\) [2606.27114].

RA-IPS then solves the saddle-point problem
\[
\min_{\theta\in\Theta}\;\max_{W\in U}\quad
\frac1N\sum_{i=1}^N w_i\,\ell\bigl(f_\theta(x_i,t_i),y_i\bigr)
+\lambda\Bigl(
\tfrac1N\sum_{i=1}^N(w_i-\tilde w_i)
\Bigr)^2
+R(\theta),
\]
subject to the box constraints and the global deviation constraint. Here \(f_\theta\) is the uplift model, \(R(\theta)\) is any standard regularizer such as weight decay, and \(\lambda>0\) penalizes global drift of \(W\) away from \(\tilde W\) [2606.27114].

Algorithmically, the method alternates between an inner maximization over \(W\) and an outer minimization over \(\theta\). The inner loop performs gradient ascent on \(w_i\), followed by projection onto \([a_i,b_i]\) and enforcement of the global sum constraint by a simple shift or a sorting-based projection onto the simplex-like halfspace \(\{\sum (w_i-\tilde w_i)\le N\varepsilon_N\}\). The outer step updates model parameters using the weighted loss
\[
L(\theta)=\frac1N\sum_i \hat w_i\cdot \ell\bigl(f_\theta(x_i,t_i),y_i\bigr)+R(\theta).
\]
In this construction, robustness is localized at the level of sample weights rather than at the level of feature representation alone.

## 4. Alternative RA-IPS constructions in recommender learning and coarsened IPW

In offline recommender learning, the RA-IPS construction in the supplied description starts from a propensity-independent generalization-error bound. Let \(D=\{1,\dots,m\}\times\{1,\dots,n\}\) be the set of user-item pairs, \(R\in\mathbb R^{m\times n}\) the true rating matrix, \(\hat H:D\to\mathbb R\) the hypothesis, and \(O_{u,i}\sim\mathrm{Bernoulli}(P_{u,i})\) the MNAR observation indicator. The ideal population risk is
\[
L(\hat H)=\frac1{mn}\sum_{(u,i)\in D}\ell(R_{u,i},\hat H_{u,i}),
\]
while the naive empirical MNAR loss is
\[
\hat L_{\mathrm{naive}}(\hat H;O)=\frac1M\sum_{u,i:O_{u,i}=1}\ell(R_{u,i},\hat H_{u,i}).
\]
The discrepancy term is defined as
\[
\mathrm{Disc}(\hat H):=\sup_{\hat H'\in\mathcal H}
\bigl[
\hat L_{\mathrm{naive}}(\hat H';O')-\hat L_{\mathrm{naive}}(\hat H';O)
\bigr],
\]
where \(O'\sim \mathrm{Uniform}(D)\) is a uniform MCAR surrogate [1910.07295].

The resulting minimax objective is
\[
\min_{h\in\mathcal H}\max_{\phi\in\mathcal H}
\left\{
L_{\mathrm{pred}}(h)+\beta\cdot L_{\mathrm{adv}}(\phi;h)+\lambda\cdot\Omega(h)
\right\},
\]
with
\[
L_{\mathrm{pred}}(h):=\hat L_{\mathrm{naive}}(h;O),
\qquad
L_{\mathrm{adv}}(\phi;h):=\hat L_{\mathrm{naive}}(\phi;O')-\hat L_{\mathrm{naive}}(\phi;O).
\]
The critic \(\phi\) is a second copy of the rating-prediction model, for example a rank-\(d\) factorization \(U'V'^\top\), and optimization alternates between predictor and critic updates using MNAR minibatches and uniform minibatches. The central point is that the theory and algorithm do not require a propensity estimation procedure [1910.07295].

In the CIPW line, the supplied RA-IPS description is different again. Coarse IPW first coarsens the covariate space by a partition \((S,N)\), where \(S=\{S_1,S_2,\dots\}\) is a collection of disjoint measurable subsets of \(\mathbb R^d\) and \(N\) is the remainder. For each block \(S_j\), the coarse propensity is \(e(S_j)=\Pr[T=1\mid X\in S_j]\). The CIPW estimator is
\[
\tau_{S,N}(C;e)
=
\frac{1}{n\cdot(1-D(N))}
\sum_{i:X_i\notin N}
\left[
\frac{T_iY_i}{e(S(X_i))}
-
\frac{(1-T_i)Y_i}{1-e(S(X_i))}
\right].
\]
The data-dependent algorithm splits the sample into \(C_1,C_2\), uses \(C_1\) to cover approximate \(\beta\)-outliers by \(\ell_\infty\)-balls of radius \(\alpha\), creates singleton blocks for remaining non-outlier points in \(C_2\), sends residual points to \(N\), and then performs a fractional re-weighting step so that each ball’s outlier fraction is approximately its overall outlier fraction. The output is a fractional CIPW estimator \(\tau_A=\tau_{S,N,w}(C_2;e)\) [2410.01658].

## 5. Theoretical guarantees

The uplift paper states two central claims. First, access to the true propensity scores ensures ITE identifiability even with unobserved confounders. Second, Proposition 4 gives the global moment constraint
\[
\mathbb{E}\bigl[t_i/\pi(x_i,u_i)\bigr]
=
\mathbb{E}\bigl[(1-t_i)/(1-\pi(x_i,u_i))\bigr]
=1,
\]
and hence
\[
\frac1N\sum_i(w_i-\tilde w_i)\xrightarrow{p}0.
\]
Theorem 5 then gives a generalization bound under bounded loss \(C_1\), bounded weights \(C_2\), function class \(\mathcal F\), and empirical Rademacher complexity \(\mathcal R(\mathcal F)\), with the paper stating in particular that as \(N\to\infty\) the estimation error vanishes at a rate governed by \(\mathcal R(\mathcal F)\) and the sample size [2606.27114].

The recommender formulation likewise centers theory rather than heuristic reweighting. The cited theorem states that, with probability at least \(1-\delta\) over \(O\sim P\) and \(O'\sim\mathrm{Uniform}(D)\), the population risk satisfies
\[
L(\hat H)\le
\hat L_{\mathrm{naive}}(\hat H;O)
+\mathrm{Disc}(\hat H)
+2L\cdot(3\,R(\mathcal H)+2\,R(\mathcal H))
+3\Delta\cdot \sqrt{\log(6/\delta)/(2M)}.
\]
The critical feature is that no true propensities \(P_{u,i}\) appear in this bound. In the supplied interpretation, adversarial minimization of the discrepancy term drives MNAR samples to look “uniform” to the predictor’s loss, so that the true population loss remains controlled even though \(P\) is never known [1910.07295].

The CIPW formulation establishes a different robustness result. Under Lipschitzness of \(\mu_t(x)=\mathbb E[Y(t)\mid X=x]\), sparsity of extreme scores, and isolation of outliers, the simplified main guarantee states that, given \(\|\hat e-e\|_\infty\le \varepsilon\le \beta/10\) and \(n\gg 1/(\rho^2\beta)\),
\[
\mathrm{RMSE}(\tau_A)\le C\cdot(\alpha L+\rho+\varepsilon)+O(1/\sqrt n).
\]
The same description states: bias \(\le O(\alpha L+\rho+\varepsilon/\beta)\), variance \(\le O(1/(n\beta))\), and hence CI width at fixed level \(\lesssim O(\alpha L+\rho+\varepsilon/\beta+1/\sqrt{n\beta})\). It also states that standard IPW or doubly robust estimators satisfy
\[
\mathrm{RMSE}_{\mathrm{robust}}(\mathrm{IPW})=\Omega(1)
\]
under \(\varepsilon\)-inaccurate propensities, whereas no data-independent CIPW estimator can be robust to inaccuracies [2410.01658].

Taken together, these guarantees show that “robustness” is formalized differently across the three settings: identifiability and bounded excess risk in uplift, propensity-independent generalization in recommender learning, and robustness of RMSE or CI width in coarsened IPW.

## 6. Empirical behavior, tuning, and interpretive issues

For uplift modeling, the reported datasets are CRITEO-UPLIFT and LAZADA, both masked to simulate hidden confounders, together with production e-commerce campaign data with real unobserved confounders. The reported metrics are LIFT@30, AUUC, QINI, and PUC. The paper states that CHAUN and RA-IPS demonstrate superiority over state-of-the-art uplift models, with relative improvements of up to \(25.6\%\) in QINI scores, and that RA-IPS further enhances robustness, outperforming standard IPS by \(5.4\%\) under unobserved confounding. More specifically, under confounding simulation, BaseNet+IPS versus BaseNet+RA-IPS shows QINI increasing from \(0.1592\) to \(0.1621\) on CRITEO-masked, while CHAUN+IPS versus CHAUN+RA-IPS shows QINI increasing from \(0.1658\) to \(0.1704\) on CRITEO-masked and up to \(+5.4\%\) on the Production dataset [2606.27114].

The same uplift study provides explicit practical guidance. The hyperparameter \(\Gamma\) controls the box bounds \([a_i,b_i]\); one starts at \(\Gamma=1\) and increases slowly, for example \(1.1,1.2,\dots\), until empirical performance ceases to improve. The global deviation control \(\varepsilon_N\) may be set as \(\varepsilon_N\approx c/\sqrt N\) for small constant \(c\). The penalty coefficient \(\lambda\) weights the squared-drift term, and a small \(\lambda\), for example \(0.1\)–\(1\), is stated to suffice. Computationally, each mini-batch update adds an inner loop of up to \(K\) gradient-ascent steps in \(W\), with projection onto \([a_i,b_i]\) costing \(O(B)\) per batch of size \(B\) and the global constraint projection also \(O(B)\), so the additional per-batch cost is linear in \(B\). Tuning can be performed by simulating hidden confounding, for example by masking a subset of covariates, and selecting \(\Gamma,\lambda\) to maximize a held-out uplift metric such as QINI or AUUC [2606.27114].

In the recommender setting, validation is described in terms of Mean-Squared Error on a held-out MCAR test set and ranking metrics such as NDCG@K and Recall@K. The paper states that the adversarial approach is superior to a range of existing methods in both rating prediction and ranking metrics in practical settings without MCAR data [1910.07295]. In the CIPW setting, the principal validation target is confidence-interval size or RMSE rather than ranking or uplift, with the central comparison being to standard IPW variants, trimmed IPW, doubly robust estimators, and data-independent coarsenings [2410.01658].

A recurring misconception is that RA-IPS always means “estimate a better propensity score.” That is not the uniform pattern in the cited literature. The uplift RA-IPS perturbs nominal inverse-propensity weights adversarially within an uncertainty set; the recommender RA-IPS explicitly avoids any propensity estimation procedure; and the CIPW variant achieves robustness through data-dependent coarsening of the covariate space. Another misconception is that robustness is assumption-free. The cited guarantees rely, respectively, on overlap and boundedness conditions, a Rademacher-complexity generalization analysis, or assumptions such as Lipschitzness, sparsity of extreme scores, and isolation of outliers.

Source: https://www.emergentmind.com/topics/robust-adversarial-inverse-propensity-score-ra-ips