---
title: 'CausalMACE: Mixture-of-Experts for CACE'
url: https://www.emergentmind.com/topics/causalmace
type: topic
---

# CausalMACE: Mixture-of-Experts for CACE

CausalMACE is the causal inference method introduced in “Estimating Complier Average Causal Effects with Mixtures of Experts,” where the name combines **Causal** with **MACE**, short for **Mixture-of-Experts for the Complier Average Causal Effect (CACE)**. It is a mixture-of-experts architecture for randomized experiments with treatment non-compliance, in which principal strata are treated as latent classes, a gating network estimates stratum membership probabilities from covariates, and expert networks model stratum-specific potential outcomes. Its central purpose is to estimate the complier effect without relying on the classical instrumental-variable assumptions of monotonicity and exclusion restriction, replacing them with principal ignorability and structural mixture modeling [2405.02779].

## 1. Causal formulation and target estimand

CausalMACE is formulated for experiments with baseline covariates \(X\), randomized assignment \(Z \in \{0,1\}\), actual treatment taken \(T \in \{0,1\}\), and observed outcome \(Y\). Randomization is modeled as \(Z \mid X \sim \text{Bernoulli}(\eta(X))\), with allocation ratio \(\eta(X) \in (\epsilon_\eta,1-\epsilon_\eta)\). The methodological difficulty is that assignment and treatment can differ, so the intention-to-treat contrast in \(Z\) is generally not the scientific quantity of interest when non-compliance is substantial [2405.02779].

The method adopts the principal-stratification view. Four latent compliance types are defined: compliers, always-takers, never-takers, and defiers. These are represented by a one-hot latent vector
\[
\boldsymbol{S} = (S_c,S_a,S_n,S_d)^T,
\]
with \(S_k \in \{0,1\}\) and \(\sum_k S_k = 1\). Their covariate-dependent probabilities,
\[
\rho_k(X) = \mathbb{E}[S_k \mid X], \qquad k \in \{c,a,n,d\},
\]
are the core outputs of the gating network. Treatment actually taken is written as
\[
T = S_c Z + S_a + S_d(1-Z),
\]
so compliers satisfy \(T=Z\), always-takers satisfy \(T=1\), never-takers satisfy \(T=0\), and defiers satisfy \(T=1-Z\) [2405.02779].

The target estimand is the complier average causal effect,
\[
\text{CACE} \equiv \Delta = \mathbb{E}[Y^{t=1} - Y^{t=0} \mid S_c = 1].
\]
To accommodate violations of exclusion restriction, the framework uses elementary potential outcomes \(Y^{s=k,z=l,t=m}\), which allow outcomes to depend separately on assignment and treatment. Consistency is stated as
\[
Y = T Y^{t=1} + (1-T)Y^{t=0}.
\]
Under principal ignorability and positivity of compliers, the paper derives the key decomposition
\[
\Delta = \frac{\mathbb{E}\!\left[\{Q_{c11}(X)-Q_{c00}(X)\}\rho_c(X)\right]}{\mathbb{E}[\rho_c(X)]},
\]
where \(Q_{c11}(X)=\mathbb{E}[Y^{s=c,z=1,t=1}\mid X]\) and \(Q_{c00}(X)=\mathbb{E}[Y^{s=c,z=0,t=0}\mid X]\). Estimating CACE is therefore reduced to estimating the complier probability \(\rho_c(X)\) and the two complier outcome regressions \(Q_{c11}(X)\) and \(Q_{c00}(X)\) [2405.02779].

## 2. Identification strategy relative to classical IV

The standard LATE or IV formulation for CACE uses four assumptions: instrument relevance, instrument exogeneity, monotonicity, and exclusion restriction. Under these assumptions, CACE is identified by the Wald estimator. The paper’s starting point is that, in many applications, monotonicity can fail because defiers exist, and exclusion restriction can fail because assignment can have direct or placebo effects. In those settings, classical IV can be biased or only partially identifying [2405.02779].

CausalMACE departs from this framework in two explicit ways. First, it does **not require monotonicity**: defiers are retained as a distinct latent stratum and enter the treatment model through \(\mu_d(Z)=1-Z\). Second, it does **not require exclusion restriction**: elementary potential outcomes retain separate \(z\) and \(t\) arguments, so assignment may affect outcomes beyond treatment receipt. The method instead relies on **principal ignorability**, consisting of \(Z \perp \boldsymbol{S} \mid X\) and \(Y^{s=k,z=l,t=m} \perp \boldsymbol{S} \mid X\), together with positivity of compliers, \(\rho_c(X)>\epsilon_\rho>0\) [2405.02779].

This reallocation of assumptions is central to the method’s logic. Rather than imposing behavioral restrictions such as “no defiers” or “no direct assignment effects,” CausalMACE imposes a covariate-driven latent-mixture structure. The paper explicitly characterizes this as a trade of classical IV assumptions for modeling assumptions in a machine-learning spirit. A plausible implication is that the method is most attractive when rich covariates are available and monotonicity or exclusion restriction is substantively doubtful [2405.02779].

## 3. Mixture-of-experts parameterization

The first mixture-of-experts component models treatment receipt. Define
\[
\pi(X,Z) \equiv \mathbb{E}[T \mid X,Z].
\]
Lemma 4 shows that
\[
\pi(X,Z)=\sum_{k \in \{c,a,n,d\}} \rho_k(X)\mu_k(Z),
\]
where the experts are fixed and known:
\[
\mu_c(Z)=Z,\qquad \mu_a(Z)=1,\qquad \mu_n(Z)=0,\qquad \mu_d(Z)=1-Z.
\]
Thus,
\[
T \mid X,Z \sim \text{Bernoulli}\!\left(\sum_k \rho_k(X)\mu_k(Z)\right),
\]
and the unknown part of the first mixture is entirely the gating function \(\rho(X)\). In the parametric version,
\[
\rho_k(X;\delta)=\frac{\exp(\delta_k^T X)}{\sum_{l \in \{c,a,n,d\}}\exp(\delta_l^T X)},
\]
so the gating network is a softmax over the four strata [2405.02779].

The second mixture-of-experts component models observed outcomes inside the two informative cells \((Z,T)=(1,1)\) and \((0,0)\). Let
\[
q_{11}(X)=\mathbb{E}[Y \mid Z=1,T=1,X], \qquad q_{00}(X)=\mathbb{E}[Y \mid Z=0,T=0,X].
\]
These decompose as
\[
q_{11}(X)=P_{c11}(X)Q_{c11}(X)+P_{a11}(X)Q_{a11}(X),
\]
\[
q_{00}(X)=P_{c00}(X)Q_{c00}(X)+P_{n00}(X)Q_{n00}(X),
\]
where the gating weights inside each cell are known functions of the first-step estimates:
\[
P_{c11}(X)=\frac{\rho_c(X)}{\rho_c(X)+\rho_a(X)},\qquad
P_{a11}(X)=\frac{\rho_a(X)}{\rho_c(X)+\rho_a(X)},
\]
\[
P_{c00}(X)=\frac{\rho_c(X)}{\rho_c(X)+\rho_n(X)},\qquad
P_{n00}(X)=\frac{\rho_n(X)}{\rho_c(X)+\rho_n(X)}.
\]
Accordingly, the outcome model is a known-gating two-expert mixture in each observed cell [2405.02779].

The expert functions \(Q_{kll}(X)\) are parametric or nonparametric outcome regressions. For binary outcomes, the paper uses logistic GLMs,
\[
Q_{kll}(X;\theta)=\expit(\theta^T X),
\]
and for continuous outcomes it uses linear-Gaussian models,
\[
Q_{kll}(X;\theta)=\theta^T X,
\]
with residual variance. Theoretical identifiability results are established for these mixtures when the expert functions are linear or expit functions. This architecture is the sense in which the method is a genuine mixture-of-experts estimator rather than a relabeled IV estimator [2405.02779].

## 4. Estimation, identifiability, and asymptotics

CausalMACE is estimated in three components. Step 1 estimates the compliance-type gating network \(\rho_k(X)\). Step 2 estimates the expert outcome functions \(Q_{c11}\) and \(Q_{c00}\) together with their companion experts \(Q_{a11}\) and \(Q_{n00}\). The final step substitutes these nuisance estimates into the principal-ignorability plug-in estimator
\[
\widehat{\Delta}_{PI}
=
\frac{\sum_{i=1}^n \{\hat Q_{c11}(X_i)-\hat Q_{c00}(X_i)\}\hat\rho_c(X_i)}
{\sum_{i=1}^n \hat\rho_c(X_i)}.
\]
The paper describes this estimator as a **partial M-estimator** under correct parametric specification and regularity conditions [2405.02779].

Both major fitting stages are carried out by dedicated EM algorithms. In Step 1, stratum labels are treated as latent; the E-step computes posterior responsibilities \(h_{k,i}=\mathbb{P}(S_k=1 \mid X_i,Z_i,T_i)\), and the M-step updates \(\rho_k(\cdot)\) through multinomial logistic regression with soft labels. In Step 2, the latent labels are “complier versus always-taker” in cell \(11\) and “complier versus never-taker” in cell \(00\); the E-step computes posterior responsibilities, and the M-step fits weighted GLMs or weighted regressions for the experts. Nonparametric variants replace multinomial logistic regression and GLMs with more flexible learners while preserving the EM-like weighting scheme [2405.02779].

The theoretical contribution is unusually explicit for a flexible latent-mixture causal method. Theorem 4.1 gives identifiability of the treatment mixture \(\pi(X,Z)=\sum_k \rho_k(X)\mu_k(Z)\) under mild conditions. Theorems 4.2 and 4.3 establish identifiability of the outcome mixtures for linear and logistic expert functions, respectively. In the appendix, the paper shows that \(\widehat{\Delta}_{PI}\) and the nuisance parameters jointly solve a stacked system of estimating equations, leading to
\[
\sqrt{n}(\widehat{\Delta}_{PI}-\Delta_0)\xrightarrow{d}\mathcal{N}(0,\sigma^2).
\]
Thus the estimator is \(\sqrt{n}\)-consistent and asymptotically normal, with variance estimated in practice by the nonparametric bootstrap [2405.02779].

## 5. Specialized regimes, simulations, and the PROBIT trial

Although the general formulation allows both defiers and direct assignment effects, the paper also defines specialized estimators for restricted regimes. Setting \(\rho_d(\cdot)\equiv 0\) yields a monotonicity-only version, \(\widehat{\Delta}_{PI,MO}\). Adding exclusion restriction yields further simplifications and the estimator \(\widehat{\Delta}_{PI,MO}^{ER}\). Separate algorithms are also given for ER-only regimes. These restricted versions are not the primary proposal, but they clarify how the general model nests more classical cases and can gain efficiency when stronger assumptions are credible [2405.02779].

The simulations consider four scenarios: neither monotonicity nor ER holds; ER holds but monotonicity fails; monotonicity holds but ER fails; and both monotonicity and ER hold. The data-generating process uses 14 correlated covariates, specifically 7 Bernoulli and 7 log-normal variables, with sample sizes \(n=2000,5000,10000\). The comparisons include \(\widehat{\Delta}_{PI}\), \(\widehat{\Delta}_{PI}^{ER}\), \(\widehat{\Delta}_{PI,MO}\), \(\widehat{\Delta}_{PI,MO}^{ER}\), and two classical IV benchmarks, the Wald estimator and IV matching, under both correct specification and misspecification induced by dropping important covariates [2405.02779].

The main empirical pattern is consistent across the scenarios. When IV assumptions hold, IV estimators perform very well, and \(\widehat{\Delta}_{PI,MO}^{ER}\) is close in RMSE. When IV assumptions fail, Wald and matching show very large biases, on the order of roughly 40–60 percentage points, whereas CausalMACE estimators have much smaller bias and substantially lower RMSE, including under misspecification. In Scenario 1, where neither monotonicity nor ER holds, \(\widehat{\Delta}_{PI}\) has the lowest RMSE among the CausalMACE estimators; in Scenario 3, where monotonicity holds but ER fails, \(\widehat{\Delta}_{PI,MO}\) is best. The variance is reported to scale roughly like \(1/n\), consistent with the \(\sqrt{n}\)-rate, and \(\widehat{\Delta}_{PI}\) often has the smallest variance [2405.02779].

The real-data illustration uses the Promotion of Breastfeeding Intervention Trial (PROBIT), a large randomized trial in Belarus. Assignment \(Z\) is breastfeeding promotion versus standard care, treatment \(T\) is actual attendance at the breastfeeding program, outcome \(Y\) is infant weight at 3 months dichotomized at 6000g, and \(X\) includes baseline covariates such as location, education, maternal allergy, smoking, C-section, sex of child, mother’s age, and birth weight. The intention-to-treat ATE of assignment on \(Y\) is about 0.07, but 36% of those assigned to the program did not attend, making compliance-sensitive estimands relevant. The IV-based CACE, under monotonicity and ER, is about 0.11 with tight confidence intervals; \(\widehat{\Delta}_{PI}\), which assumes neither monotonicity nor ER, is about 0.20 with wider confidence intervals. The paper interprets this gap as plausible because assignment to a breastfeeding program may have direct behavioral or psychological effects and because monotonicity may be violated if some mothers respond adversely to institutional encouragement [2405.02779].

## 6. Practical considerations and nomenclature

The implementation guidance in the paper is modular. It recommends starting with a multinomial logistic model for \(\rho_k(X)\), then fitting GLM-based or more flexible expert regressions for \(Q_{kll}(X)\), estimating the model in two stages via EM, and finally computing \(\widehat{\Delta}_{PI}\) with bootstrap confidence intervals. It also emphasizes that covariates should include variables suspected to explain both compliance behavior and outcomes, that the number of strata is fixed by design at four, and that convergence monitoring for the EM algorithm should focus on log-likelihood and parameter stability. Joint estimation of all components is explicitly not recommended because of identifiability issues [2405.02779].

The principal limitation is the strength of principal ignorability: conditional on \(X\), all variables jointly affecting compliance type and potential outcomes must be measured. The paper also notes that misspecification of \(\rho\) or \(Q\) can bias CACE, that scalability to very high-dimensional \(X\) may require regularization or modern machine-learning methods, that nonparametric identifiability is not yet fully characterized, and that extensions to multi-arm trials, longitudinal compliance, or censoring require further development. This suggests that CausalMACE is best viewed as a theoretically grounded middle ground between classical IV estimators and fully nonparametric principal-stratification models [2405.02779].

The term “CausalMACE” is not unique in the broader arXiv literature. It has also been used informally for the **Model-Averaged Causal Estimation Transformer Neural Process (MACE-TNP)**, a meta-learned estimator of Bayesian model-averaged interventional distributions under uncertain causal graphs [2507.05526], and it appears as the title of **“CausalMACE: Causality Empowered Multi-Agents in Minecraft Cooperative Tasks”**, a causality-aware multi-agent planning framework for Minecraft [2508.18797]. In the sense defined here, however, CausalMACE denotes the mixture-of-experts method for estimating CACE under treatment non-compliance introduced in [2405.02779].

Source: https://www.emergentmind.com/topics/causalmace