missoNet: Convex Framework for mQTL Analysis
- missoNet is a convex, three-stage estimation framework that jointly models cis SNP effects and conditional CpG dependencies for regional mQTL analysis.
- It replaces unavailable empirical covariances with unbiased surrogate statistics under an MCAR missingness model, preserving convex optimization.
- The method employs sequential convex programs using Lasso, GLASSO, and FISTA, with strong theoretical guarantees and favorable empirical performance.
Searching arXiv for the specified paper and closely related context papers so the article can be grounded in current literature. missoNet is a convex, three-stage estimation framework for multivariate regression with missing response data that was introduced for sequencing-based regional DNA methylation QTL analysis. It jointly estimates a sparse regression coefficient matrix for cis SNP effects and a sparse precision matrix for residual dependence among CpG sites, thereby modeling both genetic regulation and conditional dependence within CpG blocks. Its central methodological feature is the use of unbiased surrogate statistics for masked responses, which avoids imputation while preserving convexity at each optimization stage and enabling non-asymptotic error guarantees under stated assumptions (Alam et al., 8 Jul 2025).
1. Statistical setting and inferential target
missoNet is formulated for regional mQTL analysis in which responses are transformed methylation levels at multiple CpGs within a genomic region and predictors are nearby cis SNP genotypes. The multivariate response formulation is motivated by the observation that treating a block of CpGs as a joint outcome can increase power and reveal coordinated regulation across CpGs. With samples, SNPs, and CpGs, the model is
where has standardized columns, , and satisfies and . The residual precision matrix is .
The two primary estimands are the sparse coefficient matrix 0, which encodes SNP-to-CpG effects, and the sparse precision matrix 1, whose zero off-diagonal entries encode conditional independences among CpGs under multivariate normality. This joint estimation problem places missoNet in direct continuity with multivariate regression and Gaussian graphical modeling, but specialized to the response-missingness regime that arises in bisulfite sequencing data.
A key feature of the setup is that missingness affects the responses rather than the predictors. The observed matrix is
2
where 3 independently across rows, with column-specific missing rates 4. The framework therefore assumes missing completely at random (MCAR) for responses. This assumption is structurally important because the unbiased surrogate constructions and the associated theory are derived under precisely this masking model (Alam et al., 8 Jul 2025).
2. Surrogate covariance construction under response missingness
The central obstacle is that the empirical response covariance 5 and cross-covariance 6 are unavailable when 7 is partially masked. Pairwise deletion and imputation-based strategies can yield biased or indefinite covariance estimates, which is particularly problematic when the downstream objective includes a log-determinant term.
missoNet addresses this by replacing unavailable complete-data quantities with unbiased surrogates corrected by the first and second moments of the mask. The mask moments are
8
and
9
Using these quantities, missoNet defines
0
Under MCAR, these are unbiased for 1 and 2. The predictor covariance remains the standard
3
because predictors are fully observed.
These surrogate statistics are then substituted into a missing-data analogue of the MRCE objective. For complete data, MRCE minimizes a penalized Gaussian likelihood in 4. missoNet replaces 5 and 6 with 7 and 8, yielding the surrogate objective
9
This objective is convex in either 0 or 1 when the other is fixed, provided the covariance input is positive semidefinite. The positive-semidefiniteness issue is therefore not peripheral but fundamental to the design of the full algorithm (Alam et al., 8 Jul 2025).
3. Three-stage convex estimation procedure
missoNet solves the surrogate problem through three sequential convex programs. The staged design separates sparse regression initialization, residual-network estimation, and coefficient refinement using the learned residual precision structure.
| Stage | Optimization target | Computational strategy |
|---|---|---|
| I | Initial 2 with 3 | Column-wise Lasso via coordinate descent or proximal gradient |
| II | 4 from PSD-corrected residual covariance | PSD projection, then graphical Lasso with GLASSO or QUIC |
| III | Refined 5 with fixed 6 | FISTA with Nesterov acceleration and backtracking |
Stage I fixes 7 and solves
8
This decomposes column-wise. For each response 9,
0
Stage II constructs a plug-in residual covariance
1
Because 2 may be indefinite under missingness, directly solving a graphical Lasso objective can be non-convex or unbounded. missoNet therefore projects it to the nearest positive semidefinite matrix in max norm: 3 and then estimates the precision matrix by
4
Stage III refines the coefficient matrix with 5 fixed: 6 The implementation uses FISTA with Nesterov acceleration and backtracking line search. The iterative updates are
7
with soft-thresholding
8
The Armijo condition is used for backtracking, and the convergence rate improves from 9 to 0. This staged decomposition suggests that missoNet is designed less as a monolithic block-coordinate routine than as a sequence of convex subproblems with carefully controlled inputs (Alam et al., 8 Jul 2025).
4. Tuning, assumptions, and theoretical guarantees
missoNet supports both BIC-style tuning and cross-validation. The joint BIC for selecting 1 is
2
The paper also specifies stage-specific BICs corresponding to the three estimation stages. For practical selection, a one-standard-error rule, denoted cv.1se, is recommended for parsimony and better false-discovery-rate control.
The theoretical analysis is non-asymptotic and quantifies the effects of missingness, dimensionality, sparsity, and noise. Stage I relies on a restricted eigenvalue condition for each response-specific support set 3, with cone
4
and
5
Under the stated deviation bounds and tuning condition 6, Proposition 1 yields
7
Stage II adds an irrepresentability condition for graph selection, expressed through the Kronecker matrix 8. After PSD projection, the residual covariance obeys
9
With 0, Proposition 2 gives
1
and
2
Stage III assumes a restricted eigenvalue condition for the refined matrix loss,
3
and defines
4
Theorem 1 then gives
5
The theory is explicitly tied to the assumptions that response missingness is MCAR, errors are sub-Gaussian, columns of 6 are standardized, and the missingness rates 7 are estimated from data to compute 8 and 9. This suggests that the guarantees are strong within the paper’s formal regime, but are not advertised as covering more general missing-data mechanisms (Alam et al., 8 Jul 2025).
5. Empirical behavior in simulations and CARTaGENE mQTL analysis
The simulation studies examine both scaling behavior and direct method comparison. Under AR(1) errors and MCAR masks, Stage I error 0 decreases at 1, increases with 2, and grows with missingness 3. Stage II precision error 4 scales like 5 and grows with missingness and response dimension 6. Stage III coefficient error 7 improves over Stage I uniformly and scales like 8 and 9, with clearer benefits when residual correlation 0 is high. For 1, at 2 and 3, the Stage I error is 4 versus Stage III 5; at 6, the corresponding values are 7 versus 8. The paper also notes that at 9 missingness with small 0, Stage III may underperform Stage I, but improves with larger 1.
Across comparative experiments involving MRCE, Lasso, cglasso, and missoNet variants, missoNet [cv.min] consistently achieves the lowest prediction error for 2. In Model 1 with 3 missingness, the reported prediction errors are missoNet 4, MRCE 5, and Lasso 6. For network estimation, missoNet [BIC] often attains the lowest KLL; for example, in Model 2 with 7 missingness, the reported KLL is 8. For sparsity recovery of 9, missoNet [cv.1se] yields high TPR, excellent TNR, and top MCC; in Model 1 with 00 missingness, the reported TNR is 01 and MCC is 02. Computation is also favorable: missoNet [BIC] is reported as fast due to convex programs, warm starts, local search, and parallelization, whereas MRCE is slow in all settings and cglasso is generally slower, becoming faster only in some high-dimensional instances.
The real-data analysis uses 202 adults from CARTaGENE with targeted bisulfite sequencing methylomes. Preprocessing regressed CpG methylation residuals on cohort, ACPA status, age, sex, and a cell composition proxy. Residuals were grouped into 62 candidate CpG regions, and nearby SNPs within 03 kb were considered after an initial univariate screen at 04. Training used 115 high-depth samples and independent validation used 87 earlier samples. Average missingness was approximately 05 in training and 06 in validation, with an additional 07 MCAR masking applied on complete CpGs for robustness.
On validation, missoNet [cv.1se] achieved the best mean squared prediction error:
- missoNet [cv.1se]: 08
- Lasso [cv.1se]: 09
- MRCE [cv.min]: 10
- cglasso [BIC]: 11
For out-of-sample log-likelihood, cglasso [BIC] had the highest value at 12 but the worst MSE, while missoNet [BIC] achieved 13 with over-dense networks and missoNet [cv.1se] achieved 14, which the study characterizes as balancing fit and parsimony. False discovery checks using 10 synthetic null SNPs per region showed that missoNet [cv.1se] attained
15
with 16 and 17. By contrast, Lasso [cv.min] retained many dummy SNPs, with 18. Across 9,238 CpG-SNP pairs tested in 16 illustrative regions, missoNet [cv.1se] selected 957 nonzero associations, of which 841 (19) matched known mQTLs from Gaunt et al. 2016 or involved CpGs within 100 bp of known mQTL sites. Some regions had no associations, including chr20:32,255,222–32,255,294, while others, including chr1:8,958,863–8,959,033, yielded novel candidates for follow-up (Alam et al., 8 Jul 2025).
6. Software implementation, operational guidance, and scope
missoNet is available as an R package on CRAN via install.packages("missoNet"). The package takes fully observed 20 with standardized columns and 21 with missing responses set to zero, together with a mask or inferred missingness probabilities 22. It internally computes 23, 24, and 25. The principal outputs are 26, 27, 28, and 29, along with fit diagnostics such as BIC grids, cross-validation errors, and plotting utilities including a BIC heatmap. Tuning can be specified by "cv" or "BIC", with options including nlambda, lambda.min.ratio, warm starts, fast=TRUE for local search, and parallel=TRUE for parallelization (Alam et al., 8 Jul 2025).
The package defines maximal regularization values as
30
and then constructs logarithmic sequences to smaller values. Operationally, Stage I consists of 31 independent Lasso fits, Stage II uses graphical Lasso on the PSD-corrected residual covariance, and Stage III uses FISTA with backtracking and stopping criteria based on the Armijo condition and relative change thresholds. The paper emphasizes that warm starts, local search, and parallelization reduce runtime substantially, with missoNet [BIC] being the fastest setting and cross-validation trading additional cost for generalizability.
Several limitations are explicit. The missingness model is MCAR for responses; the theory assumes sub-Gaussian errors, restricted eigenvalue conditions, and irrepresentability for graph selection; and estimation of the column-specific missing rates 32 is required. The empirical studies further indicate that very high missing rates, such as at least 33, combined with small sample size can limit the gains of Stage III refinement. A plausible implication is that missoNet is best matched to moderate-to-high-dimensional genomic settings where missingness is substantial but not overwhelming, and where conditional dependence among responses is biologically meaningful.
The name has a separate usage in collider-physics literature: the DeepMET study refers to a “missoNet”-style per-particle weighting design for missing transverse momentum estimation, which is distinct from the genomic regression framework described here (Collaboration, 15 Sep 2025).