Two-Step Sieve ML Estimator

• The estimator employs a two-step approach where an initial nuisance fit is obtained, followed by a refined likelihood-based optimization to achieve efficient parameter estimation.
• It converts an infinite-dimensional problem into a finite-dimensional one using sieves such as Bernstein–Kantorovich polynomials, Hermite bases, or B-splines, adapting to various model setups.
• Empirical and simulation studies demonstrate its robustness and efficiency, achieving root‑n consistency and reducing bias in multivariate copula, treatment effect, and quantitative regression models.

to=arxiv_search 天天中彩票软件 天天中彩票不中返json {"query":"\"two-step sieve\" estimator maximum likelihood semiparametric copula control function arXiv","max_results":10,"sort_by":"relevance","sort_order":"descending"}【อ่านข้อความเต็มjson to=arxiv_search to=arxiv_search ,最新高清无码专区 经彩票json {"query":"(Medovikov et al., 2024)", "max_results": 5, "sort_by":"relevance", "sort_order":"descending"} A two-step sieve ML estimator is a semiparametric estimation procedure in which an infinite-dimensional nuisance object is approximated by a finite-dimensional sieve, while estimation itself is split into two stages: a preliminary estimator or nuisance fit is obtained first, and a second-stage likelihood, pseudo-likelihood, or empirical-risk problem is then solved over the sieve space. In recent arXiv work, this architecture is used to estimate marginal parameters in multivariate models with unknown dependence (Medovikov et al., 2024), average treatment effects under single-index semiparametric models (Yu et al., 2022), and quantile regression coefficients in a triangular system with endogeneity and measurement error (Su, 20 May 2026). A closely related line of work combines a first-stage machine-learning regression with a second-stage series projection onto a data-adaptive sieve, yielding efficient plug-in estimators for pathwise differentiable functionals (Qiu et al., 2020).

1. Core two-step architecture

Across these formulations, the defining feature is the separation between nuisance recovery and final estimation. In the multivariate semiparametric model of marginal distributions and unknown copula density, the first step ignores dependence and computes the quasi-MLE

$$\hat\theta^{(0)}=\arg\max_{\theta\in\Theta}\ell_{\mathrm{marg}}(\theta),$$

whereas the second step jointly maximizes a pseudo-log-likelihood over the marginal parameter and sieve copula weights (Medovikov et al., 2024). In the single-index treatment-effect model, the first step estimates the propensity-score and outcome-regression nuisance functions by sieve-M estimation, and the second step plugs those fits into a Robinson-type least-squares estimator for the effect parameter $\alpha$ (Yu et al., 2022). In endogenous quantile regression with measurement error, the first step constructs a control function $\hat V$, either parametrically or by series regression, and the second step maximizes a sieve likelihood that integrates the generated control through copula weights (Su, 20 May 2026).

Setting	Step 1	Step 2
Multivariate marginals with unknown copula	QMLE from $\ell_{\mathrm{marg}}(\theta)$	Joint sieve MLE over $(\theta,w)$
Single-index ATE model	Sieve-ML for $(\beta,g_1)$ and $(\gamma,g_2)$	Plug-in least-squares estimator of $\alpha$
Endogenous quantile regression with measurement error	Estimate control function $\hat V$	Sieve likelihood maximization over $(b,\sigma,\gamma)$
ML + series plug-in framework	Flexible ML fit $\alpha$0	Empirical-risk projection onto a data-adaptive sieve

This recurring architecture reflects a common statistical objective: retain flexibility in the nuisance structure while recovering root-$\alpha$1 or efficiency properties for a finite-dimensional target. A plausible implication is that the “two-step” designation refers less to a single algorithm than to a design pattern for semiparametric estimation.

2. Sieve construction and parameterization

The sieve component differs across models, but in each case it converts an infinite-dimensional problem into a constrained finite-dimensional one. In the multivariate copula model, the unknown copula density $\alpha$2 is approximated by a Bernstein–Kantorovich polynomial copula,

$\alpha$3

with nonnegativity, summation, and uniform-marginal constraints on the weight tensor $\alpha$4. The resulting sieve copula has $\alpha$5 free parameters (Medovikov et al., 2024).

In the treatment-effect model, the nuisance link functions $\alpha$6 and $\alpha$7 lie in $\alpha$8, with $\alpha$9, and are expanded in the Hermite basis. Truncating the expansion at $\hat V$0 yields finite-dimensional sieve spaces

$\hat V$1

Identifiability is enforced through $\hat V$2, $\hat V$3, a nonnegative first coordinate, and a bound $\hat V$4 on the sieve coefficient vector (Yu et al., 2022).

In endogenous quantile regression with measurement error, each quantile coefficient function $\hat V$5 is approximated by a spline of order $\hat V$6 with $\hat V$7 knots on $\hat V$8, using B-spline basis functions. The second-stage parameter is $\hat V$9, where $\ell_{\mathrm{marg}}(\theta)$0 indexes the sieve approximation, $\ell_{\mathrm{marg}}(\theta)$1 parameterizes the measurement-error density, and $\ell_{\mathrm{marg}}(\theta)$2 parameterizes the copula $\ell_{\mathrm{marg}}(\theta)$3. The parameter space $\ell_{\mathrm{marg}}(\theta)$4 includes a monotonicity restriction requiring $\ell_{\mathrm{marg}}(\theta)$5 to be increasing in $\ell_{\mathrm{marg}}(\theta)$6 for all $\ell_{\mathrm{marg}}(\theta)$7 (Su, 20 May 2026).

The ML + series framework generalizes the same logic by defining a data-adaptive sieve

$\ell_{\mathrm{marg}}(\theta)$8

where $\ell_{\mathrm{marg}}(\theta)$9 is a first-stage ML fit and the basis is applied to the fitted values rather than directly to covariates. This is still a sieve, but one whose geometry is induced by the initial estimator (Qiu et al., 2020).

3. Estimation criteria in the second step

The second-step criterion is model-specific, but it always exploits the sieve approximation to recover information discarded or inaccessible in the first step. In the multivariate marginal model, the pseudo-log-likelihood is

$(\theta,w)$0

Starting at $(\theta,w)$1, the estimator solves

$(\theta,w)$2

with $(\theta,w)$3 the convex polytope of admissible copula weights (Medovikov et al., 2024).

In the single-index ATE model, the first-stage nuisance fits are obtained from two separate likelihood-type objectives: a logistic criterion for the propensity score and a least-squares criterion for the outcome regression. The second-stage estimator then uses

$(\theta,w)$4

which is the simple least-squares estimator arising after partialling out the estimated nuisance components (Yu et al., 2022).

In endogenous quantile regression with measurement error, the second-stage pseudo-likelihood for observation $(\theta,w)$5 is

$(\theta,w)$6

and the estimator maximizes the empirical average over $(\theta,w)$7 (Su, 20 May 2026). In the ML + series framework, the analogous second step is empirical-risk minimization over the data-adaptive sieve, followed by the plug-in estimator $(\theta,w)$8 (Qiu et al., 2020).

These constructions show that “ML” in the term need not always denote the same object. In some formulations it is genuine maximum likelihood or pseudo-likelihood; in others it appears as “likelihood-type” nuisance estimation followed by a plug-in target estimator.

4. Asymptotic theory and efficiency

The central theoretical motivation for two-step sieve ML methods is that they can preserve semiparametric flexibility without forfeiting asymptotic efficiency. In the multivariate copula model, the first-step QMLE is consistent but inefficient, whereas the sieve MLE is $(\theta,w)$9-consistent and asymptotically normal with covariance $(\beta,g_1)$0, and this covariance attains the semiparametric efficiency bound (Medovikov et al., 2024). The efficient score takes the form

$(\beta,g_1)$1

where $(\beta,g_1)$2 solves a least-squares projection problem in the nuisance tangent space.

In the single-index ATE model, standard sieve-M-estimation theory yields

$(\beta,g_1)$3

and similarly for the $(\beta,g_1)$4 error of the estimated link functions. Under conditions C1–C6, the effect estimator satisfies

$(\beta,g_1)$5

with influence function $(\beta,g_1)$6 (Yu et al., 2022).

The ML + series framework makes the efficiency statement especially explicit. Under Conditions A1–A3 and C1–C4, the plug-in estimator admits the expansion

$(\beta,g_1)$7

and the influence function coincides with the canonical gradient under the nonparametric model, implying asymptotic efficiency (Qiu et al., 2020).

In endogenous quantile regression with measurement error, the asymptotic normalization is $(\beta,g_1)$8, reflecting the ill-posedness encoded by the minimal eigenvalue $(\beta,g_1)$9. Consistency requires $(\gamma,g_2)$0 and $(\gamma,g_2)$1; asymptotic normality requires additional growth conditions linking $(\gamma,g_2)$2, $(\gamma,g_2)$3, and the ordinary-smoothness order of the measurement error (Su, 20 May 2026).

5. Empirical behavior and applications

The empirical results in the cited literature emphasize both efficiency gains and robustness. In simulations for semiparametric multivariate models with bivariate exponential marginals and Gaussian, Clayton, Frank, or Plackett copulas, asymptotic relative efficiency satisfies $(\gamma,g_2)$4 under independence. With strong negative dependence, $(\gamma,g_2)$5 is reported up to $(\gamma,g_2)$6–$(\gamma,g_2)$7, while $(\gamma,g_2)$8 is up to $(\gamma,g_2)$9–$\alpha$0; in three dimensions, similar patterns hold, although computational cost grows roughly as $\alpha$1 (Medovikov et al., 2024).

The same paper reports two substantive applications. In an insurance context with one censored variable, the sieve MLE produces tighter parameter estimates. In weekly $\alpha$2 Value-at-Risk forecasting for Bank of America stock returns, with models involving trading-volume change, realized volatility, or both, exceedance rates are controlled at approximately $\alpha$3 for all methods, but the sieve MLE achieves higher average censored log-scores than both QMLE and parametric FMLE, with mean gain $\alpha$4 and $\alpha$5-statistic $\alpha$6 in the bivariate case and mean gain $\alpha$7 and $\alpha$8-statistic $\alpha$9 in the trivariate case (Medovikov et al., 2024).

For the single-index ATE model, the finite-sample performance is evaluated through simulation studies and an empirical example (Yu et al., 2022). For endogenous quantile regression with measurement error, Monte Carlo simulations show that the proposed estimator markedly reduces bias relative to existing methods, and the bootstrap is proposed for inference (Su, 20 May 2026).

A recurring pattern is that the second step is most valuable when the first step deliberately sacrifices structure for robustness or tractability. This suggests why gains are minimal under independence but can be substantial when dependence, endogeneity, or latent nuisance structure is pronounced.

6. Computation, tuning, and methodological scope

The computational burden of two-step sieve ML methods is driven by basis dimension, constraints, and the need to propagate first-stage uncertainty. In the multivariate copula setting, $\hat V$0 may be selected by AIC, BIC, or cross-validation, with theory requiring $\hat V$1 and $\hat V$2. Initialization may use $\hat V$3 and either uniform weights or empirical copula histograms, while optimization may proceed via block-coordinate ascent or general-purpose constrained optimization such as interior-point or sequential quadratic programming (Medovikov et al., 2024).

In the single-index ATE model, practical optimization uses Lagrange-multiplier formulations, Newton–Raphson or quasi-Newton solvers, projection of the index vector onto the unit sphere, and alternating updates for $\hat V$4 and the least-squares coefficients (Yu et al., 2022). In the ML + series framework, the sieve dimension $\hat V$5 may be chosen by standard $\hat V$6-fold cross-validation on the series risk, and under an additional balanced-approximation condition the cross-validated choice still yields an efficient estimator (Qiu et al., 2020). In endogenous quantile regression with measurement error, the second stage uses Gauss–Legendre quadrature for the latent-$\hat V$7 integral, gradient-based optimizers such as interior-point or trust-region methods, and either analytic sandwich variance estimation or nonparametric pairs bootstrap or weighted bootstrap (Su, 20 May 2026).

Two misconceptions are addressed directly by the cited work. First, a two-step procedure is not necessarily statistically inefficient: several of these estimators are root-$\hat V$8 consistent and asymptotically efficient under their stated conditions (Medovikov et al., 2024, Qiu et al., 2020). Second, full parametric likelihood is not automatically preferable: in the copula model, full MLE is efficient only under a correct copula specification and may be biased if the copula is misspecified, whereas the sieve MLE is introduced precisely to improve over QMLE without that drawback (Medovikov et al., 2024).

A related but distinct methodology is the multi-step MLE process for ergodic diffusion, where a preliminary estimator from a short learning interval is followed by one-step and two-step score corrections. That construction is asymptotically efficient, but it is based on repeated Le Cam one-step updates rather than on sieve approximation (Kutoyants, 2015). Its relevance is conceptual: it shows that the broader logic of a rough first step followed by a refined second step is not confined to sieve-based estimation.