A Correlation-induced Finite Difference Estimator
Abstract: Finite difference (FD) approximation is a classic approach to stochastic gradient estimation when only noisy function realizations are available. In this paper, we first provide a sample-driven method via the bootstrap technique to estimate the optimal perturbation, and then propose an efficient FD estimator based on correlated samples at the estimated optimal perturbation. Furthermore, theoretical analyses of both the perturbation estimator and the FD estimator reveal that, {\it surprisingly}, the correlation enables the proposed FD estimator to achieve a reduction in variance and, in some cases, a decrease in bias compared to the traditional optimal FD estimator. Numerical results confirm the efficiency of our estimators and align well with the theory presented, especially in scenarios with small sample sizes. Finally, we apply the estimator to solve derivative-free optimization (DFO) problems, and numerical studies show that DFO problems with 100 dimensions can be effectively solved.
- Stochastic Simulation: Algorithms and Analysis. Springer, 2007.
- Online learning and optimization for queues with unknown demand curve and service distribution. arXiv preprint arXiv:2303.03399, 2023.
- Replication schemes for limiting expectations. Probability in the Engineering and Informational Sciences, 3(3):299–318, 1989.
- Michael C Fu. Gradient estimation. Handbooks in Operations Research and Management Science, 2006.
- Stochastic first- and zeroth-order methods for nonconvex stochastic programming. SIAM Journal on Optimization, 23(4):2341–2368, 2013.
- Paul Glasserman. Monte Carlo Methods in Financial Engineering. Springer Science & Business Media, 2013.
- Peter W. Glynn. Likelihood ratio gradient estimation for stochastic systems. Communications of the ACM, 33(10):75–84, 1990.
- Fumio Hayashi. Econometrics. Princeton University Press, 2011.
- Convergence properties of infinitesimal perturbation analysis estimates. Management Science, 34(11):1281–1302, 1988.
- Measure-Valued differentiation for stationary markov chains. Mathematics of Operations Research, 31(1):154–172, 2006.
- Gradient estimation for discrete-event systems by measure-valued differentiation. ACM Transactions on Modeling and Computer Simulation, 20(1):1–28, 2010.
- Infinitesimal and finite perturbation analysis for queueing networks. Automatica, 19(4):439–445, 1983.
- Stochastic estimation of the maximum of a regression function. The Annals of Mathematical Statistics, 23(3):462–466, 1952.
- Queueing Systems: Problems and Solutions. Wiley-Interscience, 1996.
- Enhanced balancing of bias-variance tradeoff in stochastic estimation: A minimax perspective. Operations Research, 2022.
- Pierre L’Ecuyer. An overview of derivative estimation. In 1991 Winter Simulation Conference Proceedings. IEEE.
- Optimally tuning finite-difference estimators. In 2020 Winter Simulation Conference (WSC). IEEE, 2020.
- Kernel estimation of the Greeks for options with discontinuous payoffs. Operations Research, 59(1):96–108, 2011.
- Random gradient-free minimization of convex functions. Foundations of Computational Mathematics, 17(2):527–566, 2015.
- A new unbiased stochastic derivative estimator for discontinuous sample performances with structural parameters. Operations Research, 66(2):487–499, 2018.
- Sensitivity analysis for simulations via likelihood ratios. Operations Research, 37(5):830–844, 1989.
- A stochastic approximation method. The Annals of Mathematical Statistics, 22(3):400–407, 1951.
- Reuven Y. Rubinstein. The score function approach for sensitivity analysis of computer simulation models. Mathematics and Computers in Simulation, 28(5):351–379, 1986.
- On the numerical performance of finite-difference-based methods for derivative-free optimization. Optimization Methods and Software, 38(2):289–311, 2023.
- James C. Spall. Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Transactions on Automatic Control, 37(3):332–341, 1992.
- Convergence rates of finite-difference sensitivity estimates for stochastic systems. Operations Research, 41(4):694–703, 1993.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
