On Learning for Ambiguous Chance Constrained Problems (2401.00547v2)
Abstract: We study chance constrained optimization problems $\min_x f(x)$ s.t. $P(\left{ \theta: g(x,\theta)\le 0 \right})\ge 1-\epsilon$ where $\epsilon\in (0,1)$ is the violation probability, when the distribution $P$ is not known to the decision maker (DM). When the DM has access to a set of distributions $\mathcal{U}$ such that $P$ is contained in $\mathcal{U}$, then the problem is known as the ambiguous chance-constrained problem \cite{erdougan2006ambiguous}. We study ambiguous chance-constrained problem for the case when $\mathcal{U}$ is of the form $\left{\mu:\frac{\mu (y)}{\nu(y)}\leq C, \forall y\in\Theta, \mu(y)\ge 0\right}$, where $\nu$ is a reference distribution.'' We show that in this case the original problem can be
well-approximated'' by a sampled problem in which $N$ i.i.d. samples of $\theta$ are drawn from $\nu$, and the original constraint is replaced with $g(x,\theta_i)\le 0,~i=1,2,\ldots,N$. We also derive the sample complexity associated with this approximation, i.e., for $\epsilon,\delta>0$ the number of samples which must be drawn from $\nu$ so that with a probability greater than $1-\delta$ (over the randomness of $\nu$), the solution obtained by solving the sampled program yields an $\epsilon$-feasible solution for the original chance constrained problem.
- E. Erdoğan and G. Iyengar, “Ambiguous chance constrained problems and robust optimization,” Mathematical Programming, vol. 107, pp. 37–61, 2006.
- M. C. Campi and S. Garatti, “The exact feasibility of randomized solutions of uncertain convex programs,” SIAM Journal on Optimization, vol. 19, no. 3, pp. 1211–1230, 2008.
- M. Vidyasagar, “Statistical learning theory and randomized algorithms for control,” IEEE Control Systems Magazine, vol. 18, no. 6, pp. 69–85, 1998.
- M. C. Campi, S. Garatti, and F. A. Ramponi, “A general scenario theory for nonconvex optimization and decision making,” IEEE Transactions on Automatic Control, vol. 63, no. 12, pp. 4067–4078, 2018.
- A. Ben-Tal and A. Nemirovski, “Robust convex optimization,” Mathematics of operations research, vol. 23, no. 4, pp. 769–805, 1998.
- H.-G. Beyer and B. Sendhoff, “Robust optimization–a comprehensive survey,” Computer methods in applied mechanics and engineering, vol. 196, no. 33-34, pp. 3190–3218, 2007.
- A. Ruszczyński and A. Shapiro, “Stochastic programming models,” Handbooks in operations research and management science, vol. 10, 2003.
- G. Calafiore and M. C. Campi, “Uncertain convex programs: randomized solutions and confidence levels,” Mathematical Programming, vol. 102, pp. 25–46, 2005.
- W. Hoeffding, “Probability inequalities for sums of bounded random variables,” The collected works of Wassily Hoeffding, pp. 409–426, 1994.