Multiple sequences Prophet Inequality Under Observation Constraints (2402.02059v1)
Abstract: In our problem, we are given access to a number of sequences of nonnegative i.i.d. random variables, whose realizations are observed sequentially. All sequences are of the same finite length. The goal is to pick one element from each sequence in order to maximize a reward equal to the expected value of the sum of the selections from all sequences. The decision on which element to pick is irrevocable, i.e., rejected observations cannot be revisited. Furthermore, the procedure terminates upon having a single selection from each sequence. Our observation constraint is that we cannot observe the current realization of all sequences at each time instant. Instead, we can observe only a smaller, yet arbitrary, subset of them. Thus, together with a stopping rule that determines whether we choose or reject the sample, the solution requires a sampling rule that determines which sequence to observe at each instant. The problem can be solved via dynamic programming, but with an exponential complexity in the length of the sequences. In order to make the solution computationally tractable, we introduce a decoupling approach and determine each stopping time using either a single-sequence dynamic programming, or a Prophet Inequality inspired threshold method, with polynomial complexity in the length of the sequences. We prove that the decoupling approach guarantees at least 0.745 of the optimal expected reward of the joint problem. In addition, we describe how to efficiently compute the optimal number of samples for each sequence, and its' dependence on the variances.
- S. Alaei, “Bayesian combinatorial auctions: Expanding single buyer mechanisms to many buyers,” SIAM Journal on Computing, vol. 43, no. 2, pp. 930–972, 2014.
- M. Feldman, N. Gravin, and B. Lucier, “Combinatorial auctions via posted prices,” in Proceedings of the twenty-sixth annual ACM-SIAM symposium on Discrete algorithms. SIAM, 2014, pp. 123–135.
- J. Correa, P. Foncea, R. Hoeksma, T. Oosterwijk, and T. Vredeveld, “Posted price mechanisms for a random stream of customers,” in Proceedings of the 2017 ACM Conference on Economics and Computation, 2017, pp. 169–186.
- E. Lee and S. Singla, “Optimal online contention resolution schemes via ex-ante prophet inequalities,” in 26th Annual European Symposium on Algorithms, ESA 2018, August 20-22, 2018, Helsinki, Finland, vol. 112, 2018, pp. 57:1–57:14.
- Z. Huang, J. A. Joao, A. Rico, A. D. Hilton, and B. C. Lee, “Dynasprint: Microarchitectural sprints with dynamic utility and thermal management,” in Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture, 2019, pp. 426–439.
- M. Epitropou and R. Vohra, “Optimal on-line allocation rules with verification,” in Algorithmic Game Theory: 12th International Symposium, SAGT 2019, Athens, Greece, September 30–October 3, 2019, Proceedings 12. Springer, 2019, pp. 3–17.
- S. Nitinawarat, G. K. Atia, and V. V. Veeravalli, “Controlled sensing for multihypothesis testing,” IEEE Transactions on automatic control, vol. 58, no. 10, pp. 2451–2464, 2013.
- Q. Xu, Y. Mei, and G. V. Moustakides, “Optimum multi-stream sequential change-point detection with sampling control,” IEEE Transactions on Information Theory, vol. 67, no. 11, pp. 7627–7636, 2021.
- U. Krengel and L. Sucheston, “On semiamarts, amarts, and processes with finite value,” Probability on Banach spaces, vol. 4, pp. 197–266, 1978.
- D. Assaf and E. Samuel-Cahn, “Simple ratio prophet inequalities for a mortal with multiple choices,” Journal of applied probability, vol. 37, no. 4, pp. 1084–1091, 2000.
- J. Correa, R. Saona, and B. Ziliotto, “Prophet secretary through blind strategies,” Mathematical Programming, vol. 190, no. 1-2, pp. 483–521, 2021.
- A. Bubna and A. Chiplunkar, “Prophet inequality: Order selection beats random order,” in Proceedings of the 24th ACM Conference on Economics and Computation, 2023, pp. 302–336.
- R. P. Kertz, “Stop rule and supremum expectations of iid random variables: a complete comparison by conjugate duality,” Journal of multivariate analysis, vol. 19, no. 1, pp. 88–112, 1986.
- J. Royston, “Algorithm as 177: Expected normal order statistics (exact and approximate),” Journal of the royal statistical society. Series C (Applied statistics), vol. 31, no. 2, pp. 161–165, 1982.
- D. Dominici, “Some properties of the inverse error function,” Contemporary Mathematics, vol. 457, pp. 191–204, 2008.