Online Uniform Sampling: Randomized Learning-Augmented Approximation Algorithms with Application to Digital Health (2402.01995v6)
Abstract: Motivated by applications in digital health, this work studies the novel problem of online uniform sampling (OUS), where the goal is to distribute a sampling budget uniformly across unknown decision times. In the OUS problem, the algorithm is given a budget $b$ and a time horizon $T$, and an adversary then chooses a value $\tau* \in [b,T]$, which is revealed to the algorithm online. At each decision time $i \in [\tau*]$, the algorithm must determine a sampling probability that maximizes the budget spent throughout the horizon, respecting budget constraint $b$, while achieving as uniform a distribution as possible over $\tau*$. We present the first randomized algorithm designed for this problem and subsequently extend it to incorporate learning augmentation. We provide worst-case approximation guarantees for both algorithms, and illustrate the utility of the algorithms through both synthetic experiments and a real-world case study involving the HeartSteps mobile application. Our numerical results show strong empirical average performance of our proposed randomized algorithms against previously proposed heuristic solutions.
- The primal-dual method for learning augmented algorithms. Advances in Neural Information Processing Systems, 33:20083–20094, 2020.
- Sense2stop: a micro-randomized trial using wearable sensors to optimize a just-in-time-adaptive stress management intervention for smoking relapse prevention. Contemporary Clinical Trials, 109:106534, 2021.
- Assessing time-varying causal effect moderation in mobile health. Journal of the American Statistical Association, 113(523):1112–1121, 2018.
- A pilot study to examine the feasibility and potential effectiveness of using smartphones to provide recovery support for adolescents. Substance abuse, 36(4):486–492, 2015.
- Habituation: effects of regular and stochastic stimulation. Journal of Neurology, Neurosurgery & Psychiatry, 35(2):234–242, 1972.
- Treatment burden and treatment fatigue as barriers to health. Current opinion in psychology, 5:31–36, 2015.
- Online bipartite matching with advice: Tight robustness-consistency tradeoffs for the two-stage model. Advances in Neural Information Processing Systems, 35:14555–14567, 2022.
- Stateful offline contextual policy evaluation and learning. In International Conference on Artificial Intelligence and Statistics, pp. 11169–11194. PMLR, 2022.
- Using wearable sensors and real time inference to understand human recall of routine activities. In Proceedings of the 10th international conference on Ubiquitous computing, pp. 154–163, 2008.
- Efficacy of contextually tailored suggestions for physical activity: a micro-randomized optimization trial of heartsteps. Annals of Behavioral Medicine, 53(6):573–582, 2019.
- Microrandomized trials for promoting engagement in mobile health data collection: Adolescent/young adult oral chemotherapy adherence as an example. Current opinion in systems biology, 21:1–8, 2020.
- Just-in-Time but Not Too Much: Determining Treatment Timing in Mobile Health. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 2(4):179, December 2018. ISSN 2474-9567. doi: 10.1145/3287057.
- Boredom in the lecture theatre: An investigation into the contributors, moderators and outcomes of boredom amongst university students. British Educational Research Journal, 35(2):243–258, 2009.
- Feasibility of obtaining measures of lifestyle from a smartphone app: the myheart counts cardiovascular health study. JAMA cardiology, 2(1):67–76, 2017.
- Mehta, A. et al. Online matching and ad allocation. Foundations and Trends® in Theoretical Computer Science, 8(4):265–368, 2013.
- Just-in-time adaptive interventions (jitais) in mobile health: key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine, pp. 1–17, 2018.
- Improving online algorithms via ml predictions. Advances in Neural Information Processing Systems, 31, 2018.
- Survival analysis with time varying covariates measured at random times by design. Journal of the Royal Statistical Society Series C: Applied Statistics, 62(3):419–434, 2013.
- A pilot study of the feasibility and potential effectiveness of using smartphones to provide recovery support. Drug and Alcohol Dependence, 100(171):e185, 2017a.
- Using smartphones to decrease substance use via self-monitoring and recovery support: study protocol for a randomized control trial. Trials, 18(1):1–11, 2017b.
- A tutorial on conformal prediction. Journal of Machine Learning Research, 9(3), 2008.
- Ecological momentary assessment. Annu. Rev. Clin. Psychol., 4:1–32, 2008.
- Improved learning-augmented algorithms for the multi-option ski rental problem via best-possible competitive analysis. arXiv preprint arXiv:2302.06832, 2023.
- Smith, J. M. Introduction to chemical engineering thermodynamics, 1950.
- Advancing behavioral intervention and theory development for mobile health: the heartsteps ii protocol. International journal of environmental research and public health, 19(4):2267, 2022.
- The science of real-time data capture: Self-reports in health research. Oxford University Press, 2007.
- Optimal robustness-consistency trade-offs for learning-augmented online algorithms. Advances in Neural Information Processing Systems, 33:8042–8053, 2020.
- Compliance with mobile ecological momentary assessment protocols in children and adolescents: a systematic review and meta-analysis. Journal of medical Internet research, 19(4):e132, 2017.
- The ski-rental problem with multiple discount options. Information Processing Letters, 111(18):903–906, 2011.
- Offline multi-action policy learning: Generalization and optimization. Operations Research, 71(1):148–183, 2023.