Decision-Epoch Matters: Unveiling its Impact on the Stability of Scheduling with Randomly Varying Connectivity (2403.18686v1)
Abstract: A classical queuing theory result states that in a parallel-queue single-server model, the maximum stability region does not depend on the scheduling decision epochs, and in particular is the same for preemptive and non-preemptive systems. We consider here the case in which each of the queues may be connected to the server or not, depending on an exogenous process. In our main result, we show that the maximum stability region now does strongly depend on how the decision epochs are defined. We compare the setting where decisions can be made at any moment in time (the unconstrained setting), to two other settings: decisions are taken either (i) at moments of a departure (non-preemptive scheduling), or (ii) when an exponentially clock rings with rate $\gamma$. We characterise the maximum stability region for the two constrained configurations, allowing us to observe a reduction compared to the unconstrained configuration. In the non-preemptive setting, the maximum stability region is drastically reduced compared to the unconstrained setting and we conclude that a non-preemptive scheduler cannot take opportunistically advantage (in terms of stability) of the random varying connectivity. Instead, for the $\gamma$ decision epochs, we observe that the maximum stability region is monotone in the rate of the decision moments $\gamma$, and that one can be arbitrarily close to the maximum stability region in the unconstrained setting if we choose $\gamma$ large enough. We further show that Serve Longest Connected (SLC) queue is maximum stable in both constrained settings, within the set of policies that select a queue among the connected ones. From a methodological viewpoint, we introduce a novel theoretical tool termed a ``test for fluid limits'' (TFL) that might be of independent interest. TFL is a simple test that, if satisfied by the fluid limit, allows us to conclude for stability.
- Scheduling in a queuing system with asynchronously varying service rates. Probability in the Engineering and Informational Sciences, 18(2):191–217, 2004.
- Scheduling in a random environment: Stability and asymptotic optimality. IEEE/ACM Transactions on Networking, 21(1):258–271, 2013.
- F. Baccelli and A. M. Makowski. Stability and bounds for single server queues in random environment. Communications in Statistics. Stochastic Models, 2(2):281–291, 1986.
- N. Bambos and G. Michailidis. Queueing and scheduling in random environments. Advances in Applied Probability, 36(1):293–317, 2004.
- Queueing networks of random link topology: stationary dynamics of maximal throughput schedules. Queueing Syst., 50(1):5–52, 2005.
- S.C. Borst. User-level performance of channel-aware scheduling algorithms in wireless data networks. IEEE/ACM Transactions on Networking, 13(3):636–647, 2005.
- M. Bramson. Stability of queueing networks, volume 1950. Springer, Berlin, Berlin, 2008.
- Scheduling control for markov-modulated single-server multiclass queueing systems in heavy traffic. Queueing Systems, 78(1):57–97, 2014.
- Scheduling in parallel queues with randomly varying connectivity and switchover delay. In 2011 Proceedings IEEE INFOCOM, pages 316–320. IEEE, 2011.
- J. G. Dai. On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models. Ann. Appl. Probab., 5(1):49–77, 1995.
- B. D’Auria. m/m/∞𝑚𝑚m/m/\inftyitalic_m / italic_m / ∞ queues in semi-markovian random environment. Queueing Systems, (58):221–237, 2008.
- Sufficient conditions for stability of longest-queue-first scheduling: second-order properties using fluid limits. Advances in Applied Probability, 38(2):505–521, 2006.
- A survey of mobile cloud computing: architecture, applications, and approaches. Wireless communications and mobile computing, 13(18):1587–1611, 2013.
- Santiago Duran and Ina Maria Maaike Verloop. Asymptotic Optimal Control of Markov-Modulated Restless Bandits. In ACM Sigmetrics 2018, Irvine, United States, June 2018.
- M. Khabbaz and C. M. Assi. Modelling and analysis of a novel deadline-aware scheduling scheme for cloud computing data centers. IEEE Transactions on Cloud Computing, 6(1):141–155, 2015.
- L. Kleinrock. Queueing Systems, vol. 1. John Wiley and Sons, 1976.
- Longest-queue-first scheduling under the sinr interference model. In ACM MobiHoc, 2010.
- Random task scheduling scheme based on reinforcement learning in cloud computing. Cluster computing, 18:1595–1607, 2015.
- P. Robert. Stochastic networks and queues, volume 52 of Applications of Mathematics (New York). Springer-Verlag, Berlin, french edition, 2003. Stochastic Modelling and Applied Probability.
- S. Shakkottai and A. L. Stolyar. Scheduling for multiple flows sharing a time-varying channel: The exponential rule. Translations of the American Mathematical Society-Series 2, 207:185–202, 2002.
- R. Srikant and L. Ying. Communication Networks: An Optimization, Control, and Stochastic Networks Perspective. Cambridge University Press, 2013.
- A.L. Stolyar. Maxweight scheduling in a generalized switch: State space collapse and workload minimization in heavy traffic. Annals of Applied Probability, 14(1):1–53, 2004.
- L. Tassiulas and A. Ephremides. Dynamic server allocation to parallel queues with randomly varying connectivity. IEEE Transactions on Information Theory, 39(2):466–478, 1993.
- I.M. Verloop. Asymptotically optimal priority policies for indexable and non-indexable restless bandits. Annals of Applied Probability, 26(4):1947–1995, 2016.
- On an index policy for restless bandits. Journal of applied probability, pages 637–648, 1990.
- P. Whittle. Restless bandits: Activity allocation in a changing world. Journal of Applied Probability, 25:287–298, 1988.