Strict Partitioning for Sporadic Rigid Gang Tasks (2403.10726v2)
Abstract: The rigid gang task model is based on the idea of executing multiple threads simultaneously on a fixed number of processors to increase efficiency and performance. Although there is extensive literature on global rigid gang scheduling, partitioned approaches have several practical advantages (e.g., task isolation and reduced scheduling overheads). In this paper, we propose a new partitioned scheduling strategy for rigid gang tasks, named strict partitioning. The method creates disjoint partitions of tasks and processors to avoid inter-partition interference. Moreover, it tries to assign tasks with similar volumes (i.e., parallelisms) to the same partition so that the intra-partition interference can be reduced. Within each partition, the tasks can be scheduled using any type of scheduler, which allows the use of a less pessimistic schedulability test. Extensive synthetic experiments and a case study based on Edge TPU benchmarks show that strict partitioning achieves better schedulability performance than state-of-the-art global gang schedulability analyses for both preemptive and non-preemptive rigid gang task sets.
- J. K. Ousterhout, “Scheduling techniques for concurrent systems,” in IEEE International Conference on Distributed Computing Systems (ICDCS), vol. 82, 1982, pp. 22–30.
- Y. Zhang, H. Franke, J. Moreira, and A. Sivasubramaniam, “Improving parallel job scheduling by combining gang scheduling and backfilling techniques,” in International Parallel and Distributed Processing Symposium (IPDPS), 2000, pp. 133–142.
- I. Moschakis and H. Karatza, “Evaluation of gang scheduling performance and cost in a cloud computing system,” The Journal of Supercomputing, vol. 59, pp. 975–992, 2010.
- C. Carrión, “Kubernetes scheduling: Taxonomy, ongoing issues and challenges,” ACM Computing Surveys, vol. 55, no. 7, pp. 1–37, 2022.
- Z. Dong, K. Yang, N. Fisher, and C. Liu, “Tardiness bounds for sporadic gang tasks under preemptive global EDF scheduling,” IEEE Transactions on Parallel Distributed Systems, vol. 32, no. 12, pp. 2867–2879, 2021.
- J. Bian, A. A. Arafat, H. Xiong, J. Li, L. Li, H. Chen, J. Wang, D. Dou, and Z. Guo, “Machine learning in real-time internet of things (IoT) systems: A survey,” IEEE Internet of Things Journal, vol. 9, no. 11, pp. 8364–8386, 2022.
- K. Seshadri, B. Akin, J. Laudon, R. Narayanaswami, and A. Yazdanbakhsh, “An evaluation of edge tpu accelerators for convolutional neural networks,” in IEEE International Symposium on Workload Characterization (IISWC), 2022, pp. 79–91.
- M. Verucchi, G. Brilli, D. Sapienza, M. Verasani, M. Arena, F. Gatti, A. Capotondi, R. Cavicchioli, M. Bertogna, and M. Solieri, “A systematic assessment of embedded neural networks for object detection,” in IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), 2020, pp. 937–944.
- Z. Dong and C. Liu, “A utilization-based test for non-preemptive gang tasks on multiprocessors,” in IEEE Real-Time Systems Symposium (RTSS), 2022, pp. 105–117.
- S. Lee, N. Guan, and J. Lee, “Design and timing guarantee for non-preemptive gang scheduling,” in IEEE Real-Time Systems Symposium (RTSS), 2022, pp. 132–144.
- E. Kim, J. Lee, L. He, Y. Lee, and K. G. Shin, “Offline guarantee and online management of power demand and supply in cyber-physical systems,” in IEEE Real-Time Systems Symposium (RTSS), 2016, pp. 89–98.
- B. Sun, T. Kloda, J. Chen, C. Lu, and M. Caccamo, “Schedulability analysis of non-preemptive sporadic gang tasks on hardware accelerators,” in IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS), 2023, pp. 147–160.
- S. Lee, S. Lee, and J. Lee, “Response time analysis for real-time global gang scheduling,” in IEEE Real-Time Systems Symposium (RTSS), 2022, pp. 92–104.
- G. Nelissen, J. Marcè i Igual, and M. Nasri, “Response-Time Analysis for Non-Preemptive Periodic Moldable Gang Tasks,” in Euromicro Conference on Real-Time Systems (ECRTS), 2022, pp. 12:1–12:22.
- S. Kato and Y. Ishikawa, “Gang EDF scheduling of parallel task systems,” in IEEE Real-Time Systems Symposium (RTSS), 2009, pp. 459–468.
- J. Goossens and V. Berten, “Gang FTP scheduling of periodic and parallel rigid real-time tasks,” arXiv preprint arXiv:1006.2617, 2010.
- J. Goossens and P. Richard, “Optimal scheduling of periodic gang tasks,” Leibniz Transactions on Embedded Systems, vol. 3, no. 1, pp. 04:1–04:18, 2016.
- Z. Dong and C. Liu, “Analysis techniques for supporting hard real-time sporadic gang task systems,” in IEEE Real-Time Systems Symposium (RTSS), 2017, pp. 128–138.
- N. Ueter, M. Günzel, G. von der Brüggen, and J.-J. Chen, “Hard real-time stationary gang-scheduling,” in Euromicro Conference on Real-Time Systems (ECRTS), 2021, pp. 10:1–10:19.
- A. Bastoni, B. B. Brandenburg, and J. H. Anderson, “An empirical comparison of global, partitioned, and clustered multiprocessor EDF schedulers,” in IEEE Real-Time Systems Symposium (RTSS), 2010, pp. 14–24.
- J. Lelli, D. Faggioli, T. Cucinotta, and G. Lipari, “An experimental comparison of different real-time schedulers on multicore systems,” Journal of Systems and Software, vol. 85, no. 10, pp. 2405–2416, 2012, automated Software Evolution.
- B. B. Brandenburg and M. Gül, “Global scheduling not required: Simple, near-optimal multiprocessor real-time scheduling with semi-partitioned reservations,” in IEEE Real-Time Systems Symposium (RTSS), 2016, pp. 99–110.
- A. Biondi and G. Buttazzo, “Timing-aware FPGA partitioning for real-time applications under dynamic partial reconfiguration,” in NASA/ESA Conference on Adaptive Hardware and Systems, 2017, pp. 172–179.
- C. Han, H. S. Chwa, K. Lee, and S. Oh, “SPET: Transparent sram allocation and model partitioning for real-time DNN tasks on edge TPU,” in ACM/IEEE Design Automation Conference (DAC), 2023, pp. 1–6.
- C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 1–9.
- S. Christian, V. Vincent, S. Ioffe, S. Jon, and W. Zbigniew, “Rethinking the Inception architecture for computer vision,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2818–2826.
- C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, “Inception-v4, inception-resnet and the impact of residual connections on learning,” in Thirty-first AAAI conference on artificial intelligence (AAAI), 2017.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 770–778.
- Y. Sun and M. Di Natale, “Assessing the pessimism of current multicore global fixed-priority schedulability analysis,” in Annual ACM Symposium on Applied Computing, 2018, pp. 575–583.
- T. P. Baker, “A comparison of global and partitioned EDF schedulability tests for multiprocessors,” in International Conference on Real-Time and Network Systems (RTNS), 2006, pp. 119–127.
- S. Lauzac, R. Melhem, and D. Mosse, “Comparison of global and partitioning schemes for scheduling rate monotonic tasks on a multiprocessor,” in EUROMICRO Workshop on Real-Time Systems, 1998, pp. 188–195.
- S. Baruah and K. Pruhs, “Open problems in real-time scheduling,” Journal of Scheduling, vol. 13, no. 1, pp. 577–582, 2010.
- Z. Dong and C. Liu, “Work-in-progress: Non-preemptive scheduling of sporadic gang tasks on multiprocessors,” in IEEE Real-Time Systems Symposium (RTSS), 2019, pp. 512–515.
- V. Sarkar, “Partitioning and scheduling parallel programs for execution on multiprocessors,” 1 1987.
- D. S. Johnson, “Fast algorithms for bin packing,” Journal of Computer and System Sciences, vol. 8, no. 3, pp. 272–314, 1974.
- B. S. Baker, E. G. Coffman, Jr., and R. L. Rivest, “Orthogonal packings in two dimensions,” SIAM Journal on Computing, vol. 9, no. 4, pp. 846–855, 1980.
- N. Audsley, A. Burns, M. Richardson, and A. Wellings, “Hard real-time scheduling: The deadline-monotonic approach,” IFAC Proceedings Volumes, vol. 24, no. 2, pp. 127–132, 1991.
- C. L. Liu and J. W. Layland, “Scheduling algorithms for multiprogramming in a hard-real-time environment,” Journal of the ACM, vol. 20, no. 1, pp. 46–61, jan 1973.
- R. I. Davis and A. Burns, “A survey of hard real-time scheduling for multiprocessor systems,” ACM Computing Surveys, vol. 43, no. 4, 2011.
- P. Ekberg and S. Baruah, “Partitioned scheduling of recurrent real-time tasks,” in IEEE Real-Time Systems Symposium (RTSS), 2021, pp. 356–367.
- A. Burchard, J. Liebeherr, Y. Oh, and S. Son, “New strategies for assigning real-time tasks to multiprocessor systems,” IEEE Transactions on Computers, vol. 44, no. 12, pp. 1429–1442, 1995.
- S. K. Dhall and C. L. Liu, “On a real-time scheduling problem,” Operations Research, vol. 26, no. 1, p. 127–140, 1978.
- J. Lopez, M. Garcia, J. Diaz, and D. Garcia, “Worst-case utilization bound for EDF scheduling on real-time multiprocessor systems,” in Euromicro Conference on Real-Time Systems (ECRTS), 2000, pp. 25–33.
- J. M. López, J. L. Díaz, and D. F. García, “Utilization bounds for EDF scheduling on real-time multiprocessor systems,” Real-Time Systems, vol. 28, pp. 39–68, 2004.
- S. Baruah and N. Fisher, “The partitioned multiprocessor scheduling of sporadic task systems,” in IEEE Real-Time Systems Symposium (RTSS), 2005.
- S. Baruah and N. Fisher, “The partitioned multiprocessor scheduling of deadline-constrained sporadic task systems,” IEEE Transactions on Computers, vol. 55, no. 7, pp. 918–923, 2006.
- N. Fisher, S. Baruah, and T. Baker, “The partitioned scheduling of sporadic tasks according to static-priorities,” in Euromicro Conference on Real-Time Systems (ECRTS), 2006, pp. 10 pp.–127.
- S. Baruah and E. Bini, “Partitioned scheduling of sporadic task systems: an ILP-based approach,” in Conference on Design and Architectures for Signal and Image Processing, 2008.
- W. Zheng, Q. Zhu, M. D. Natale, and A. S. Vincentelli, “Definition of task allocation and priority assignment in hard real-time distributed systems,” in IEEE International Real-Time Systems Symposium (RTSS), 2007, pp. 161–170.
- N. Fisher and S. Baruah, “The partitioned multiprocessor scheduling of non-preemptive sporadic task systems,” in International Conference on Real-Time and Network Systems (RTNS), 2006, pp. 99–108.
- B. Berna and I. Puaut, “PDPA: Period driven task and cache partitioning algorithm for multi-core systems,” in International Conference on Real-Time and Network Systems (RTNS), 2012, pp. 181–189.
- J. Mayank and A. Mondal, “Non-preemptive multiprocessor scheduling for periodic real-time tasks,” in 7th International Symposium on Embedded Computing and System Design (ISED), 2017, pp. 1–6.
- A. Burns, R. Davis, P. Wang, and F. Zhang, “Partitioned EDF scheduling for multiprocessors using a C=D scheme,” in Proceedings of 18th International Conference on Real-Time and Network Systems (RTNS), 2010, pp. 169–178.
- B. Andersson and E. Tovar, “Multiprocessor scheduling with few preemptions,” in IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), 2006, pp. 322–334.
- D. Casini, A. Biondi, G. Nelissen, and G. Buttazzo, “Partitioned fixed-priority scheduling of parallel tasks without preemptions,” in IEEE Real-Time Systems Symposium (RTSS), 2018, pp. 421–433.
- Y. Wu, W. Zhang, N. Guan, and Y. Ma, “TDTA: Topology-based real-time DAG task allocation on identical multiprocessor platforms,” IEEE Transactions on Parallel and Distributed Systems, vol. 34, no. 11, pp. 2895–2909, 2023.
- H.-E. Zahaf, G. Lipari, S. Niar, and A. E. Hassan Benyamina, “Preemption-aware allocation, deadline assignment for conditional DAGs on partitioned EDF,” in IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), 2020, pp. 1–10.
- J. Li, J. J. Chen, K. Agrawal, C. Lu, C. Gill, and A. Saifullah, “Analysis of federated and global scheduling for parallel real-time tasks,” in Euromicro Conference on Real-Time Systems (ECRTS), 2014, pp. 85–96.
- S. Baruah, “The federated scheduling of constrained-deadline sporadic DAG task systems,” in Design, Automation & Test in Europe Conference & Exhibition (DATE), 2015, pp. 1323–1328.
- X. Jiang, N. Guan, H. Liang, Y. Tang, L. Qiao, and Y. Wang, “Virtually-federated scheduling of parallel real-time tasks,” in IEEE Real-Time Systems Symposium (RTSS), 2021, pp. 482–494.
- N. Ueter, G. von der Brüggen, J.-J. Chen, J. Li, and K. Agrawal, “Reservation-based federated scheduling for parallel real-time tasks,” in IEEE Real-Time Systems Symposium (RTSS), 2018, pp. 482–494.
- X. Jiang, N. Guan, X. Long, and W. Yi, “Semi-federated scheduling of parallel real-time tasks on multiprocessors,” in IEEE Real-Time Systems Symposium (RTSS), 2017, pp. 80–91.
- M. Kubale, “The complexity of scheduling independent two-processor tasks on dedicated processors,” Information Processing Letters, vol. 24, no. 3, pp. 141–147, 1987.
- S. Baruah, “Fairness in periodic real-time scheduling,” in IEEE Real-Time Systems Symposium (RTSS), 1995, pp. 200–209.
- S. K. Baruah, N. K. Cohen, C. G. Plaxton, and D. A. Varvel, “Proportionate progress: A notion of fairness in resource allocation,” in Annual ACM Symposium on Theory of Computing (STOC), 1993, pp. 345–354.
- S. Collette, L. Cucu, and J. Goossens, “Integrating job parallelism in real-time scheduling theory,” Information Processing Letters, vol. 106, no. 5, pp. 180–187, 2008.
- V. Berten, P. Courbin, and J. Goossens, “Gang fixed priority scheduling of periodic moldable real-time tasks,” in 5th Junior Researcher Workshop on Real-Time Computing, 2011, pp. 9–12.
- P. Richard, J. Goossens, and S. Kato, “Comments on” gang edf schedulability analysis”,” arXiv preprint arXiv:1705.05798, 2017.
- J.-J. Chen, G. Nelissen, W.-H. Huang, M. Yang, B. Brandenburg, K. Bletsas, C. Liu, P. Richard, F. Ridouard, N. Audsley, R. Rajkumar, D. Niz, and G. Brüggen, “Many suspensions, many problems: A review of self-suspending tasks in real-time systems,” Real-Time Systems, vol. 55, no. 1, pp. 144–207, 2019.
- M. Bertogna and M. Cirinei, “Response-time analysis for globally scheduled symmetric multiprocessor platforms,” in IEEE Real-Time Systems Symposium (RTSS), 2007, pp. 149–160.
- M. Bertogna, M. Cirinei, and G. Lipari, “Schedulability analysis of global scheduling algorithms on multiprocessor platforms,” IEEE Transactions on Parallel and Distributed Systems, vol. 20, no. 4, pp. 553–566, 2009.
- E. G. Coffman, Jr, M. R. Garey, D. S. Johnson, and R. E. Tarjan, “Performance bounds for level-oriented two-dimensional packing algorithms,” SIAM Journal on Computing, vol. 9, no. 4, pp. 808–826, 1980.
- M. R. Garey, R. L. Graham, D. S. Johnson, and A. C.-C. Yao, “Resource constrained scheduling as generalized bin packing,” Journal of Combinatorial Theory, Series A, vol. 21, no. 3, pp. 257–298, 1976.
- D. Griffin, I. Bate, and R. I. Davis, “Generating utilization vectors for the systematic evaluation of schedulability tests,” in IEEE Real-Time Systems Symposium (RTSS), 2020, pp. 76–88.
- N. Audsley, A. Burns, M. Richardson, K. Tindell, and A. Wellings, “Applying new scheduling theory to static priority preemptive scheduling,” Software Engineering Journal, vol. 8, no. 5, pp. 284–292, 1993.
- R. I. Davis, A. Burns, R. J. Bril, and J. J. Lukkien, “Controller Area Network (CAN) Schedulability Analysis: Refuted, Revisited and Revised,” Real-Time Systems, vol. 35, no. 3, pp. 239–272, 2007.
- T. P. Baker, “Multiprocessor EDF and deadline monotonic schedulability analysis,” in IEEE Real-Time Systems Symposium (RTSS), 2003, pp. 120–129.