Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Improved Approximation Coflows Scheduling Algorithms for Minimizing the Total Weighted Completion Time and Makespan in Heterogeneous Parallel Networks (2312.16413v1)

Published 27 Dec 2023 in cs.DS

Abstract: Coflow is a network abstraction used to represent communication patterns in data centers. The coflow scheduling problem encountered in large data centers is a challenging $\mathcal{NP}$-hard problem. This paper tackles the scheduling problem of coflows with release times in heterogeneous parallel networks, which feature an architecture consisting of multiple network cores running in parallel. Two polynomial-time approximation algorithms are presented in this paper, designed to minimize the total weighted completion time and makespan in heterogeneous parallel networks, respectively. For any given $\epsilon>0$, our proposed approximation algorithm for minimizing the total weighted completion time achieves approximation ratios of $3 + \epsilon$ and $2 + \epsilon$ in the cases of arbitrary and zero release times, respectively. Additionally, we introduce an approximation algorithm for minimizing the makespan, achieving an approximation ratio of $2 + \epsilon$ for $\epsilon>0$. Notably, these advancements surpass the previously best-known approximation ratio of $O(\log m/ \log \log m)$ for both minimizing the total weighted completion time and makespan. This result also improves upon the previous approximation ratios of $6-\frac{2}{m}$ and $5-\frac{2}{m}$ for arbitrary and zero release times, respectively, in identical parallel networks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. S. Agarwal, S. Rajakrishnan, A. Narayan, R. Agarwal, D. Shmoys, and A. Vahdat, “Sincronia: Near-optimal network design for coflows,” in Proceedings of the 2018 ACM Conference on SIGCOMM, ser. SIGCOMM ’18.   New York, NY, USA: Association for Computing Machinery, 2018, p. 16–29.
  2. S. Ahmadi, S. Khuller, M. Purohit, and S. Yang, “On scheduling coflows,” Algorithmica, vol. 82, no. 12, pp. 3604–3629, 2020.
  3. N. Bansal and S. Khot, “Inapproximability of hypergraph vertex cover and applications to scheduling problems,” in Automata, Languages and Programming, S. Abramsky, C. Gavoille, C. Kirchner, F. Meyer auf der Heide, and P. G. Spirakis, Eds.   Berlin, Heidelberg: Springer Berlin Heidelberg, 2010, pp. 250–261.
  4. D. Borthakur, “The hadoop distributed file system: Architecture and design,” Hadoop Project Website, vol. 11, no. 2007, p. 21, 2007.
  5. C.-Y. Chen, “Scheduling coflows for minimizing the total weighted completion time in heterogeneous parallel networks,” Journal of Parallel and Distributed Computing, vol. 182, p. 104752, 2023.
  6. C.-Y. Chen, “Efficient approximation algorithms for scheduling coflows with precedence constraints in identical parallel networks to minimize weighted completion time,” IEEE Transactions on Services Computing, 2024.
  7. C.-Y. Chen, “Efficient approximation algorithms for scheduling coflows with total weighted completion time in identical parallel networks,” IEEE Transactions on Cloud Computing, 2024.
  8. M. Chowdhury and I. Stoica, “Coflow: A networking abstraction for cluster applications,” in Proceedings of the 11th ACM Workshop on Hot Topics in Networks, ser. HotNets-XI.   New York, NY, USA: Association for Computing Machinery, 2012, p. 31–36.
  9. M. Chowdhury and I. Stoica, “Efficient coflow scheduling without prior knowledge,” in Proceedings of the 2015 ACM Conference on SIGCOMM, ser. SIGCOMM ’15.   New York, NY, USA: Association for Computing Machinery, 2015, p. 393–406.
  10. M. Chowdhury, Y. Zhong, and I. Stoica, “Efficient coflow scheduling with varys,” in Proceedings of the 2014 ACM Conference on SIGCOMM, ser. SIGCOMM ’14.   New York, NY, USA: Association for Computing Machinery, 2014, p. 443–454.
  11. J. Dean and S. Ghemawat, “Mapreduce: Simplified data processing on large clusters,” Communications of the ACM, vol. 51, no. 1, p. 107–113, jan 2008.
  12. R. Graham, E. Lawler, J. Lenstra, and A. Kan, “Optimization and approximation in deterministic sequencing and scheduling: a survey,” in Discrete Optimization II, ser. Annals of Discrete Mathematics, P. Hammer, E. Johnson, and B. Korte, Eds.   Elsevier, 1979, vol. 5, pp. 287–326. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S016750600870356X
  13. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, “Dryad: distributed data-parallel programs from sequential building blocks,” in Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, 2007, pp. 59–72.
  14. S. Khuller and M. Purohit, “Brief announcement: Improved approximation algorithms for scheduling co-flows,” in Proceedings of the 28th ACM Symposium on Parallelism in Algorithms and Architectures, 2016, pp. 239–240.
  15. Z. Li and H. Shen, “Co-scheduler: A coflow-aware data-parallel job scheduler in hybrid electrical/optical datacenter networks,” IEEE/ACM Transactions on Networking, vol. 30, no. 4, pp. 1599–1612, 2022.
  16. Z. Qiu, C. Stein, and Y. Zhong, “Minimizing the total weighted completion time of coflows in datacenter networks,” in Proceedings of the 27th ACM Symposium on Parallelism in Algorithms and Architectures, ser. SPAA ’15.   New York, NY, USA: Association for Computing Machinery, 2015, p. 294–303.
  17. S. Sachdeva and R. Saket, “Optimal inapproximability for scheduling problems via structural hardness for hypergraph vertex cover,” in 2013 IEEE Conference on Computational Complexity, 2013, pp. 219–229.
  18. A. S. Schulz and M. Skutella, “Scheduling unrelated machines by randomized rounding,” SIAM Journal on Discrete Mathematics, vol. 15, no. 4, pp. 450–469, 2002.
  19. M. Shafiee and J. Ghaderi, “Scheduling coflows in datacenter networks: Improved bound for total weighted completion time,” SIGMETRICS Perform. Eval. Rev., vol. 45, no. 1, p. 29–30, jun 2017.
  20. M. Shafiee and J. Ghaderi, “An improved bound for minimizing the total weighted completion time of coflows in datacenters,” IEEE/ACM Transactions on Networking, vol. 26, no. 4, pp. 1674–1687, 2018.
  21. K. Shvachko, H. Kuang, S. Radia, and R. Chansler, “The hadoop distributed file system,” in 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), 2010, pp. 1–10.
  22. H. Tan, C. Zhang, C. Xu, Y. Li, Z. Han, and X.-Y. Li, “Regularization-based coflow scheduling in optical circuit switches,” IEEE/ACM Transactions on Networking, vol. 29, no. 3, pp. 1280–1293, 2021.
  23. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, “Spark: Cluster computing with working sets,” in 2nd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 10), 2010.
  24. H. Zhang, L. Chen, B. Yi, K. Chen, M. Chowdhury, and Y. Geng, “Coda: Toward automatically identifying and scheduling coflows in the dark,” in Proceedings of the 2016 ACM Conference on SIGCOMM, ser. SIGCOMM ’16.   New York, NY, USA: Association for Computing Machinery, 2016, p. 160–173.
  25. T. Zhang, F. Ren, J. Bao, R. Shu, and W. Cheng, “Minimizing coflow completion time in optical circuit switched networks,” IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 2, pp. 457–469, 2021.

Summary

We haven't generated a summary for this paper yet.