Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

CASPER: Carbon-Aware Scheduling and Provisioning for Distributed Web Services (2403.14792v1)

Published 21 Mar 2024 in cs.DC, cs.NI, cs.PF, and math.OC

Abstract: There has been a significant societal push towards sustainable practices, including in computing. Modern interactive workloads such as geo-distributed web-services exhibit various spatiotemporal and performance flexibility, enabling the possibility to adapt the location, time, and intensity of processing to align with the availability of renewable and low-carbon energy. An example is a web application hosted across multiple cloud regions, each with varying carbon intensity based on their local electricity mix. Distributed load-balancing enables the exploitation of low-carbon energy through load migration across regions, reducing web applications carbon footprint. In this paper, we present CASPER, a carbon-aware scheduling and provisioning system that primarily minimizes the carbon footprint of distributed web services while also respecting their Service Level Objectives (SLO). We formulate CASPER as an multi-objective optimization problem that considers both the variable carbon intensity and latency constraints of the network. Our evaluation reveals the significant potential of CASPER in achieving substantial reductions in carbon emissions. Compared to baseline methods, CASPER demonstrates improvements of up to 70% with no latency performance degradation.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize File Document Download Save Streamline Icon: https://streamlinehq.com PDF File Document Download Save Streamline Icon: https://streamlinehq.com Markdown Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Matt Adorjan. 2017. CloudPing. www.cloudping.co.
  2. Treehouse: A case for carbon-aware datacenter software. ACM SIGENERGY Energy Informatics Review 3, 3 (2023), 64–70.
  3. HIPAA Compliance Assistance. 2003. Summary of the hipaa privacy rule. Office for Civil Rights (2003).
  4. Enabling Sustainable Clouds: The Case for Virtualizing the Energy System. In Proceedings of the ACM Symposium on Cloud Computing (SoCC ’21). Association for Computing Machinery, New York, NY, USA, 350–358. https://doi.org/10.1145/3472883.3487009
  5. Gary Cook and David Pomerantz. 2015. Clicking clean: A guide to building the green Internet. Greenpeace International, Tech. Rep. (2015).
  6. CoreOS. 2016. Flannel. https://github.com/flannel-io/flannel.
  7. Peter J. Denning and Ted G. Lewis. 2017. Exponential Laws of Computing Growth. Commun. ACM 60, 1 (January 2017), 54–65.
  8. ElectricityMap. 2022. ElectricityMap. https://electricitymaps.com/.
  9. Emmanuel Engelhart and Renaud Gaudin. 2007. Kiwix. https://kiwix.org.
  10. openZIM. https://openzim.org.
  11. Latest Wikipedia zim dump. https://download.kiwix.org/zim/wikipedia/.
  12. European Parliament and Council of the European Union. 2016. Regulation (EU) 2016/679 of the European Parliament and of the Council. https://data.europa.eu/eli/reg/2016/679/oj.
  13. Wikimedia Foundation. 2023. Wikimedia’s Grafana installation. https://grafana.wikimedia.org/.
  14. Wikimedia Foundation. 2024. Wikimedia infrastructure. https://wikitech.wikimedia.org/wiki/Wikimedia_infrastructure.
  15. C. Garcia. 2022. AKCP, The Real Amount of Energy A Data Center Uses. https://www.akcp.com/blog/the-real-amount-of-energy-a-data-center-use/.
  16. ACT: Designing Sustainable Computer Systems with an Architectural Carbon Modeling Tool. In Proceedings of the 49th Annual International Symposium on Computer Architecture. 784–799.
  17. Chasing Carbon: The Elusive Environmental Footprint of Computing. In HPCA. ACM.
  18. CO2 Emission Aware Scheduling for Deep Neural Network Training Workloads. In 2022 IEEE International Conference on Big Data (Big Data). 1542–1549. https://doi.org/10.1109/BigData55660.2022.10020544
  19. Aled James and Daniel Schien. 2019. A low carbon kubernetes scheduler. In 6th International Conference on ICT for Sustainability, ICT4S 2019 (CEUR Workshop Proceedings, Vol. 2382). CEUR-WS. 6th International Conference on ICT for Sustainability, ICT4S 2019 ; Conference date: 10-06-2019 Through 14-06-2019.
  20. Nicola Jones. 2018. How to stop data centres from gobbling up the world’s electricity. Nature 561, 7722 (2018), 163–167.
  21. The Online Pause and Resume Problem: Optimal Algorithms and An Application to Carbon-Aware Load Shifting. In Proceedings of the ACM on Measurement and Analysis of Computing Systems (SIGMETRICS 2024). ACM, New York, NY, USA, 35 pages.
  22. Liuzixuan Lin and Andrew A Chien. 2023. Adapting Datacenter Capacity for Greener Datacenters and Grid. In Proceedings of the ACM International Conference on Future Energy Systems (e-Energy). ACM, New York, NY, USA, 200–213.
  23. Bringing Carbon Awareness to Multi-cloud Application Delivery. In Proceedings of the 2nd Workshop on Sustainable Computer Systems. 1–6.
  24. CarbonCast: multi-day forecasting of grid carbon intensity. In Proceedings of the 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation. 198–207.
  25. PuLP: a linear programming toolkit for python. The University of Auckland, Auckland, New Zealand 65 (2011).
  26. Green Gas House Protocol. 2024. GHG Protocol Scope 2 Guidance. https://ghgprotocol.org/scope-2-guidance.
  27. Carbon-Aware Computing for Datacenters. IEEE Transactions on Power Systems 38, 2 (2023), 1270–1280.
  28. Matthew J Saltzman. 2002. COIN-OR: an open-source library for optimization. Programming languages and systems in computational economics and finance (2002), 3–32.
  29. Ecovisor: A Virtual Energy System for Carbon-Efficient Applications. In ASPLOS. ACM, New York, NY, USA, 252–265.
  30. Hybrid adaptive checkpointing for virtual machine fault tolerance. In 2018 IEEE International Conference on Cloud Engineering (IC2E). IEEE, 12–22.
  31. Energy and Policy Considerations for Modern Deep Learning Research. In AAAI Conference on Artificial Intelligence (AAAI). ACM, New York, NY, USA, 13693–13696.
  32. Quantifying the Benefits of Carbon-Aware Temporal and Spatial Workload Shifting in the Cloud. arXiv preprint arXiv:2306.06502 (2023).
  33. Carbon-Aware Global Routing in Path-Aware Networks. In Proceedings of the ACM International Conference on Future Energy Systems (e-Energy). ACM, New York, NY, USA, 144–158.
  34. Energy-carbon footprint optimization in sequence-dependent production scheduling. Applied Energy 315 (2022), 118949. https://doi.org/10.1016/j.apenergy.2022.118949
  35. Emile Vauge. 2016. Traefik. https://traefik.io/traefik/.
  36. Let’s Wait Awhile: How Temporal Workload Shifting Can Reduce Carbon Emissions in the Cloud. In Proceedings of the 22nd International Middleware Conference (Middleware). ACM, New York, NY, USA, 260–272.
  37. Let’s wait awhile: How temporal workload shifting can reduce carbon emissions in the cloud. In Proceedings of the 22nd International Middleware Conference. 260–272.
  38. Sustainable AI: Environmental Implications, Challenges and Opportunities. Proceedings of Machine Learning and Systems 4, 795–813.
  39. Cadre: Carbon-aware data replication for geo-diverse services. In 2015 IEEE International Conference on Autonomic Computing. IEEE, 177–186.
  40. Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach. arXiv:2304.07948 [cs.AI]
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (9)
  1. Abel Souza (10 papers)
  2. Shruti Jasoria (1 paper)
  3. Basundhara Chakrabarty (1 paper)
  4. Alexander Bridgwater (1 paper)
  5. Axel Lundberg (1 paper)
  6. Filip Skogh (2 papers)
  7. Ahmed Ali-Eldin (11 papers)
  8. David Irwin (32 papers)
  9. Prashant Shenoy (57 papers)
Citations (11)
View on Semantic Scholar
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets