Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
80 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Carbon Containers: A System-level Facility for Managing Application-level Carbon Emissions (2309.14477v1)

Published 25 Sep 2023 in cs.DC, cs.ET, cs.OS, cs.PF, cs.SY, and eess.SY

Abstract: To reduce their environmental impact, cloud datacenters' are increasingly focused on optimizing applications' carbon-efficiency, or work done per mass of carbon emitted. To facilitate such optimizations, we present Carbon Containers, a simple system-level facility, which extends prior work on power containers, that automatically regulates applications' carbon emissions in response to variations in both their workload's intensity and their energy's carbon-intensity. Specifically, \carbonContainerS enable applications to specify a maximum carbon emissions rate (in g$\cdot$CO$_2$e/hr), and then transparently enforce this rate via a combination of vertical scaling, container migration, and suspend/resume while maximizing either energy-efficiency or performance. Carbon Containers are especially useful for applications that i) must continue running even during high-carbon periods, and ii) execute in regions with few variations in carbon-intensity. These low-variability regions also tend to have high average carbon-intensity, which increases the importance of regulating carbon emissions. We implement a Carbon Containers prototype by extending Linux Containers to incorporate the mechanisms above and evaluate it using real workload traces and carbon-intensity data from multiple regions. We compare Carbon Containers with prior work that regulates carbon emissions by suspending/resuming applications during high/low carbon periods. We show that Carbon Containers are more carbon-efficient and improve performance while maintaining similar carbon emissions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. https://openai.com/blog/ai-and-compute/, March 16th 2018.
  2. Azure Public Dataset. https://github.com/Azure/AzurePublicDataset, Accessed October 2020.
  3. Electricity Map. https://www.electricitymap.org/map, Accessed March 2022.
  4. Google Data Centers Efficiency. google.com/about/datacenters/efficiency/, Accessed March 2022.
  5. Greenhouse Gas Protocol. https://ghgprotocol.org/, Accessed March 2022.
  6. Checkpoint/Restore in Userspace (CRIU). https://criu.org/Main_Page, Accessed June 2023.
  7. The Case for Energy-Proportional Computing. Computer, 40(12):33–37, December 2007.
  8. Enabling Sustainable Clouds: The Case for Virtualizing the Energy System. In SoCC, November 2021.
  9. On the Promise and Pitfalls of Optimizing Embodied Carbon. In Proceedings of the 2nd Workshop on Sustainable Computer Systems (HotCarbon), 2023.
  10. Sustainable Computing – Without the Hot Air. In Proceedings of the First Workshop on Sustainable Computer Systems Design and Implementation (HotCarbon), 2022.
  11. A. Chien. Driving the Cloud to True Zero Carbon. CACM, 64(2), February 2021.
  12. Live Migration of Virtual Machines. In NSDI, April 2005.
  13. WattsKit: Software-Defined Power Monitoring of Distributed Systems. In 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), April 2017.
  14. Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms. In Proceedings of the 26th Symposium on Operating Systems Principles, SOSP ’17, page 153–167, New York, NY, USA, 2017. ACM.
  15. Measuring the carbon intensity of ai in cloud instances. In 2022 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’22, 2022.
  16. Cloud-scale VM-deflation for Running Interactive Applications on Transient Servers. In ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC), Stockholm, Sweden, June 2020.
  17. ACT: Designing Sustainable Computer Systems with an Architectural Carbon Modeling Tool. In ISCA, June 2022.
  18. Chasing Carbon: The Elusive Environmental Footprint of Computing. In 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA). IEEE, 2021.
  19. Combining Renewable Solar and Open Air Cooling for Internet-scale Distributed Networks. In e-Energy, June 2019.
  20. Managing Distributed UPS Energy for Effective Power Capping in Data Centers. In ISCA, June 2012.
  21. Thunderbolt: Throughput-Optimized, Quality-of-Service-Aware Power Capping at Scale. In USENIX Symposium on Operating System Design and Implementation (OSDI), November 2020.
  22. Canonical Ltd. Linux Containers. https://linuxcontainers.org/.
  23. Recalibrating Global Data Center Energy-use Estimates. Science, 367(6481):984–986, February 2020.
  24. The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink. Technical report, Google Inc., April 2022.
  25. Carbon Emissions and Large Neural Network Training. Technical report, arXiv, April 2021.
  26. Carbon Emissions and Large Neural Network Training, 2021.
  27. Data Center Power Oversubscription with a Medium Voltage Power Plane and Priority-Aware Capping. In ACM Symposium on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2020.
  28. Resource deflation: A new approach for transient resource reclamation. In Proceedings of the Fourteenth EuroSys Conference 2019, pages 1–17, 2019.
  29. HotSpot: Automated VM Hopping in Cloud Spot Markets. In ACM Symposium on Cloud Computing (SoCC), Santa Clara, California, September 2017.
  30. Power Containers: An OS Facility for Fine-grained Power and Energy Management on Multicore Servers. In ACM Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2013.
  31. Follow the Sun through the Clouds: Application Migration for Geographically Shifting Workloads. In ACM Symposium on Cloud Computing (SoCC), Santa Clara, California, October 2016.
  32. Ecovisor: A Virtual Energy System for Carbon-Efficient Applications. In ASPLOS, March 2023.
  33. Energy and Policy Considerations for Modern Deep Learning Research. In AAAI Conference on Artificial Intelligence (AAAI), February 2020.
  34. Let’s Wait Awhile: How Temporal Workload Shifting Can Reduce Carbon Emissions in the Cloud. In Proceedings of the 22nd International Middleware Conference (Middleware), December 2021.
  35. CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines. In International Conference on Virtual Execution Environments (VEE), Newport Beach, CA, March 2011.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. John Thiede (1 paper)
  2. Noman Bashir (32 papers)
  3. David Irwin (32 papers)
  4. Prashant Shenoy (57 papers)
Citations (6)