Papers
Topics
Authors
Recent
Search
2000 character limit reached

GreenWhisk: Emission-Aware Computing for Serverless Platform

Published 4 Sep 2024 in cs.DC | (2409.03029v1)

Abstract: Serverless computing is an emerging cloud computing abstraction wherein the cloud platform transparently manages all resources, including explicitly provisioning resources and geographical load balancing when the demand for service spikes. Users provide code as functions, and the cloud platform runs these functions handling all aspects of function execution. While prior work has primarily focused on optimizing performance, this paper focuses on reducing the carbon footprint of these systems making variations in grid carbon intensity and intermittency from renewables transparent to the user. We introduce GreenWhisk, a carbon-aware serverless computing platform built upon Apache OpenWhisk, operating in two modes - grid-connected and grid-isolated - addressing intermittency challenges arising from renewables and the grid's carbon footprint. Moreover, we develop carbon-aware load balancing algorithms that leverage energy and carbon information to reduce the carbon footprint. Our evaluation results show that GreenWhisk can easily incorporate carbon-aware algorithms, thereby reducing the carbon footprint of functions without significantly impacting the performance of function execution. In doing so, our system design enables the integration of new carbon-aware strategies into a serverless computing platform.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. Redesigning data centers for renewable energy. In Proceedings of the Twentieth ACM Workshop on Hot Topics in Networks, pages 45–52, 2021.
  2. Batch: machine learning inference serving on serverless platforms with adaptive batching. In SC20: International Conference for High Performance Computing, Networking, Storage and Analysis, pages 1–15. IEEE, 2020.
  3. On global electricity usage of communication technology: trends to 2030. Challenges, 6(1):117–157, 2015.
  4. Beyond load balancing: Package-aware scheduling for serverless platforms. In 2019 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), pages 282–291. IEEE, 2019.
  5. Enabling sustainable clouds: The case for virtualizing the energy system. In Proceedings of the ACM Symposium on Cloud Computing, pages 350–358, 2021.
  6. Serverless computing for internet of things: A systematic literature review. Future Generation Computer Systems, 128:299–316, 2022.
  7. Managing server energy and operational costs in hosting centers. In Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, pages 303–314, 2005.
  8. Policy and mechanism for carbon-aware cloud applications. In 2012 IEEE network operations and management symposium, pages 590–594. IEEE, 2012.
  9. Electricity Map. https://www.electricitymap.org/map, Accessed Nov 2023.
  10. Locality-aware load-balancing for serverless clusters. In Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing, pages 227–239, 2022.
  11. Mlless: Achieving cost efficiency in serverless machine learning training. arXiv e-prints, pages arXiv–2206, 2022.
  12. Parasol and greenswitch: Managing datacenters powered by renewable energy. ACM SIGPLAN Notices, 48(4):51–64, 2013.
  13. Greenhadoop: leveraging green energy in data-processing frameworks. In Proceedings of the 7th ACM european conference on Computer Systems, pages 57–70, 2012.
  14. Google Data Centers. https://www.google.com/about/datacenters/locations/, Accessed Nov 2023.
  15. Benefits and limitations of tapping into stored energy for datacenters. In Proceedings of the 38th annual international symposium on Computer architecture, pages 341–352, 2011.
  16. Chasing carbon: The elusive environmental footprint of computing. In 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA), pages 854–867. IEEE, 2021.
  17. How to cool internet-scale distributed networks on the cheap. In Proceedings of the Seventh International Conference on Future Energy Systems, pages 1–12, 2016.
  18. Carbonscaler: Leveraging cloud workload elasticity for optimizing carbon-efficiency. arXiv preprint arXiv:2302.08681, 2023.
  19. IPMI Overview. https://www.ibm.com/docs/en/power8/8335-GCA?topic=ipmi-overview, Accessed Nov 2023.
  20. A low carbon kubernetes scheduler. In ICT4S, 2019.
  21. Towards demystifying serverless machine learning training. In Proceedings of the 2021 International Conference on Management of Data, pages 857–871, 2021.
  22. Occupy the cloud: Distributed computing for the 99%. In Proceedings of the 2017 symposium on cloud computing, pages 445–451, 2017.
  23. Cost minimization using renewable cooling and thermal energy storage in cdns. In 2015 IEEE International Conference on Autonomic Computing, pages 121–126. IEEE, 2015.
  24. Chameleon: Application-level power management. IEEE Transactions on Mobile Computing, 7(8):995–1010, 2008.
  25. Funcpipe: A pipelined serverless framework for fast and cost-efficient training of deep learning models. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 6(3):1–30, 2022.
  26. Greening geographical load balancing. ACM SIGMETRICS Performance Evaluation Review, 39(1):193–204, 2011.
  27. Recalibrating global data center energy-use estimates. Science, 367(6481):984–986, 2020.
  28. Energy-aware load balancing in content delivery networks. In 2012 Proceedings IEEE INFOCOM, pages 954–962. IEEE, 2012.
  29. OpenWhisk. https://openwhisk.apache.org/, Accessed Nov 2023.
  30. Using batteries to reduce the power costs of internet-scale distributed networks. In Proceedings of the Third ACM Symposium on Cloud Computing, pages 1–14, 2012.
  31. Carbon emissions and large neural network training. arXiv preprint arXiv:2104.10350, 2021.
  32. Carbon-aware computing for datacenters. IEEE Transactions on Power Systems, 38(2):1270–1280, 2022.
  33. Solar-powered parking analytics system using deep reinforcement learning. ACM Transactions on Sensor Networks, 19(4):1–27, 2023.
  34. Energy-efficient parking analytics system using deep reinforcement learning. In Proceedings of the 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, pages 81–90, 2021.
  35. Serverless data analytics in the ibm cloud. In Proceedings of the 19th International Middleware Conference Industry, pages 1–8, 2018.
  36. Weighted distributed hash tables. In Proceedings of the seventeenth annual ACM symposium on Parallelism in algorithms and architectures, pages 218–227, 2005.
  37. Serverless in the wild: Characterizing and optimizing the serverless workload at a large cloud provider. In 2020 USENIX annual technical conference (USENIX ATC 20), pages 205–218, 2020.
  38. Blink: managing server clusters on intermittent power. In Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems, pages 185–198, 2011.
  39. Prateek Sharma. Challenges and opportunities in sustainable serverless computing. ACM SIGENERGY Energy Informatics Review, 3(3):53–58, 2023.
  40. Power containers: An os facility for fine-grained power and energy management on multicore servers. ACM SIGARCH Computer Architecture News, 41(1):65–76, 2013.
  41. Solcast API. https://solcast.com/, Accessed Nov 2023.
  42. Ecovisor: A virtual energy system for carbon-efficient applications. In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2, pages 252–265. ASPLOS, 2023.
  43. Energy and policy considerations for modern deep learning research. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pages 13693–13696, 2020.
  44. A case for virtualizing the electric utility in cloud data centers. In 6th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 14), 2014.
  45. Distributed machine learning with a serverless architecture. In IEEE INFOCOM 2019-IEEE Conference on Computer Communications, pages 1288–1296. IEEE, 2019.
  46. WattTime. https://www.watttime.org/, Accessed Nov 2023.
  47. Let’s wait awhile: How temporal workload shifting can reduce carbon emissions in the cloud. In Proceedings of the 22nd International Middleware Conference, pages 260–272, 2021.
  48. Carbon responder: Coordinating demand response for the datacenter fleet. arXiv preprint arXiv:2311.08589, 2023.
  49. Infless: a native serverless system for low-latency, high-throughput inference. In Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, pages 768–781, 2022.
  50. Gillis: Serving large neural networks in serverless functions with automatic model partitioning. In 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS), pages 138–148. IEEE, 2021.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up