Adapting Datacenter Capacity for Greener Datacenters and Grid (2301.03148v2)
Abstract: Cloud providers are adapting datacenter (DC) capacity to reduce carbon emissions. With hyperscale datacenters exceeding 100 MW individually, and in some grids exceeding 15% of power load, DC adaptation is large enough to harm power grid dynamics, increasing carbon emissions, power prices, or reduce grid reliability. To avoid harm, we explore coordination of DC capacity change varying scope in space and time. In space, coordination scope spans a single datacenter, a group of datacenters, and datacenters with the grid. In time, scope ranges from online to day-ahead. We also consider what DC and grid information is used (e.g. real-time and day-ahead average carbon, power price, and compute backlog). For example, in our proposed PlanShare scheme, each datacenter uses day-ahead information to create a capacity plan and shares it, allowing global grid optimization (over all loads, over entire day). We evaluate DC carbon emissions reduction. Results show that local coordination scope fails to reduce carbon emissions significantly (3.2%--5.4% reduction). Expanding coordination scope to a set of datacenters improves slightly (4.9%--7.3%). PlanShare, with grid-wide coordination and full-day capacity planning, performs the best. PlanShare reduces DC emissions by 11.6%--12.6%, 1.56x--1.26x better than the best local, online approach's results. PlanShare also achieves lower cost. We expect these advantages to increase as renewable generation in power grids increases. Further, a known full-day DC capacity plan provides a stable target for DC resource management.
- 2009. Follow the Sun, Wind, Moon. https://www.vertatique.com/cloud-computing-starting-follow-sunwindmoon.
- 2018. Lancium. https://www.lancium.com. A startup company, building zero-carbon cloud computing resources..
- 2019. Clicking Clean Virginia: The Dirty Energy Powering Data Center Alley. https://www.greenpeace.org/usa/reports/click-clean-virginia/.
- A Holistic Approach for Designing Carbon Aware Datacenters. arXiv preprint arXiv:2201.10036 (2022).
- U.S. Energy Information Administration. 2022. Electric Power Monthly. https://www.eia.gov/electricity/monthly/epm_table_grapher.php?t=epmt_5_03
- United States Environmental Protection Agency. 2020. Emissions & Generation Resource Integrated Database. https://www.epa.gov/egrid/data-explorer
- Learning from Optimal: Energy Procurement Strategies for Data Centers. In Proceedings of the Tenth ACM International Conference on Future Energy Systems (Phoenix, AZ, USA) (e-Energy ’19). Association for Computing Machinery, New York, NY, USA, 326–330. https://doi.org/10.1145/3307772.3328308
- Amazon. 2022. 2021 Environmental Report. Available from https://sustainability.aboutamazon.com/reporting-and-downloads.
- Amazon Web Services (AWS). [n. d.]. Amazon Global Datacenters.
- Enabling Sustainable Clouds: The Case for Virtualizing the Energy System. In Proceedings of the ACM Symposium on Cloud Computing. 350–358.
- Integrating Variable Renewable Energy: Challenges and Solutions. Technical Report. NREL.
- Bloomberg. 2018. European Union Aims to Be First Carbon Neutral Major Economy by 2050. Fortune (November 2018).
- John Campbell. 2022. Data centres used 14% of Republic of Ireland’s electricity use. https://www.bbc.com/news/world-europe-61308747
- Greening multi-tenant data center demand response. Performance Evaluation 91 (2015), 229–254.
- An online market mechanism for edge emergency demand response via cloudlet control. In IEEE INFOCOM 2019-IEEE Conference on Computer Communications. IEEE, 2566–2574.
- Andrew A Chien. 2020. Characterizing Opportunity Power in the California Independent System Operator (CAISO) in Years 2015-2017. Energy and Earth Science 3, 2 (December 2020). Also available as University of Chicago, Computer Science TR-2018-07, https://newtraell.cs.uchicago.edu/research/publications/techreports.
- The Zero-Carbon Cloud: High-Value, Dispatchable Demand for Renewable Power Generators. The Electricity Journal (2015), 110–118.
- Characterizing Curtailed and Uneconomic Renewable Power in the Mid-continent Independent System Operator. AIMS Energy 6, 2 (December 2018), 376–401.
- Microsoft Corporation. 2021. Microsft 2021 Environmental Sustainability Report. Available from https://www.microsoft.com/en-us/corporate-responsibility/sustainability/report.
- Olivier Corradi. 2022. Marginal vs average: which one to use in practice? https://www.electricitymaps.com/blog/marginal-vs-average-real-time-decision-making
- Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms. In Proceedings of the 26th Symposium on Operating Systems Principles (SOSP ’17). 153–167. https://doi.org/10.1145/3132747.3132772
- CPUC. [n. d.]. California Public Utilities Commission (CPUC). https://www.cpuc.ca.gov/rps.
- Harnessing renewable energy in cloud datacenters: opportunities and challenges. iEEE Network 28, 1 (2014), 48–55.
- Carbon-aware electricity cost minimization for sustainable data centers. IEEE Transactions on Sustainable Computing 2, 2 (2017), 211–223.
- William Driscoll. 2022. California law would target 90% renewable and zero-carbon electricity by 2035. https://pv-magazine-usa.com/2022/09/06/california-law-would-target-90-renewable-and-zero-carbon-electricity-by-2035/
- JuMP: A modeling language for mathematical optimization. SIAM review 59, 2 (2017), 295–320.
- Dominion Energy. 2018. 2018 Virginia Integrated Resource Plan. https://rga.lis.virginia.gov/Published/2018/RD249
- Dominion Energy. 2020. 2020 Virginia Integrated Resource Plan. https://www.dominionenergy.com/-/media/pdfs/global/2020-va-integrated-resource-plan.pdf
- Dominion Energy. 2021. 2021 Update to the 2020 Integrated Resource Plan. https://www.dominionenergy.com/-/media/pdfs/global/company/2021-de-integrated-resource-plan.pdf
- Mary Jo Foley. 2022. Cloud revenues power Microsoft’s $51.7 billion Q2 in fiscal year 2022. https://www.zdnet.com/article/microsoft-cloud-revenues-power-microsofts-51-7-billion-second-fy22-quarter/.
- Robbie Galvin. 2021. Data Centers Are Pushing Ireland’s Electric Grid to the Brink. https://gizmodo.com/data-centers-are-pushing-ireland-s-electric-grid-to-the-1848282390
- Parasol and greenswitch: Managing datacenters powered by renewable energy. In ACM SIGARCH Computer Architecture News. ACM, 51–64.
- Caroline Golin and Nick Pearson. 2022. A policy roadmap for 24/7 carbon-free energy. https://cloud.google.com/blog/topics/sustainability/a-policy-roadmap-for-achieving-247-carbon-free-energy
- Google. [n. d.]. About Google Datacenters. https://www.google.com/about/datacenters/.
- Google. 2018. Moving toward 24x7 Carbon-Free Energy at Google Data Centers: Progress and Insights. Technical Report. Google.
- Google. 2022. Google 2021 Environmental Report. Available from https://www.gstatic.com/gumdrop/sustainability/google-2022-environmental-report.pdf.
- Efficient solar provisioning for net-zero Internet-scale distributed networks. In 2018 10th International Conference on Communication Systems Networks (COMSNETS). 372–379.
- LLC Gurobi Optimization. 2020. Gurobi Optimizer Reference Manual. http://www.gurobi.com
- GWEC. 2016. Global Wind Report: Annual Market Update. Technical Report. Global Wind Energy Council. Documents curtailment around the world.
- Siqi Han. 2015. The Wind is Wasted in China. https://www.wilsoncenter.org/.
- Kevin Imboden. 2021. 2022 Global Data Center Market Comparison. https://cushwake.cld.bz/2022-Global-Data-Center-Market-Comparison
- California ISO. 2016. Greenhouse Gas Emission Tracking Methodology. https://www.caiso.com/Documents/GreenhouseGasEmissionsTracking-Methodology.pdf
- California ISO. 2022a. Managing Oversupply. https://www.caiso.com/informed/Pages/ManagingOversupply.aspx
- California ISO. 2022b. Market Processes and Products. http://www.caiso.com/market/Pages/MarketProcesses.aspx
- Nicola Jones. 2018. How to Stop Data Centres from Gobbling up the World’s Electricity. Nature (September 2018).
- Lucas Joppa. 2021. Made to measure: Sustainability commitment progress and updates. https://blogs.microsoft.com/blog/2021/07/14/made-to-measure-sustainability-commitment-progress-and-updates/
- Peter Judge. 2022a. Dominion Energy admits it can’t meet data center power demands in Virginia. https://www.datacenterdynamics.com/en/news/dominion-energy-admits-it-cant-meet-data-center-power-demands-in-virginia/
- Peter Judge. 2022b. EirGrid pulls plug on 30 Irish data center projects. https://www.datacenterdynamics.com/en/news/eirgrid-pulls-plug-on-30-irish-data-center-projects/
- Peter Judge. 2022c. Google and Microsoft join long term energy storage group. https://www.datacenterdynamics.com/en/news/google-and-microsoft-join-long-term-energy-storage-group/
- Data Centers as Dispatchable Loads to Harness Stranded Power. IEEE Transactions on Sustainable Energy (2016). DOI 10.1109/TSTE.2016.2593607.
- Wook Hyun Kwon and Soo Hee Han. 2006. Receding horizon control: model predictive control for state models. Springer Science & Business Media.
- Capping the Brown Energy Consumption of Internet Services at Low Cost. In Proceedings of the International Conference on Green Computing (GREENCOMP ’10). IEEE Computer Society, USA, 3–14. https://doi.org/10.1109/GREENCOMP.2010.5598305
- Joint capacity planning and operational management for sustainable data centers and demand response. In Proceedings of the Seventh International Conference on Future Energy Systems. 1–12.
- Michelle Lewis. 2023. These big tech firms bought the most clean energy in 2022. Available from https://electrek.co/2023/02/09/big-tech-clean-energy-2022/.
- Liuzixuan Lin and Andrew A. Chien. 2020. Characterizing Stranded Power in the ERCOT in Years 2012-2019: A Preliminary Report. Technical Report TR-2020-06. University of Chicago.
- Evaluating Coupling Models for Cloud Datacenters and Power Grids. In Proceedings of the Twelfth ACM International Conference on Future Energy Systems. 171–184.
- Dynamic right-sizing for power-proportional data centers. IEEE/ACM Transactions on Networking 21, 5 (2012), 1378–1391.
- A Guide to Reducing Carbon Emissions through Data Center Geographical Load Shifting. In Proceedings of the Twelfth ACM International Conference on Future Energy Systems. 430–436.
- The Environmental Potential of Hyper-Scale Data Centers: Using Locational Marginal CO2 Emissions to Guide Geographical Load Shifting. In Proceedings of the 54th Hawaii International Conference on System Sciences. 3158.
- Renewable and cooling aware workload management for sustainable data centers. In Proceedings of the 12th ACM SIGMETRICS/PERFORMANCE joint international conference on Measurement and Modeling of Computer Systems. 175–186.
- Greening Geographical Load Balancing. IEEE/ACM Transactions on Networking 23, 2 (2015), 657–671.
- Data center demand response: Avoiding the coincident peak via workload shifting and local generation. Performance Evaluation 70, 10 (2013), 770–791.
- Temporal load balancing with service delay guarantees for data center energy cost optimization. IEEE Transactions on Parallel and Distributed Systems 25, 3 (2013), 775–784.
- Electricity Maps. 2022. Electricity Maps. https://app.electricitymaps.com/map
- Recalibrating global data center energy-use estimates. Science 367, 6481 (2020), 984–986. https://doi.org/10.1126/science.aba3758 arXiv:https://science.sciencemag.org/content/367/6481/984.full.pdf
- Global warming of 1.5 C. An IPCC Special Report on the impacts of global warming of 1, 5 (2018).
- James McAnany. 2021. 2021 Demand Response Operations Markets Activity Report: January 2022. https://www.pjm.com/-/media/markets-ops/dsr/2021-demand-response-activity-report.ashx
- Modeling and analysis of utilizing cryptocurrency mining for demand flexibility in electric energy systems: A synthetic texas grid case study. IEEE Transactions on Energy Markets, Policy and Regulation (2023).
- Microsoft Azure. [n. d.]. Azure Global Datacenters. https://azure.microsoft.com/en-us/global-infrastructure/.
- Rich Miller. 2022. Dominion Energy Plans More Green Power for Virginia’s Data Centers. https://datacenterfrontier.com/dominion-energy-plans-more-green-power-for-virginias-data-centers/
- Electric Reliability Council of Texas. [n. d.]. Large Flexible Load Task Force. https://www.ercot.com/committees/tac/lfltf.
- Anthony Papavasiliou and Shmuel S Oren. 2013. Multiarea stochastic unit commitment for high wind penetration in a transmission constrained network. Operations Research 61, 3 (2013), 578–592.
- Brian Peccarelli. 2020. Three Ways COVID-19 is Accelerating Digital Transformation in Professional Services. (June 2020). https://bit.ly/34Qitb5, 37% growth.
- Sundar Pichai. 2019. Our biggest renewable energy purchase ever. https://blog.google/outreach-initiatives/sustainability/our-biggest-renewable-energy-purchase-ever/
- New York State Energy Planning Board. 2015. The Energy to Lead: 2015 New York State Energy Plan. http://energyplan.ny.gov/Plans/2015.aspx.
- 20% of US electricity from wind will have limited impacts on system efficiency and regional climate. Scientific reports 10, 1 (2020), 1–14.
- Cutting the Electric Bill for Internet-Scale Systems. In Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication (Barcelona, Spain) (SIGCOMM ’09). Association for Computing Machinery, New York, NY, USA, 123–134. https://doi.org/10.1145/1592568.1592584
- Carbon-Aware Computing for Datacenters. arXiv preprint arXiv:2106.11750 (2021).
- John Roach. 2021. Microsoft’s virtual datacenter grounds ‘the cloud’ in reality. Microsoft to build 50 to 100 datacenters per year, https://news.microsoft.com/innovation-stories/microsofts-virtual-datacenter-grounds-the-cloud-in-reality/.
- Green AI. Commun. ACM 63, 12 (nov 2020), 54–63. https://doi.org/10.1145/3381831
- Leveraging energy storage to optimize data center electricity cost in emerging power markets. In Proceedings of the Seventh International Conference on Future Energy Systems. 1–13.
- Staff. 2020. COVID-19 Accelerates Cloud Adoption, Market to Reach $1 trillion, IDC. Equipment FA News (October 2020). https://www.equipmentfa.com/news/31459/covid-19-accelerates-cloud-adoption-market-to-reach-1t-idc.
- Grid Accommodation of Dynamic HPC Demand. In Proceedings of the 48th International Conference on Parallel Processing: Workshops (Kyoto, Japan) (ICPP 2019). Association for Computing Machinery, New York, NY, USA, Article 9, 4 pages. https://doi.org/10.1145/3339186.3339214
- An online incentive mechanism for emergency demand response in geo-distributed colocation data centers. In Proceedings of the seventh international conference on future energy systems. 1–13.
- Borg: The next Generation. In Proceedings of the Fifteenth European Conference on Computer Systems (Heraklion, Greece) (EuroSys ’20). Association for Computing Machinery, New York, NY, USA, Article 30, 14 pages. https://doi.org/10.1145/3342195.3387517
- United Nations Framework Convention on Climate Change. 2015. Paris Climate Change Conference. http://unfccc.int/meetings/paris_nov_2015/meeting/8926.php.
- Optimal power cost management using stored energy in data centers. In Proceedings of the ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems. 221–232.
- Jonathan Vanian and Kif Leswing. 2023. ChatGPT and generative AI are booming, but the costs can be extraordinary. https://www.cnbc.com/2023/03/13/chatgpt-and-generative-ai-are-booming-but-at-a-very-expensive-price.html
- Markus Wacket. 2021. German parties agree on 2030 coal phase-out in coalition talks. https://www.reuters.com/business/cop/exclusive-germanys-government-in-waiting-agrees-phase-out-coal-by-2030-sources-2021-11-23/
- WattTime. 2022. Automated Emissions Reduction. https://www.watttime.org/solutions/automated-emissions-reduction-aer/
- Fan Yang and Andrew A Chien. 2016. ZCCloud: Exploring wasted green power for high-performance computing. In 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 1051–1060.
- Fan Yang and Andrew A. Chien. 2017. Large-scale and Extreme-Scale Computing with Stranded Green Power: Opportunities and Costs. IEEE Transactions on Parallel and Distributed Systems 29, 5 (December 2017).
- Online Inventory Management with Application to Energy Procurement in Data Centers. CoRR abs/1901.04372 (2019). arXiv:1901.04372 http://arxiv.org/abs/1901.04372
- Chaojie Zhang. 2022. Eliminating the Capacity Variation Penalty for Cloud Resource Management. Ph. D. Dissertation. The University of Chicago, Chicago, IL, USA. Advisor(s) Chien, Andrew A.
- Chaojie Zhang and Andrew A Chien. 2021. Scheduling Challenges for Variable Capacity Resources. In Workshop on Job Scheduling for Parallel Processing (JSSPP).
- A truthful incentive mechanism for emergency demand response in colocation data centers. In 2015 IEEE Conference on Computer Communications (INFOCOM). IEEE, 2632–2640.
- Flexibility from networks of data centers: A market clearing formulation with virtual links. Electric Power Systems Research 189 (2020), 106723.
- Electricity bill capping for cloud-scale data centers that impact the power markets. In 2012 41st International Conference on Parallel Processing. IEEE, 440–449.
- Mitigating Curtailment and Carbon Emissions through Load Migration between Data Centers. Joule (October 2020). https://doi.org/10.1016/j.joule.2020.08.001
- A truthful and efficient incentive mechanism for demand response in green datacenters. IEEE Transactions on Parallel and Distributed Systems 31, 1 (2018), 1–15.
- Fuel cell generation in geo-distributed cloud services: A quantitative study. In 2014 IEEE 34th International Conference on Distributed Computing Systems. IEEE, 52–61.
- Carbon-Aware Online Control of Geo-Distributed Cloud Services. IEEE Transactions on Parallel and Distributed Systems 27, 9 (2016), 2506–2519.
- Liuzixuan Lin (2 papers)
- Andrew A. Chien (9 papers)