Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Transactive Local Energy Markets Enable Community-Level Resource Coordination Using Individual Rewards (2403.15617v1)

Published 22 Mar 2024 in eess.SY, cs.MA, and cs.SY

Abstract: ALEX (Autonomous Local Energy eXchange) is an economy-driven, transactive local energy market where each participating building is represented by a rational agent. Relying solely on building-level information, this agent minimizes its electricity bill by automating distributed energy resource utilization and trading. This study examines ALEX's capabilities to align participant and grid-stakeholder interests and assesses ALEX's impact on short- and long-term intermittence using a set of community net-load metrics, such as ramping rate, load factor, and peak load. The policies for ALEX's rational agents are generated using dynamic programming through value iteration in conjunction with iterative best response. This facilitates comparing ALEX and a benchmark energy management system, which optimizes building-level self-consumption, ramping rate, and peak net load. Simulations are performed using the open-source CityLearn2022 dataset to provide a pathway for benchmarking by future studies. The experiments demonstrate that ALEX enables the coordination of distributed energy resources across the community. Remarkably, this community-level coordination occurs even though the system is populated by agents who only access building-level information and selfishly maximize their own relative profit. Compared to the benchmark energy management system, ALEX improves across all metrics.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. I. R. E. Agency, “Global energy transformation: A roadmap to 2050 (2019 edition),” International Renewable Energy Agency, Tech. Rep., 2019. [Online]. Available: https://www.irena.org/publications/2019/Apr/Global-energy-transformation-A-roadmap-to-2050-2019Edition.
  2. S. Chen and C.-C. Liu, “From demand response to transactive energy: state of the art,” Journal of Modern Power Systems and Clean Energy, vol. 5, no. 1, pp. 10–19, 2017.
  3. R. B. Melton, “Gridwise transactive energy framework,” The GridWise Architecture Council, Tech. Rep., 2019. [Online]. Available: https://gridwiseac.org/pdfs/pnnl_22946_gwac_te_framework_july_2019_v1_1.pdf
  4. E. Mengelkamp, J. Diesing, and C. Weinhardt, “Tracing local energy markets: A literature review,” it - Information Technology, vol. 61, no. 2-3, pp. 101–110, 2019. [Online]. Available: https://doi.org/10.1515/itit-2019-0016
  5. T. Capper, A. Gorbatcheva, M. A. Mustafa, M. Bahloul, J. M. Schwidtal, R. Chitchyan, M. Andoni, V. Robu, M. Montakhabi, I. J. Scott, C. Francis, T. Mbavarira, J. M. Espana, and L. Kiesling, “Peer-to-peer, community self-consumption, and transactive energy: A systematic literature review of local energy market models,” Renewable and Sustainable Energy Reviews, vol. 162, p. 112403, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1364032122003112
  6. V. Dudjak, D. Neves, T. Alskaif, S. Khadem, A. Pena-Bello, P. Saggese, B. Bowler, M. Andoni, M. Bertolini, Y. Zhou, B. Lormeteau, M. A. Mustafa, Y. Wang, C. Francis, F. Zobiri, D. Parra, and A. Papaemmanouil, “Impact of local energy markets integration in power systems layer: A comprehensive review,” Applied Energy, vol. 301, p. 117434, 2021. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0306261921008266
  7. D. Kiedanski, D. Kofman, P. Maillé, and J. Horta, “Misalignments of objectives in demand response programs: a look at local energy markets,” in 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), 2020, pp. 1–7.
  8. D. Papadaskalopoulos and G. Strbac, “Nonlinear and randomized pricing for distributed management of flexible loads,” IEEE Transactions on Smart Grid, vol. 7, no. 2, pp. 1137–1146, 2016.
  9. S. Zhang, D. May, M. Gül, and P. Musilek, “Reinforcement learning-driven local transactive energy market for distributed energy resources,” Energy and AI, vol. 8, p. 100150, 03 2022.
  10. K. Nweye, S. Siva, and G. Z. Nagy, “The CityLearn Challenge 2022,” 2023. [Online]. Available: https://doi.org/10.18738/T8/0YLJ6Q
  11. K. Nweye, S. Sankaranarayanan, and Z. Nagy, “Merlin: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities,” Applied Energy, vol. 346, p. 121323, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0306261923006876
  12. E. Mengelkamp, S. Bose, E. Kremers, J. Eberbach, B. Hoffmann, and C. Weinhardt, “Increasing the efficiency of local energy markets through residential demand response,” Energy Informatics, vol. 1, pp. 1–18, 2018. [Online]. Available: https://doi.org/10.1186/s42162-018-0017-3
  13. E. Mengelkamp, J. Gärttner, and C. Weinhardt, “Intelligent agent strategies for residential customers in local electricity markets,” in Proceedings of the Ninth International Conference on Future Energy Systems, ser. e-Energy ’18.   New York, NY, USA: Association for Computing Machinery, 2018, p. 97–107. [Online]. Available: https://doi.org/10.1145/3208903.3208907
  14. J. R. Vazquez-Canteli, G. Henze, and Z. Nagy, “Marlisa: Multi-agent reinforcement learning with iterative sequential action selection for load shaping of grid-interactive connected buildings,” in Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, ser. BuildSys ’20.   New York, NY, USA: Association for Computing Machinery, 2020, p. 170–179. [Online]. Available: https://doi.org/10.1145/3408308.3427604
  15. J. Vázquez-Canteli and Z. Nagy, “Reinforcement learning for demand response: A review of algorithms and modeling techniques,” Applied Energy, vol. 235, pp. 1072–89, 02 2019.
  16. H. Zang and J. Kim, “Reinforcement learning based peer-to-peer energy trade management using community energy storage in local energy market,” Energies, vol. 14, no. 14, 2021. [Online]. Available: https://www.mdpi.com/1996-1073/14/14/4131
  17. X. Xu, Y. Jia, Y. Xu, Z. Xu, S. Chai, and C. S. Lai, “A multi-agent reinforcement learning-based data-driven method for home energy management,” IEEE Transactions on Smart Grid, vol. 11, no. 4, pp. 3201–3211, 2020.
  18. S. Zhang and P. Musilek, “The impact of battery storage on power flow and economy in an automated transactive energy market,” Energies, vol. 16, no. 5, 2023. [Online]. Available: https://www.mdpi.com/1996-1073/16/5/2251
  19. R. Bellman, “A markovian decision process,” Journal of Mathematics and Mechanics, vol. 6, no. 5, pp. 679–684, 1957. [Online]. Available: http://www.jstor.org/stable/24900506
  20. R. Coulom, “Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search,” in 5th International Conference on Computer and Games, P. Ciancarini and H. J. van den Herik, Eds., Turin, Italy, May 2006. [Online]. Available: https://inria.hal.science/inria-00116992
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now