A proximal policy optimization based intelligent home solar management
Abstract: In the smart grid, the prosumers can sell unused electricity back to the power grid, assuming the prosumers own renewable energy sources and storage units. The maximizing of their profits under a dynamic electricity market is a problem that requires intelligent planning. To address this, we propose a framework based on Proximal Policy Optimization (PPO) using recurrent rewards. By using the information about the rewards modeled effectively with PPO to maximize our objective, we were able to get over 30\% improvement over the other naive algorithms in accumulating total profits. This shows promise in getting reinforcement learning algorithms to perform tasks required to plan their actions in complex domains like financial markets. We also introduce a novel method for embedding longs based on soliton waves that outperformed normal embedding in our use case with random floating point data augmentation.
- “Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer” In CoRR abs/1701.06538, 2017 arXiv: http://arxiv.org/abs/1701.06538
- “Proximal Policy Optimization Algorithms” In CoRR abs/1707.06347, 2017 arXiv: http://arxiv.org/abs/1707.06347
- “Deep Reinforcement Learning for Real-Time Energy Management in Smart Home” In IEEE Systems Journal 17.2, 2023, pp. 2489–2499 DOI: 10.1109/JSYST.2023.3247592
- “Real-time energy scheduling for home energy management systems with an energy storage system and electric vehicle based on a supervised-learning-based strategy” In Energy Conversion and Management 292, 2023, pp. 117340 DOI: https://doi.org/10.1016/j.enconman.2023.117340
- “Reinforcement Learning-Based Energy Management of Smart Home with Rooftop Solar Photovoltaic System, Energy Storage System, and Home Appliances” In Sensors 19.18, 2019 DOI: 10.3390/s19183937
- Sattar Mohammadi, Mahmoud Momtazpour and Esmaeil Sanaei “Optimization-based home energy management in the presence of solar energy and storage” In 2013 21st Iranian Conference on Electrical Engineering (ICEE), 2013, pp. 1–6 DOI: 10.1109/IranianCEE.2013.6599649
- “Managing Price Uncertainty in Prosumer-Centric Energy Trading: A Prospect-Theoretic Stackelberg Game Approach” In IEEE Transactions on Smart Grid 10.1, 2019, pp. 702–713 DOI: 10.1109/TSG.2017.2750706
- “Home load and solar power management under real-time prices” In 2014 14th International Conference on Environment and Electrical Engineering, 2014, pp. 5–10 DOI: 10.1109/EEEIC.2014.6835827
- “Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid” In IEEE Transactions on Smart Grid 1.3, 2010, pp. 320–331 DOI: 10.1109/TSG.2010.2089069
- “Don’t throw away your value model! Making PPO even better via Value-Guided Monte-Carlo Tree Search decoding”, 2023 arXiv:2309.15028 [cs.CL]
- “Grandmaster-Level Chess Without Search”, 2024 arXiv:2402.04494 [cs.LG]
- “CO2 Emission Forecasting for Living Standards in Smart Cities” In SoutheastCon 2023, 2023, pp. 187–192 DOI: 10.1109/SoutheastCon51012.2023.10115183
- Matthias Schonlau and Rosie Yuyan Zou “The random forest algorithm for statistical learning” In The Stata Journal: Promoting communications on statistics and Stata 20.1, 2020, pp. 3–29 DOI: 10.1177/1536867X20909688
- “Long Short-Term Memory” In Neural Comput. 9.8 Cambridge, MA, USA: MIT Press, 1997, pp. 1735–1780 DOI: 10.1162/neco.1997.9.8.1735
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.