Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
153 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Storm Surge Modeling in the AI ERA: Using LSTM-based Machine Learning for Enhancing Forecasting Accuracy (2403.04818v1)

Published 7 Mar 2024 in cs.LG and physics.ao-ph

Abstract: Physics simulation results of natural processes usually do not fully capture the real world. This is caused for instance by limits in what physical processes are simulated and to what accuracy. In this work we propose and analyze the use of an LSTM-based deep learning network ML architecture for capturing and predicting the behavior of the systemic error for storm surge forecast models with respect to real-world water height observations from gauge stations during hurricane events. The overall goal of this work is to predict the systemic error of the physics model and use it to improve the accuracy of the simulation results post factum. We trained our proposed ML model on a dataset of 61 historical storms in the coastal regions of the U.S. and we tested its performance in bias correcting modeled water level data predictions from hurricane Ian (2022). We show that our model can consistently improve the forecasting accuracy for hurricane Ian -- unknown to the ML model -- at all gauge station coordinates used for the initial data. Moreover, by examining the impact of using different subsets of the initial training dataset, containing a number of relatively similar or different hurricanes in terms of hurricane track, we found that we can obtain similar quality of bias correction by only using a subset of six hurricanes. This is an important result that implies the possibility to apply a pre-trained ML model to real-time hurricane forecasting results with the goal of bias correcting and improving the produced simulation accuracy. The presented work is an important first step in creating a bias correction system for real-time storm surge forecasting applicable to the full simulation area. It also presents a highly transferable and operationally applicable methodology for improving the accuracy in a wide range of physics simulation scenarios beyond storm surge forecasting.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. A.B. Smith. U.s. billion-dollar weather and climate disasters, 1980 - present (ncei accession 0209268), 2023.
  2. Response of storm-related extreme sea level along the u.s. atlantic coast to combined weather and climate forcing. Journal of Climate, 33(9):3745–3769, May 2020. ISSN 1520-0442. doi:10.1175/jcli-d-19-0551.1.
  3. Tide and storm surge predictions using finite element model. Journal of Hydraulic Engineering, 118(10):1373–1390, October 1992. doi:10.1061/(asce)0733-9429(1992)118:10(1373).
  4. Adcirc: an advanced three-dimensional circulation model for shelves, coasts, and estuaries. report 1, theory and methodology of adcirc-2dd1 and adcirc-3dl. 1992.
  5. Performance of the unstructured-mesh, swan+adcirc model in computing hurricane waves and surge. Journal of Scientific Computing, 52(2):468–497, November 2011. ISSN 1573-7691. doi:10.1007/s10915-011-9555-6.
  6. Visualizing uncertainties in a storm surge ensemble data assimilation and forecasting system. Natural Hazards, 77(1):317–336, January 2015. ISSN 1573-0840. doi:10.1007/s11069-015-1596-y.
  7. Ensemble forecast for storm tide and resurgence from tropical cyclone isaias. Weather and Climate Extremes, 38:100504, December 2022. ISSN 2212-0947. doi:10.1016/j.wace.2022.100504.
  8. Assessing storm surge multiscenarios based on ensemble tropical cyclone forecasting. Journal of Geophysical Research: Atmospheres, 128(23), December 2023. ISSN 2169-8996. doi:10.1029/2023jd038903.
  9. Quantifying impacts of forecast uncertainties on predicted storm surges. Natural Hazards, 88(3):1423–1449, May 2017. ISSN 1573-0840. doi:10.1007/s11069-017-2924-1.
  10. Efficient probabilistic storm surge estimation through adaptive importance sampling across storm advisories. Coastal Engineering, 183:104287, August 2023. ISSN 0378-3839. doi:10.1016/j.coastaleng.2023.104287.
  11. A review of application of machine learning in storm surge problems. Journal of Marine Science and Engineering, 11(9):1729, September 2023. ISSN 2077-1312. doi:10.3390/jmse11091729.
  12. A framework for flexible peak storm surge prediction. Coastal Engineering, 186:104406, 2023. ISSN 0378-3839. doi:10.1016/j.coastaleng.2023.104406.
  13. S. Mafi and G. Amirinia. Forecasting hurricane wave height in gulf of mexico using soft computing methods. Ocean Engineering, 146:352–362, 2017. ISSN 0029-8018. doi:10.1016/j.oceaneng.2017.10.003.
  14. Rapid prediction of peak storm surge from tropical cyclone track time series using machine learning. Coastal Engineering, 170:104024, December 2021. doi:10.1016/j.coastaleng.2021.104024.
  15. A. Al Kajbaf and M. Bensi. Application of surrogate models in estimation of storm surge:a comparative assessment. Applied Soft Computing, 91:106184, June 2020. ISSN 1568-4946. doi:10.1016/j.asoc.2020.106184.
  16. Estimating hurricane-induced vertical surge and wave loads on elevated coastal buildings based on cfd simulations and ensemble learning. Coastal Engineering, 183:104325, 2023. ISSN 0378-3839. doi:10.1016/j.coastaleng.2023.104325.
  17. A review of recurrent neural networks: Lstm cells and network architectures. Neural Computation, 31(7):1235–1270, July 2019. ISSN 1530-888X. doi:10.1162/neco_a_01199.
  18. A. Graves. Generating sequences with recurrent neural networks. 2013. doi:10.48550/ARXIV.1308.0850.
  19. Systematization of short-term forecasts of regional wave heights using a machine learning technique and long-term wave hindcast. Ocean Engineering, 264:112593, November 2022. ISSN 0029-8018. doi:10.1016/j.oceaneng.2022.112593.
  20. WAVEWATCH III® Model Description. https://polar.ncep.noaa.gov/waves/wavewatch/, 2023a.
  21. WAVEWATCH III® 30-year Hindcast Phase 2. https://polar.ncep.noaa.gov/waves/hindcasts/nopp-phase2.php, 2023b.
  22. Prediction of significant wave height in hurricane area of the atlantic ocean using the bi-lstm with attention model. Ocean Engineering, 266:112747, 2022. ISSN 0029-8018. doi:10.1016/j.oceaneng.2022.112747.
  23. L.-H. Bai and H. Xu. Accurate estimation of tidal level using bidirectional long short-term memory recurrent neural network. Ocean Engineering, 235:108765, September 2021. ISSN 0029-8018. doi:10.1016/j.oceaneng.2021.108765.
  24. L.-H. Bai and H. Xu. Accurate storm surge forecasting using the encoder–decoder long short term memory recurrent neural network. Physics of Fluids, 34(1), January 2022. ISSN 1089-7666. doi:10.1063/5.0081858.
  25. Exploring deep learning capabilities for surge predictions in coastal areas. Scientific Reports, 11(1), August 2021. ISSN 2045-2322. doi:10.1038/s41598-021-96674-0.
  26. The ERA5 global reanalysis. Quarterly Journal of the Royal Meteorological Society, 146(730):1999–2049, June 2020. ISSN 1477-870X. doi:10.1002/qj.3803.
  27. GESLA (global extreme sea level analysis) high frequency sea level dataset - version 2., 2016.
  28. Z. Wei. Forecasting wind waves in the us atlantic coast using an artificial neural network model: Towards an ai-based storm forecast system. Ocean Engineering, 237:109646, October 2021. ISSN 0029-8018. doi:10.1016/j.oceaneng.2021.109646.
  29. Statistical bias correction for simulated wind speeds over cordex-east asia. Earth and Space Science, 6(2):200–211, February 2019. ISSN 2333-5084. doi:10.1029/2018ea000493.
  30. F. Wang and D. Tian. On deep learning-based bias correction and downscaling of multiple climate models simulations. Climate Dynamics, 59(11–12):3451–3468, April 2022. ISSN 1432-0894. doi:10.1007/s00382-022-06277-2.
  31. Deep learning for daily precipitation and temperature downscaling. Water Resources Research, 57(4), April 2021. ISSN 1944-7973. doi:10.1029/2020wr029308.
  32. A deep learning-based bias correction method for predicting ocean surface waves in the northwest pacific ocean. Geophysical Research Letters, 49(23):e2022GL100916, 2022. doi:10.1029/2022GL100916.
  33. Medical image computing and computer-assisted intervention–MICCAI 2015. Lecture Notes in Computer Science, 9351:234–241, 2015.
  34. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In F. Bach and D. Blei, editors, Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 448–456, Lille, France, 07–09 Jul 2015. PMLR.
  35. An application of a machine learning algorithm to determine and describe error patterns within wave model output. Coastal Engineering, 157:103595, April 2020. ISSN 0378-3839. doi:10.1016/j.coastaleng.2019.103595.
  36. The ncep–fnmoc combined wave ensemble product: Expanding benefits of interagency probabilistic forecasts to the oceanic environment. Bulletin of the American Meteorological Society, 94(12):1893–1905, December 2013. ISSN 1520-0477. doi:10.1175/bams-d-12-00032.1.
  37. Improving ncep’s global-scale wave ensemble averages using neural networks. Ocean Modelling, 149:101617, May 2020. ISSN 1463-5003. doi:10.1016/j.ocemod.2020.101617.
  38. A hybrid deep learning model for the bias correction of sst numerical forecast products using satellite data. Remote Sensing, 14(6):1339, March 2022. ISSN 2072-4292. doi:10.3390/rs14061339.
  39. Deep learning for bias correction of mjo prediction. Nature Communications, 12(1), May 2021. ISSN 2041-1723. doi:10.1038/s41467-021-23406-3.
  40. Adcirc/swan hindcasts for historical storms 2003-2022, 2023. URL https://www.designsafe-ci.org/data/browser/public/designsafe.storage.published/PRJ-3932/#details-5508251847528869395-242ac117-0001-012.
  41. CERA - Coastal Emergency Risk Accessment. Center for Computation and Technology at Louisiana State University. https://cera.coastalrisk.live/, 2024.
  42. NOAA. Water levels - station selection, 2023. URL https://tidesandcurrents.noaa.gov/stations.html.
  43. USGS. Usgs current water data for the nation, 2023. URL https://waterdata.usgs.gov/nwis/rt.
  44. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2):157–166, March 1994. ISSN 1941-0093. doi:10.1109/72.279181.
  45. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735–1780, November 1997. ISSN 1530-888X. doi:10.1162/neco.1997.9.8.1735.
  46. Deep convolutional neural networks on multichannel time series for human activity recognition. In Ijcai, volume 15, pages 3995–4001. Buenos Aires, Argentina, 2015.
  47. 1d convolutional neural networks and applications: A survey. Mechanical Systems and Signal Processing, 151:107398, April 2021. ISSN 0888-3270. doi:10.1016/j.ymssp.2020.107398.
  48. Deep learning. nature, 521(7553):436–444, 2015. doi:10.1038/nature14539.
  49. Activation functions in neural networks. Towards Data Sci, 6(12):310–316, 2017.
  50. D.P. Kingma and J. Ba. Adam: A method for stochastic optimization, 2014.
  51. P.I. Frazier. A tutorial on bayesian optimization, 2018.
  52. Scikit-learn: Machine learning in python. the Journal of machine Learning research, 12:2825–2830, 2011.
  53. A. Géron. Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow. " O’Reilly Media, Inc.", 2022.
  54. F. Wilcoxon. Individual comparisons by ranking methods. Biometrics Bulletin, 1(6):80, December 1945. ISSN 0099-4987. doi:10.2307/3001968.
Citations (7)

Summary

  • The paper presents an LSTM-based technique that corrects systemic biases in physics-based storm surge models using historical hurricane data.
  • It employs rigorous preprocessing with a sliding window approach to effectively capture the temporal dynamics of storm surge events.
  • The model demonstrates significant accuracy improvements during Hurricane Ian, showcasing its potential for operational real-time forecasting.

Enhancing Storm Surge Forecasting Accuracy Through LSTM-Based Machine Learning

Introduction

The accuracy and reliability of storm surge modeling are pivotal in predicting the potentially devastating impact of hurricanes. Despite the advancements in high fidelity physics-based models such as ADCIRC coupled with SWAN, limitations inherent in these deterministic models often introduce biases and inaccuracies, particularly in the face of the unpredictable nature of severe weather events. The paper by Stefanos Giaremis et al. on "Storm Surge Modeling in the AI Era: Using LSTM-based Machine Learning for Enhancing Forecasting Accuracy" presents an innovative approach to mitigate these issues by employing Long Short-Term Memory (LSTM) networks, a class of recurrent neural networks, in the post-processing phase of storm surge modeling to correct systemic errors and enhance forecasting accuracy.

Methodology

The cornerstone of the research methodology is the utilization of LSTM networks to model and predict the systemic errors—termed as offsets—between the observed real-world water heights and those forecasted by a physics-based model during hurricane events. The LSTM architecture was chosen for its proficiency in capturing temporal dependencies, essential for accurately modeling the sequential data of storm surges. The paper trained the LSTM model on a comprehensive dataset encompassing 61 historical storms, using offsets extracted from the comparison of modeled versus observed water levels at gauge stations. A notable aspect of the research methodology is the rigorous data pre-processing, which includes offset extraction, standardization, and reshaping through a sliding window approach, making the raw data amenable to LSTM processing. The performance of the LSTM-based model was then tested for bias correction on data from hurricane Ian, a recent and significant event, ensuring the model's real-world applicability and generalization capabilities.

Results and Discussion

The research presented compelling numerical results, with the LSTM model showing consistent improvement in forecasting accuracy for hurricane Ian across all gauge station coordinates used for the initial data. This improvement was quantified using several regression evaluation metrics, such as root mean square error (RMSE) and R-squared coefficients, showcasing strong numerical evidence of the model's efficacy in bias correction. An intriguing finding was the model's ability to achieve a similar quality of bias correction using only a subset of six hurricanes. This implies not only the model's robustness but also its operational versatility, allowing for pre-trained models to be applied in real-time hurricane forecasting, significantly reducing the computational overhead typically associated with ensemble and probabilistic forecasting approaches.

Theoretical and Practical Implications

Theoretically, this work enriches the existing literature on the integration of machine learning techniques, particularly LSTM networks, within the field of weather forecasting and storm surge modeling. Practically, the LSTM-based bias correction methodology offers a highly transferable and operationally viable solution to improve the accuracy of storm surge forecasts, potentially enhancing the preparedness and response mechanisms of affected regions. Furthermore, the paper sets the groundwork for future explorations into the application of LSTM and other advanced machine learning techniques for bias correction across a wider range of physics simulation scenarios beyond storm surge forecasting.

Future Directions

While this paper marks a significant advancement, it also opens avenues for further research, particularly in exploring alternative machine learning architectures like bidirectional LSTMs with self-attention mechanisms, which could offer further improvements in capturing the complex temporal dynamics of storm surges. Additionally, extending the LSTM-based bias correction to a geospatial domain, enabling model corrections beyond gauge stations and throughout the entire simulation area, represents a compelling future challenge.

In conclusion, the paper by Stefanos Giaremis et al. presents a pioneering approach to enhancing storm surge forecasting accuracy using LSTM-based machine learning. By accurately modeling and correcting the systemic errors of physics-based models, this research offers new possibilities for improving the resilience of coastal communities against the ever-present threat of hurricanes

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets