Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge (2407.20902v1)
Abstract: Process-based hydrologic models are invaluable tools for understanding the terrestrial water cycle and addressing modern water resources problems. However, many hydrologic models are computationally expensive and, depending on the resolution and scale, simulations can take on the order of hours to days to complete. While techniques such as uncertainty quantification and optimization have become valuable tools for supporting management decisions, these analyses typically require hundreds of model simulations, which are too computationally expensive to perform with a process-based hydrologic model. To address this gap, we propose a hybrid modeling workflow in which a process-based model is used to generate an initial set of simulations and a ML surrogate model is then trained to perform the remaining simulations required for downstream analysis. As a case study, we apply this workflow to simulations of variably saturated groundwater flow at a prospective managed aquifer recharge (MAR) site. We compare the accuracy and computational efficiency of several ML architectures, including deep convolutional networks, recurrent neural networks, vision transformers, and networks with Fourier transforms. Our results demonstrate that ML surrogate models can achieve under 10% mean absolute percentage error and yield order-of-magnitude runtime savings over processed-based models. We also offer practical recommendations for training hydrologic surrogate models, including implementing data normalization to improve accuracy, using a normalized loss function to improve training stability and downsampling input features to decrease memory requirements.
- Review on Regional Water Resources Assessment Models under Stationary and Changing Climate. Water Resources Management, 18(6):591–612, December 2004. ISSN 0920-4741, 1573-1650. doi:10.1007/s11269-004-9130-0. URL http://link.springer.com/10.1007/s11269-004-9130-0.
- A Review on Hydrological Models. Aquatic Procedia, 4:1001–1007, 2015. ISSN 2214241X. doi:10.1016/j.aqpro.2015.02.126. URL https://linkinghub.elsevier.com/retrieve/pii/S2214241X15001273.
- Reactive transport codes for subsurface environmental simulation. Computational Geosciences, 19(3):445–478, June 2015. ISSN 1573-1499. doi:10.1007/s10596-014-9443-x. URL https://doi.org/10.1007/s10596-014-9443-x.
- Hyperresolution global land surface modeling: Meeting a grand challenge for monitoring Earth’s terrestrial water: OPINION. Water Resources Research, 47(5), May 2011. ISSN 00431397. doi:10.1029/2010WR010090. URL http://doi.wiley.com/10.1029/2010WR010090. 604 citations (Crossref) [2024-02-08].
- A review of surrogate models and their application to groundwater modeling. Water Resources Research, 51(8):5957–5973, 2015. ISSN 1944-7973. doi:10.1002/2015WR016967. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/2015WR016967. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/2015WR016967.
- Development of a Deep Learning Emulator for a Distributed Groundwater–Surface Water Model: ParFlow-ML. Water, 13(23):3393, December 2021. ISSN 2073-4441. doi:10.3390/w13233393. URL https://www.mdpi.com/2073-4441/13/23/3393.
- A Physics-Informed, Machine Learning Emulator of a 2D Surface Water Model: What Temporal Networks and Simulation-Based Inference Can Help Us Learn about Hydrologic Processes. Water, 13(24):3633, January 2021. ISSN 2073-4441. doi:10.3390/w13243633. URL https://www.mdpi.com/2073-4441/13/24/3633. Number: 24 Publisher: Multidisciplinary Digital Publishing Institute.
- A conservative finite elements approach to overland flow: the control volume finite element formulation. Journal of Hydrology, 175(1):267–291, February 1996. ISSN 0022-1694. doi:10.1016/S0022-1694(96)80014-X.
- PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning. In Proceedings of the 35 th International Conference on Machine Learning. arXiv, November 2018. URL http://arxiv.org/abs/1804.06300. arXiv:1804.06300 [cs, stat].
- Sixty years of global progress in managed aquifer recharge. Hydrogeology Journal, 27(1):1–30, February 2019. ISSN 1431-2174, 1435-0157. doi:10.1007/s10040-018-1841-z. URL http://link.springer.com/10.1007/s10040-018-1841-z. 282 citations (Crossref) [2024-02-08].
- Inventory of managed aquifer recharge sites in Europe: historical development, current situation and perspectives. Hydrogeology Journal, 25(6):1909–1922, September 2017. ISSN 1435-0157. doi:10.1007/s10040-017-1554-8. URL https://doi.org/10.1007/s10040-017-1554-8. 111 citations (Crossref) [2024-02-08].
- Airborne geophysical method images fast paths for managed recharge of California’s groundwater. Environmental Research Letters, 17(12):124021, December 2022. ISSN 1748-9326. doi:10.1088/1748-9326/aca344. URL https://iopscience.iop.org/article/10.1088/1748-9326/aca344.
- Controls on flood managed aquifer recharge through a heterogeneous vadose zone: hydrologic modeling at a site characterized with surface geophysics. Hydrology and Earth System Sciences, 27(5):969–990, March 2023. ISSN 1607-7938. doi:10.5194/hess-27-969-2023. URL https://hess.copernicus.org/articles/27/969/2023/.
- Managed aquifer recharge with reverse-osmosis desalinated seawater: modeling the spreading in groundwater using stable water isotopes. Hydrology and Earth System Sciences, 22(12):6323–6333, December 2018. ISSN 1607-7938. doi:10.5194/hess-22-6323-2018. 12 citations (Crossref) [2024-02-08].
- Transport, dispersion, and degradation of nonpoint source contaminants during flood-managed aquifer recharge. Vadose Zone Journal, 23(2):1–14, 2024. doi:10.1002/vzj2.20307.
- Mid-Kaweah GSA. Groundwater Sustainability Plan. Groundwater Sustainability Plan, Mid-Kaweah GSA, Tulare, CA, 2019.
- Mapping Aquifer Systems with Airborne Electromagnetics in the Central Valley of California. Ground Water, 56(6):893–908, November 2018. ISSN 1745-6584. doi:10.1111/gwat.12656.
- Development of a Coupled Land Surface and Groundwater Model. Journal of Hydrometeorology, 6(3):233–247, June 2005. ISSN 1525-7541, 1525-755X. doi:10.1175/JHM422.1. URL http://journals.ametsoc.org/doi/10.1175/JHM422.1.
- Capturing the influence of groundwater dynamics on land surface processes using an integrated, distributed watershed model: INFLUENCE OF GROUNDWATER DYNAMICS ON LAND. Water Resources Research, 44(2), February 2008. ISSN 00431397. doi:10.1029/2007WR006004. URL http://doi.wiley.com/10.1029/2007WR006004.
- Newton-Krylov-multigrid solvers for large-scale, highly heterogeneous, variably saturated ¯ow problems q. Advances in Water Resources, 2001.
- A Parallel Multigrid Preconditioned Conjugate Gradient Algorithm for Groundwater Flow Simulations. Nuclear Science and Engineering, 124(1):145–159, September 1996. ISSN 0029-5639, 1943-748X. doi:10.13182/NSE96-A24230. URL https://www.tandfonline.com/doi/full/10.13182/NSE96-A24230.
- Integrated surface–groundwater flow modeling: A free-surface overland flow boundary condition in a parallel groundwater flow model. Advances in Water Resources, 29(7):945–958, July 2006. ISSN 03091708. doi:10.1016/j.advwatres.2005.08.006. URL https://linkinghub.elsevier.com/retrieve/pii/S0309170805002101.
- Reed M. Maxwell. A terrain-following grid transform and preconditioner for parallel, large-scale, integrated hydrologic modeling. Advances in Water Resources, 53:109–117, March 2013. ISSN 03091708. doi:10.1016/j.advwatres.2012.10.001. URL https://linkinghub.elsevier.com/retrieve/pii/S0309170812002564.
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proceedings of the 9th International Conference on Learning Representations (ICLR 2021), 2021.
- U-FNO—An enhanced Fourier neural operator-based deep-learning model for multiphase flow. Advances in Water Resources, 163:104180, May 2022. ISSN 03091708. doi:10.1016/j.advwatres.2022.104180. URL https://linkinghub.elsevier.com/retrieve/pii/S0309170822000562.
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting, June 2022. URL http://arxiv.org/abs/2201.12740. arXiv:2201.12740 [cs, stat].
- A new fluid flow approximation method using a vision transformer and a U-shaped convolutional neural network. AIP Advances, 13(2):025233, February 2023. doi:10.1063/5.0138515. URL https://aip.scitation.org/doi/full/10.1063/5.0138515. Publisher: American Institute of Physics.
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. In Proceedings of the 32nd International Conference on Machine Learning. arXiv, March 2015. URL http://arxiv.org/abs/1502.03167. arXiv:1502.03167 [cs].
- Rectifier Nonlinearities Improve Neural Network Acoustic Models. In Proceedings of the 30th International Conference on Machine Learning, 2013.
- Improving neural networks by preventing co-adaptation of feature detectors, 2012. URL https://arxiv.org/abs/1207.0580. Publisher: arXiv Version Number: 1.
- Attention is All you Need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS 2017), 2017.
- Fourier Neural Operator for Parametric Partial Differential Equations, 2020. URL https://arxiv.org/abs/2010.08895. Publisher: arXiv Version Number: 3.
- Hyper-resolution global hydrological modelling: what is next?: “Everywhere and locally relevant”. Hydrological Processes, 29(2):310–320, January 2015. ISSN 08856087. doi:10.1002/hyp.10391. URL https://onlinelibrary.wiley.com/doi/10.1002/hyp.10391. 267 citations (Crossref) [2024-02-08].
- Adam: A Method for Stochastic Optimization. arXiv:1412.6980 [cs], 2015.
- Deep learning scaling is predictable, empirically. preprint, December 2017. URL http://arxiv.org/abs/1712.00409. arXiv:1712.00409 [cs, stat].
- C. D. Lewis. Industrial and business forecasting methods: a practical guide to exponential smoothing and curve fitting. Butterworth Scientific, London ; Boston, 1982. ISBN 978-0-408-00559-3.
- Object Detectors Emerge in Deep Scene CNNs, December 2014. URL https://arxiv.org/abs/1412.6856v2.
- Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis, November 2019. URL https://arxiv.org/abs/1911.09267v3.
- Attention is not Explanation, May 2019. URL http://arxiv.org/abs/1902.10186. arXiv:1902.10186 [cs].
- What Does BERT Learn about the Structure of Language? In Anna Korhonen, David Traum, and Lluís Màrquez, editors, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3651–3657, Florence, Italy, July 2019. Association for Computational Linguistics. doi:10.18653/v1/P19-1356. URL https://aclanthology.org/P19-1356.
- Attention is not not Explanation, September 2019. URL http://arxiv.org/abs/1908.04626. arXiv:1908.04626 [cs].
- Timothy Dai (2 papers)
- Kate Maher (1 paper)
- Zach Perzan (1 paper)