Machine Learning Based Optimization Workflow for Tuning Numerical Settings of Differential Equation Solvers for Boundary Value Problems (2404.10472v1)
Abstract: Several numerical differential equation solvers have been employed effectively over the years as an alternative to analytical solvers to quickly and conveniently solve differential equations. One category of these is boundary value solvers, which are used to solve real-world problems formulated as differential equations with boundary conditions. These solvers require certain numerical settings to solve the differential equations that affect their solvability and performance. A systematic fine-tuning of these settings is required to obtain the desired solution and performance. Currently, these settings are either selected by trial and error or require domain expertise. In this paper, we propose a machine learning-based optimization workflow for fine-tuning the numerical settings to reduce the time and domain expertise required in the process. In the evaluation section, we discuss the scalability, stability, and reliability of the proposed workflow. We demonstrate our workflow on a numerical boundary value problem solver.
- Victor, Viny Saajan and Schmeißer, Andre and Leitte, Heike and Gramsch, Simone, “Visual Parameter Space Analysis for Optimizing the Quality of Industrial Nonwovens“ IEEE Computer Graphics and Applications, IEEE, vol. 42, no. 2, pp. 56–67, 2022.
- Ettmüller, Manuel and Arne, Walter and Marheineke, Nicole and Wegener, Raimund, “On flow-enhanced crystallization in fiber spinning: asymptotically justified boundary conditions for numerics of a stiff viscoelastic two-phase model“ Journal of Non-Newtonian Fluid Mechanics, Elsevier, vol. 296, pp. 104636, 2022.
- Arne, Walter and Marheineke, Nicole and Schnebele, Johannes and Wegener, Raimund, “Fluid-fiber-interactions in rotational spinning process of glass wool production“ Journal of Mathematics in Industry, SpringerOpen, vol. 1, no. 1, pp. 1–26, 2011.
- Kierzenka, Jacek and Shampine, Lawrence F, “A BVP solver based on residual control and the Matlab PSE“ ACM Transactions on Mathematical Software (TOMS), ACM New York, NY, USA, vol. 27, no. 3, pp. 299–316, 2001.
- Soetaert, Karline and Cash, Jeff and Mazzia, Francesca, “Package bvpSolve, solving testproblems“ 2010.
- Noble, William S, “What is a support vector machine?“ Nature biotechnology, Nature Publishing Group, vol. 24, no. 12, pp. 1565–1567, 2006.
- Ke, Guolin and Meng, Qi and Finley, Thomas and Wang, Taifeng and Chen, Wei and Ma, Weidong and Ye, Qiwei and Liu, Tie-Yan, “Lightgbm: A highly efficient gradient boosting decision tree“ Advances in neural information processing systems, vol. 30, 2007.
- Breiman, Leo, “Random forests“ Machine learning, Springer, vol. 45, no. 1, pp. 5–32, 2001.
- Fix, Evelyn and Hodges, Joseph Lawson, “Discriminatory analysis. Nonparametric discrimination: Consistency properties“ International Statistical Review/Revue Internationale de Statistique, JSTOR, vol. 57, no. 3, pp. 238–247, 1989.
- Cover, Thomas and Hart, Peter, “Nearest neighbor pattern classification“ IEEE transactions on information theory, vol. 13, no. 1, pp. 21–27, 1967.
- Akiba, Takuya and Sano, Shotaro and Yanase, Toshihiko and Ohta, Takeru and Koyama, Masanori, “Optuna: A Next-generation Hyperparameter Optimization Framework“ Proceedings of the 25rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2623–2631, 2019.
- Deb, Kalyanmoy and Pratap, Amrit and Agarwal, Sameer and Meyarivan, TAMT, “A fast and elitist multiobjective genetic algorithm: NSGA-II“ IEEE transactions on evolutionary computation, vol. 6, no. 2, pp. 182–197, 2002.
- Ozaki, Yoshihiko and Tanigaki, Yuki and Watanabe, Shuhei and Onishi, Masaki, “Multiobjective tree-structured parzen estimator for computationally expensive optimization problems“ Proceedings of the 2020 genetic and evolutionary computation conference, pp. 533–541, 2020.
- Ozaki, Yoshihiko and Tanigaki, Yuki and Watanabe, Shuhei and Nomura, Masahiro and Onishi, Masaki, “Multiobjective Tree-Structured Parzen Estimator“ Journal of Artificial Intelligence Research, vol. 73, pp. 1209–1250, 2022.
- Bergstra, James and Bengio, Yoshua, “Random search for hyper-parameter optimization.“ Journal of machine learning research, vol. 13, no. 2, 2012.
- Yurdakul, Bilal, “Statistical properties of population stability index“ Western Michigan University, 2018.
- Siddiqi, Naeem, “Credit risk scorecards: developing and implementing intelligent credit scoring“ John Wiley & Sons, vol. 3, 2012.