Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 175 tok/s
Gemini 2.5 Pro 54 tok/s Pro
GPT-5 Medium 38 tok/s Pro
GPT-5 High 37 tok/s Pro
GPT-4o 108 tok/s Pro
Kimi K2 180 tok/s Pro
GPT OSS 120B 447 tok/s Pro
Claude Sonnet 4.5 36 tok/s Pro
2000 character limit reached

Multi-Fidelity Methods for Optimization: A Survey (2402.09638v1)

Published 15 Feb 2024 in cs.LG and cs.NE

Abstract: Real-world black-box optimization often involves time-consuming or costly experiments and simulations. Multi-fidelity optimization (MFO) stands out as a cost-effective strategy that balances high-fidelity accuracy with computational efficiency through a hierarchical fidelity approach. This survey presents a systematic exploration of MFO, underpinned by a novel text mining framework based on a pre-trained LLM. We delve deep into the foundational principles and methodologies of MFO, focusing on three core components -- multi-fidelity surrogate models, fidelity management strategies, and optimization techniques. Additionally, this survey highlights the diverse applications of MFO across several key domains, including machine learning, engineering design optimization, and scientific discovery, showcasing the adaptability and effectiveness of MFO in tackling complex computational challenges. Furthermore, we also envision several emerging challenges and prospects in the MFO landscape, spanning scalability, the composition of lower fidelities, and the integration of human-in-the-loop approaches at the algorithmic level. We also address critical issues related to benchmarking and the advancement of open science within the MFO community. Overall, this survey aims to catalyze further research and foster collaborations in MFO, setting the stage for future innovations and breakthroughs in the field.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (323)
  1. R. Shi, T. Long, N. Ye, Y. Wu, Z. Wei, and Z. Liu, “Metamodel-based multidisciplinary design optimization methods for aerospace system,” Astrodynamics, vol. 5, pp. 185–215, 2021.
  2. P. Wu, W. Yuan, L. Ji, L. Zhou, Z. Zhou, W. Feng, and Y. Guo, “Missile aerodynamic shape optimization design using deep neural networks,” Aerosp. Sci. Technol., vol. 126, p. 107640, 2022.
  3. B. Peherstorfer, K. Willcox, and M. D. Gunzburger, “Survey of multifidelity methods in uncertainty propagation, inference, and optimization,” SIAM Rev., vol. 60, no. 3, pp. 550–591, 2018.
  4. M. G. Fernández-Godino, C. Park, N. H. Kim, and R. T. Haftka, “Review of multi-fidelity models,” AIAA J., vol. 57, pp. 351–400, 2016.
  5. M. F.-G. Giselle, C. Park, N. H. Kim, and R. T. Haftka, “Issues in deciding whether to use multifidelity surrogates,” AIAA J., vol. 57, no. 5, pp. 2039–2054, 2019.
  6. C. Park, R. T. Haftka, and N. H. Kim, “Remarks on multi-fidelity surrogates,” Struct. Multidiscipl. Optim., vol. 55, no. 3, pp. 1029–1050, 2017.
  7. L. Brevault, M. Balesdent, and A. Hebbal, “Overview of Gaussian process based multi-fidelity techniques with variable relationship between fidelities,” Aerosp. Sci. Technol., vol. 107, p. 106339, 2020.
  8. L. L. Gratiet, “Multi-fidelity Gaussian process regression for computer experiments,” Ph.D. dissertation, Université Paris-Diderot-Paris VII, 2013.
  9. T. D. Robinson, “Surrogate-based optimization using multifidelity models with variable parameterization,” Ph.D. dissertation, Massachusetts Institute of Technology, 2007.
  10. A. I. March, “Multidelity methods for multidisciplinary system design,” Ph.D. dissertation, Massachusetts Institute of Technology, 2012.
  11. A. Haas, “Multifidelity optimization for supersonic aircraft design,” Ph.D. dissertation, Stanford University, 2012.
  12. J. Demange, “Multifidelity multiobjective trust-region-based optimisation for high-lift devices.” Ph.D. dissertation, Cranfield University, 2018.
  13. M. Santos, “Multi-fidelity modeling for aerothermal analysis of deployable planetary entry technologies,” Ph.D. dissertation, Missouri University of Science and Technology, 2021.
  14. L. Partin, “Multitask and multifidelity convolutional encoder-decoder networks,” Ph.D. dissertation, University of Notre Dame, 2022.
  15. N. G. G. Farah, “Multifidelity methods for simulation of wax deposition in single-phase and two-phase flow,” Ph.D. dissertation, Imperial College London, 2023.
  16. C. M. F. Masuda, “Multifidelity methods for uncertainty quantification in cardiovascular hemodynamics,” Ph.D. dissertation, Stanford University, 2022.
  17. M. Berci, “Multidisciplinary multifidelity optimisation of flexible wing aerofoils by passive adaptivity,” Ph.D. dissertation, University of Leeds, 2011.
  18. M. Grootendorst, “BERTopic: Neural topic modeling with a class-based TF-IDF procedure,” arXiv preprint arXiv:2203.05794, 2022.
  19. N. Reimers and I. Gurevych, “Sentence-BERT: Sentence embeddings using siamese BERT-networks,” in Conference on Empirical Methods in Natural Language Processing, 2019.
  20. L. McInnes and J. Healy, “UMAP: uniform manifold approximation and projection for dimension reduction,” CoRR, vol. abs/1802.03426, 2018.
  21. L. McInnes, J. Healy, and S. Astels, “HDBSCAN: Hierarchical density based clustering,” J. Open Source Softw., vol. 2, no. 11, p. 205, 2017.
  22. T. Joachims, “A probabilistic analysis of the rocchio algorithm with TFIDF for text categorization,” in ICML’97: Proc. of the Fourteenth International Conference on Machine Learning.   Morgan Kaufmann, 1997, pp. 143–151.
  23. J. G. Carbonell and J. Goldstein, “The use of mmr, diversity-based reranking for reordering documents and producing summaries,” in SIGIR’98: Proc. of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.   ACM, 1998, pp. 335–336.
  24. M. Grootendorst, “Keybert: Minimal keyword extraction with bert.” 2020. [Online]. Available: https://doi.org/10.5281/zenodo.4461265
  25. L. Li, K. G. Jamieson, G. DeSalvo, A. Rostamizadeh, and A. Talwalkar, “Hyperband: A novel bandit-based approach to hyperparameter optimization,” J. Mach. Learn. Res., vol. 18, pp. 185:1–185:52, 2017.
  26. C. He, Y. Zhang, D. Gong, and X. Ji, “A review of surrogate-assisted evolutionary algorithms for expensive optimization problems,” Expert Syst. Appl., vol. 217, p. 119495, 2023.
  27. A. A. Giunta, V. Balabanov, M. Kaufman, S. Burgee, B. Grossman, R. T. Haftka, W. H. Mason, and L. T. Watson, “Variable-complexity response surface design of an HSCT configuration,” Multidisciplinary Design Optimization, Alexandrov NM and Hussaini MY eds, pp. 53–69, 1997.
  28. B. Liu, S. Koziel, and Q. Zhang, “A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems,” J. Comput. Sci., vol. 12, pp. 28–37, 2016.
  29. K. Kandasamy, G. Dasarathy, J. B. Oliva, J. G. Schneider, and B. Póczos, “Multi-fidelity Gaussian process bandit optimisation,” J. Artif. Intell. Res., vol. 66, pp. 151–196, 2019.
  30. J. P. Folch, R. M. Lee, B. Shafei, D. Walz, C. Tsay, M. van der Wilk, and R. Misener, “Combining multi-fidelity modelling and asynchronous batch bayesian optimization,” Comput. Chem. Eng., vol. 172, p. 108194, 2023.
  31. J. Yi, Y. Shen, and C. AShoemaker, “A multi-fidelity RBF surrogate-based optimization framework for computationally expensive multi-modal problems with application to capacity planning of manufacturing systems,” Struct. Multidiscip. Optim., vol. 62, no. 4, pp. 1787–1807, 2020.
  32. I. C. Kampolis, A. S. Zymaris, V. G. Asouti, and K. C. Giannakoglou, “Multilevel optimization strategies based on metamodel-assisted evolutionary algorithms, for computationally expensive problems,” in CEC’07: Proc. of the IEEE Congress on Evolutionary Computation, 2007, pp. 4116–4123.
  33. D. Zhao and D. Xue, “A comparative study of metamodeling methods considering sample quality merits,” Struct. Multidiscip. Optim., vol. 42, no. 6, pp. 923–938, 2010.
  34. A. Habib, H. K. Singh, and T. Ray, “A multiple surrogate assisted multi/many-objective multi-fidelity evolutionary algorithm,” Inf. Sci., vol. 502, pp. 537–557, 2019.
  35. J. W. Bandler, R. M. Biernacki, S. H. Chen, P. A. Grobelny, and R. H. Hemmers, “Space mapping technique for electromagnetic optimization,” IEEE Trans. Microw. Theory Tech., vol. 42, no. 12, pp. 2536–2544, 1994.
  36. J. W. Bandler, R. M. Biernacki, S. H. Chen, P. A. Grobelny, R. H. Hemmers, and K. Madsen, “Electromagnetic optimization exploiting aggressive space mapping,” IEEE Trans. Microw. Theory Tech., vol. 43, no. 12, pp. 2874–2882, 1995.
  37. ——, “A trust region aggressive space mapping algorithm for em optimization,” IEEE Trans. Microw. Theory Tech., vol. 46, no. 12, pp. 2412–2425, 1998.
  38. M. H. Bakr, J. W. Bandler, N. Georgieva, and K. Madsen, “A hybrid aggressive space-mapping algorithm for em optimization,” IEEE Trans. Microw. Theory Tech., vol. 47, no. 12, pp. 2440–2449, 1999.
  39. M. H. Bakr, J. W. Bandler, M. A. Ismail, J. E. Rayas-Sánchez, and Q. j. Zhang, “Neural space mapping em optimization of microwave structures,” 2000 IEEE MTT-S International Microwave Symposium Digest, vol. 2, pp. 879–882 vol.2, 2000.
  40. J. Ren, L.  . Leifsson, S. Koziel, and Y. A. Tesfahunegn, “Multi-fidelity aerodynamic shape optimization using manifold mapping,” in Proc. of the 57th AIAA/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, 2016, p. 0419.
  41. R. T. Haftka, “Combining global and local approximations,” AIAA J., vol. 29, no. 9, pp. 1523–1525, 1991.
  42. K. J. Chang, R. T. Haftka, G. L. Giles, and P.-J. Kao, “Sensitivity-based scaling for approximating structural response,” J. Aircr., vol. 30, no. 2, pp. 283–288, 1993.
  43. R. Lewis and S. Nash, “A multigrid approach to the optimization of systems governed by differential equations,” in Proc. of the 8th Symposium on Multidisciplinary Analysis and Optimization, 2000, p. 4890.
  44. M. Eldred, A. Giunta, and S. Collis, “Second-order corrections for surrogate-based optimization with model hierarchies,” in Proc. of the 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, 2004, p. 4457.
  45. S. Gano, V. Perez, J. Renaud, S. Batill, and B. Sanders, “Multilevel variable fidelity optimization of a morphing unmanned aerial vehicle,” in Proc. of the 45th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics & Materials Conference, 2004, p. 1763.
  46. S. E. Gano, J. E. Renaud, and B. Sanders, “Hybrid variable fidelity optimization by using a Kriging-based scaling function,” AIAA J., vol. 43, no. 11, pp. 2422–2433, 2005.
  47. X. Marduel, C. Tribes, and J.-Y. Trépanier, “Variable-fidelity optimization: efficiency and robustness,” Optim. Eng., vol. 7, no. 4, pp. 479–500, 2006.
  48. ——, “Optimization using variable fidelity solvers: exploration of an approximation management framework for aerodynamic shape optimization,” in Proc. of the 9th AIAA/ISSMO symposium on multidisciplinary analysis and optimization, 2002, p. 5595.
  49. B. Warner and M. Misra, “Understanding neural networks as statistical tools,” Am. Stat., vol. 50, no. 4, pp. 284–293, 1996.
  50. H. S. Kim, M. Koc, and J. Ni, “A hybrid multi-fidelity approach to the optimal design of warm forming processes using a knowledge-based artificial neural network,” Int. J. Mach. Tools Manuf., vol. 47, no. 2, pp. 211–222, 2007.
  51. M. Tyan, N. V. Nguyen, and J.-W. Lee, “Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aerofoil design,” Eng. Optim., vol. 47, no. 7, pp. 885–908, 2015.
  52. N. V. N. M. Tyan and J.-W. Lee, “A modified variable complexity modeling for efficient multidisciplinary aircraft conceptual design,” Optim. Eng., vol. 16, no. 2, pp. 483–505, 2015.
  53. C. Durantin, J. Rouxel, J.-A. Désidéri, and A. Glière, “Multifidelity surrogate modeling based on radial basis functions,” Struct. Multidiscipl. Optim., vol. 56, no. 5, pp. 1061–1075, 2017.
  54. X. Song, L. Lv, W. Sun, and J. Zhang, “A radial basis function-based multi-fidelity surrogate model: exploring correlation between high-fidelity and low-fidelity models,” Struct. Multidiscipl. Optim., vol. 60, no. 3, pp. 965–981, 2019.
  55. H. Wang, Y. Jin, C. Yang, and L. Jiao, “Transfer stacking from low-to high-fidelity: A surrogate-assisted bi-fidelity evolutionary algorithm,” Appl. Soft Comput., vol. 92, p. 106276, 2020.
  56. J. Yi, L. Gao, X. Li, C. A. Shoemaker, and C. Lu, “An on-line variable-fidelity surrogate-assisted harmony search algorithm with multi-level screening strategy for expensive engineering design optimization,” Knowl. Based Syst., vol. 170, pp. 1–19, 2019.
  57. J. Zheng, X. Shao, L. Gao, P. Jiang, and H. Qiu, “Difference mapping method using least square support vector regression for variable-fidelity metamodelling,” Eng. Optim., vol. 47, no. 6, pp. 719–736, 2015.
  58. Q. Zhou, X. Shao, P. Jiang, H. Zhou, and L. Shu, “An adaptive global variable fidelity metamodeling strategy using a support vector regression based scaling function,” Simul. Model. Pract. Theory, vol. 59, pp. 18–35, 2015.
  59. M. Shi, L. Lv, W. Sun, and X. Song, “A multi-fidelity surrogate model based on support vector regression,” Struct. Multidiscip. Optim., vol. 61, no. 6, pp. 2363–2375, 2020.
  60. G. Sun, G. Li, and Q. Li, “Variable fidelity design based surrogate and artificial bee colony algorithm for sheet metal forming process,” Finite Elem. Anal. Des., vol. 59, pp. 76–90, 2012.
  61. R. Vitali, R. Haftka, and B. Sankar, “Correction response surface approximations for stress intensity factors of a composite stiffened plate,” in Proc. of the 39th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference and Exhibit, 1998, p. 2047.
  62. R. Vitali, R. T. Haftka, and B. V. Sankar, “Multi-fidelity design of stiffened composite panel with a crack,” Struct. Multidisc. Optim., vol. 23, pp. 347–356, 2002.
  63. D. L. Knill, A. A. Giunta, C. A. Baker, B. Grossman, W. H. Mason, R. T. Haftka, and L. T. Watson, “Response surface models combining linear and euler aerodynamics for supersonic transport design,” J. Aircr., vol. 36, no. 1, pp. 75–86, 1999.
  64. G. Sun, G. Li, S. Zhou, W. Xu, X. Yang, and Q. Li, “Multi-fidelity optimization for sheet metal forming process,” Struct. Multidiscipl. Optim., vol. 44, no. 1, pp. 111–124, 2011.
  65. S. E. Gano, J. E. Renaud, J. D. Martin, and T. W. Simpson, “Update strategies for Kriging models used in variable fidelity optimization,” Struct. Multidiscip. Optim., vol. 32, no. 4, pp. 287–298, 2006.
  66. Y. Liu and M. Collette, “Improving surrogate-assisted variable fidelity multi-objective optimization using a clustering algorithm,” Appl. Soft Comput., vol. 24, pp. 482–493, 2014.
  67. Y. Xiong, W. Chen, and K.-L. Tsui, “A new variable-fidelity optimization framework based on model fusion and objective-oriented sequential sampling,” J. Mech. Des., vol. 130, no. 11, pp. 1 114 011–1 114 019, 2008.
  68. Q. Zhou, Y. Wang, S. Choi, P. Jiang, X. Shao, and J. Hu, “A sequential multi-fidelity metamodeling approach for data regression,” Knowl. Based Syst., vol. 134, pp. 199–212, 2017.
  69. J. Zhu, Y.-J. Wang, and M. Collette, “A multi-objective variable-fidelity optimization method for genetic algorithms,” Eng. Optim., vol. 46, no. 4, pp. 521–542, 2014.
  70. Q. Zhou, X. Shao, P. Jiang, Z. Gao, C. Wang, and L. Shu, “An active learning metamodeling approach by sequentially exploiting difference information from variable-fidelity models,” Adv. Eng. Informatics, vol. 30, no. 3, pp. 283–297, 2016.
  71. Q. Zhou, J. Wu, T. Xue, and P. Jin, “A two-stage adaptive multi-fidelity surrogate model-assisted multi-objective genetic algorithm for computationally expensive problems,” Eng. Comput., vol. 37, no. 1, pp. 623–639, 2021.
  72. Z. Li, K. Tian, H. Li, Y. Shi, and B. Wang, “A competitive variable-fidelity surrogate-assisted CMA-ES algorithm using data mining techniques,” Aerosp. Sci. Technol., vol. 119, p. 107084, 2021.
  73. M. Kennedy and A. O’Hagan, “Predicting the output from a complex computer code when fast approximations are available,” Biometrika, vol. 87, no. 1, pp. 1–13, 2000.
  74. A. G. Journel and C. J. Huijbregts, “Mining geostatistics,” 1989.
  75. L. Huang, Z. Gao, and D. Zhang, “Research on multi-fidelity aerodynamic optimization methods,” Chinese J. Aeronaut., vol. 26, no. 2, pp. 279–286, 2013.
  76. A. I. J. Forrester, A. Sóbester, and A. J. Keane, “Multi-fidelity optimization via surrogate modelling,” Proc. Math. Phys. Eng. Sci. P ROY SOC A-MATH PHY, vol. 463, no. 2088, pp. 3251–3269, 2007.
  77. F. Ding and A. Kareem, “A multi-fidelity shape optimization via surrogate modeling for civil structures,” J. Wind Eng. Ind. Aerodyn., vol. 178, pp. 49–56, 2018.
  78. H. Zhang, Y. Li, Z. Chen, X. Su, and X. Yuan, “Multi-fidelity model based optimization of shaped film cooling hole and experimental validation,” Int. J. Heat Mass Transf., vol. 132, pp. 118–129, 2019.
  79. H. K. Yong, L. Wang, D. J. Toal, A. J. Keane, and F. Stanley, “Multi-fidelity Kriging-assisted structural optimization of whole engine models employing medial meshes,” Struct. Multidiscipl. Optim., vol. 60, no. 3, pp. 1209–1226, 2019.
  80. Z.-H. Han, R. Zimmermann, and S. Görtz, “Alternative co-Kriging method for variable-fidelity surrogate modeling,” AIAA J., vol. 50, no. 5, pp. 1205–1210, 2012.
  81. R. Zimmermannand and Z.-H. Han, “Simplified cross-correlation estimation for multi-fidelity surrogate co-Kriging models,” Adv. Appl. Math. Sci., vol. 7, no. 2, pp. 181–202, 2010.
  82. L. L. Gratiet, “Recursive co-Kriging model for design of computer experiments with multiple levels of fidelity,” Int. J. Uncertain. Quantif., vol. 4, no. 5, 2014.
  83. P. S. Palar and K. Shimoyama, “Multi-fidelity uncertainty analysis in cfd using hierarchical Kriging,” in Proc. of the 35th AIAA Applied Aerodynamics Conference, 2017, p. 3261.
  84. Y. Zhang, Z.-H. Han, and K.-S. Zhang, “Variable-fidelity expected improvement method for efficient global optimization of expensive functions,” Struct. Multidiscipl. Optim., vol. 58, no. 4, pp. 1431–1451, 2018.
  85. F. Liu, Z.-H. Han, Y. Zhang, K. Song, W.-P. Song, F. Gui, and J.-B. Tang, “Surrogate-based aerodynamic shape optimization of hypersonic flows considering transonic performance,” Aerosp. Sci. Technol., vol. 93, p. 105345, 2019.
  86. L. Bonfiglio, P. Perdikaris, S. Brizzolara, and G. Karniadakis, “Multi-fidelity optimization of super-cavitating hydrofoils,” Comput. Methods Appl. Mech. Eng., vol. 332, pp. 63–85, 2018.
  87. L. Zhang, Y. Wu, P. Jiang, S. Choi, and Q. Zhou, “A multi-fidelity surrogate modeling approach for incorporating multiple non-hierarchical low-fidelity data,” Adv. Eng. Informatics, vol. 51, p. 101430, 2022.
  88. M. A. Álvarez, L. Rosasco, and N. D. Lawrence, “Kernels for vector-valued functions: A review,” Found. Trends Mach. Learn., vol. 4, no. 3, pp. 195–266, 2012.
  89. K. Li, R. Chen, and X. Yao, “A data-driven evolutionary transfer optimization for expensive problems in dynamic environments,” IEEE Trans. Evol. Comput., 2023.
  90. H. Yang and K. Li, “Instoptima: Evolutionary multi-objective instruction optimization via large language model-based instruction operators,” in EMNLP’23: Findings of the Association for Computational Linguistics: EMNLP 2023.   Association for Computational Linguistics, 2023, pp. 13 593–13 602.
  91. R. Chen and K. Li, “Data-driven evolutionary multi-objective optimization based on multiple-gradient descent for disconnected pareto fronts,” in EMO’23: Proc. of the 12th International Conference on Evolutionary Multi-Criterion Optimization, ser. Lecture Notes in Computer Science, vol. 13970.   Springer, 2023, pp. 56–70.
  92. K. Swersky, J. Snoek, and R. P. Adams, “Multi-task Bayesian optimization,” in NIPS’13: Proc. of the Annual Conference on Neural Information Processing Systems 2013, 2013, pp. 2004–2012.
  93. S. Takeno, H. Fukuoka, Y. Tsukada, T. Koyama, M. Shiga, I. Takeuchi, and M. Karasuyama, “Multi-fidelity Bayesian optimization with max-value entropy search and its parallelization,” in ICML’J20: Proc. of the 37th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, vol. 119.   PMLR, 2020, pp. 9334–9345.
  94. H. B. Moss, D. S. Leslie, and P. Rayson, “MUMBO: multi-task max-value Bayesian optimization,” in ECML/PKDD’20: Proc. of the 2020 European Conference on Machine Learning and Knowledge Discovery in Databases, ser. Lecture Notes in Computer Science, vol. 12459.   Springer, 2020, pp. 447–462.
  95. S. Takeno, H. Fukuoka, Y. Tsukada, T. Koyama, M. Shiga, I. Takeuchi, and M. Karasuyama, “A generalized framework of multifidelity max-value entropy search through joint entropy,” Neural Comput., vol. 34, no. 10, pp. 2145–2203, 2022.
  96. Q. Lin, J. Qian, Y. Cheng, Q. Zhou, and J. Hu, “A multi-output multi-fidelity Gaussian process model for non-hierarchical low-fidelity data fusion,” Knowl. Based Syst., vol. 254, p. 109645, 2022.
  97. P. Mikkola, J. Martinelli, L. Filstroff, and S. Kaski, “Multi-fidelity Bayesian optimization with unreliable information sources,” in AISTATS’23: Proc. of the 2023 International Conference on Artificial Intelligence and Statistics, vol. 206.   PMLR, 2023, pp. 7425–7454.
  98. M. Poloczek, J. Wang, and P. I. Frazier, “Multi-information source optimization,” in NeurIPS’17: Annual Conference on Neural Information Processing Systems 2017, 2017, pp. 4288–4298.
  99. Y. Zhang, T. N. Hoang, B. K. H. Low, and M. Kankanhalli, “Information-based multi-fidelity Bayesian optimization,” in NIPS Workshop on Bayesian Optimization, 2017.
  100. K. Cutajar, M. Pullin, A. C. Damianou, N. D. Lawrence, and J. González, “Deep Gaussian processes for multi-fidelity modeling,” CoRR, vol. abs/1903.07320, 2019.
  101. P. Perdikaris, M. Raissi, A. Damianou, N. D. Lawrence, and G. E. Karniadakis, “Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling,” Proc. R. Soc. A: Math. Phys. Eng. Sci., vol. 473, no. 2198, p. 20160751, 2017.
  102. J. Requeima, W. Tebbutt, W. Bruinsma, and R. E. Turner, “The Gaussian process autoregressive regression model (GPAR),” in AISTAS’19: Proc. of the 22nd International Conference on Artificial Intelligence and Statistics, vol. 89, 2019, pp. 1860–1869.
  103. A. C. Damianou and N. D. Lawrence, “Deep Gaussian processes,” in AISTATS’13: Proc. of the Sixteenth International Conference on Artificial Intelligence and Statistics, ser. JMLR Workshop and Conference Proceedings, vol. 31.   JMLR.org, 2013, pp. 207–215.
  104. H. Salimbeni and M. P. Deisenroth, “Doubly stochastic variational inference for deep Gaussian processes,” in NeurIPS’17: Annual Conference on Neural Information Processing Systems 2017, 2017, pp. 4588–4599.
  105. S. Li, W. Xing, R. M. Kirby, and S. Zhe, “Multi-fidelity Bayesian optimization via deep neural networks,” in NeurIPS’20: Proc. of the Annual Conference on Neural Information Processing Systems 2020, 2020.
  106. S. Li, R. M. Kirby, and S. Zhe, “Batch multi-fidelity Bayesian optimization with deep auto-regressive networks,” in NeurIPS’21: Proc. of the Annual Conference on Neural Information Processing Systems 2021, 2021, pp. 25 463–25 475.
  107. Y. Xu, X. Song, and C. Zhang, “Hierarchical regression framework for multi-fidelity modeling,” Knowl. Based Syst., vol. 212, p. 106587, 2021.
  108. M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics informed deep learning (part I): data-driven solutions of nonlinear partial differential equations,” CoRR, vol. abs/1711.10561, 2017. [Online]. Available: http://arxiv.org/abs/1711.10561
  109. X. Meng and G. E. Karniadakis, “A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems,” J. Comput. Phys., vol. 401, 2020.
  110. L. Lu, M. Dao, P. Kumar, U. Ramamurty, G. E. Karniadakis, and S. Suresh, “Extraction of mechanical properties of materials through deep learning from instrumented indentation,” Proc. Natl. Acad. Sci. U. S. A., vol. 117, pp. 7052 – 7062, 2020.
  111. S. Chakraborty, “Transfer learning based multi-fidelity physics informed deep neural network,” J. Comput. Phys., vol. 426, p. 109942, 2021.
  112. K. Harada, D. Rajaram, and D. N. Mavris, “Application of multi-fidelity physics-informed neural network on transonic airfoil using wind tunnel measurements,” AIAA SCITECH 2022 Forum, 2022.
  113. X. Meng, Z. Wang, D. Fan, M. S. Triantafyllou, and G. E. Karniadakis, “A fast multi-fidelity method with uncertainty quantification for complex data correlations: Application to vortex-induced vibrations of marine risers,” Comput. Methods Appl. Mech. Eng., vol. 386, p. 114212, 2021.
  114. D. Liu and Y. Wang, “Multi-fidelity physics-constrained neural network and its application in materials modeling,” J. Mech. Des., vol. 141, no. 12, p. 121403, 2019.
  115. D. H. Wolpert and W. G. Macready, “No free lunch theorems for optimization,” IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 67–82, 1997.
  116. N. M. Alexandrov, R. M. Lewis, C. R. Gumbert, L. L. Green, and P. A. Newman, “Approximation and model management in aerodynamic optimization with variable-fidelity models,” J. Aircr., vol. 38, pp. 1093–1101, 2001.
  117. N. M. Alexandrov, J. E. D. Jr., R. M. Lewis, and V. Torczon, “A trust-region framework for managing the use of approximation models in optimization,” Struct. Multidiscipl. Optim., vol. 15, pp. 16–23, 1998.
  118. N. M. Alexandrov, R. M. Lewis, C. R. Gumbert, L. L. Green, and P. A. Newman, “Optimization with variable-fidelity models applied to wing design,” NASA, Tech. Rep. CR-209826, 1999.
  119. Z. Han, C. Xu, Z. Liang, Z. Yu, K. Zhang, and W. Song, “Efficient aerodynamic shape optimization using variable-fidelity surrogate models and multilevel computational grids,” Chinese J. Aeronaut., vol. 33, no. 1, pp. 31–47, 2020.
  120. D. Huang, T. T. Allen, W. I. Notz, and R. A. Miller, “Sequential kriging optimization using multiple-fidelity evaluations,” Struct. Multidiscipl. Optim., vol. 32, pp. 369–382, 2006.
  121. P. H. Reisenthel and T. T. Allen, “Application of multifidelity expected improvement algorithms to aeroelastic design optimization,” in AIAA’14: Proc. of the 10th AIAA Multidisciplinary Design Optimization Conference, 2014, p. 1490.
  122. F. D. Fiore and L. Mainini, “Non-myopic multifidelity Bayesian optimization,” CoRR, vol. abs/2207.06325, 2022.
  123. H. B. Moss, D. S. Leslie, J. Gonzalez, and P. Rayson, “GIBBON: general-purpose information-based Bayesian optimisation,” J. Mach. Learn. Res., vol. 22, pp. 235:1–235:49, 2021.
  124. P. Luong, D. Nguyen, S. Gupta, S. Rana, and S. Venkatesh, “Adaptive cost-aware Bayesian optimization,” Knowl. Based Syst., vol. 232, p. 107481, 2021.
  125. E. H. Lee, V. Perrone, C. Archambeau, and M. W. Seeger, “Cost-aware Bayesian optimization,” CoRR, vol. abs/2003.10870, 2020.
  126. J. González, Z. Dai, P. Hennig, and N. D. Lawrence, “Batch bayesian optimization via local penalization,” in AISTATS’16: Proc. of the 19th International Conference on Artificial Intelligence and Statistics, vol. 51.   JMLR.org, 2016, pp. 648–657.
  127. K. Kandasamy, A. Krishnamurthy, J. Schneider, and B. Póczos, “Parallelised bayesian optimisation via thompson sampling,” in AISTATS’18: Proc. of the 21st International Conference on Artificial Intelligence and Statistics, vol. 84.   PMLR, 2018, pp. 133–142.
  128. T. Savage, N. Basha, O. K. Matar, and E. A. del Rio-Chanona, “Deep Gaussian process-based multi-fidelity bayesian optimization for simulated chemical reactors,” CoRR, vol. abs/2210.17213, 2022.
  129. J. Yi, Y. Shen, and C. A. Shoemaker, “A multi-fidelity RBF surrogate-based optimization framework for computationally expensive multi-modal problems with application to capacity planning of manufacturing systems,” Struct. Multidiscipl. Optim., vol. 62, no. 4, pp. 1787–1807, 2020.
  130. A. Kenny, T. Ray, and H. K. Singh, “An iterative two-stage multifidelity optimization algorithm for computationally expensive problems,” IEEE Trans. Evol. Comput., vol. 27, no. 3, pp. 520–534, 2023.
  131. K. G. Jamieson and A. Talwalkar, “Non-stochastic best arm identification and hyperparameter optimization,” in AISTATS’16: Proc. of the 19th International Conference on Artificial Intelligence and Statistics, vol. 51, 2016, pp. 240–248.
  132. Z. S. Karnin, T. Koren, and O. Somekh, “Almost optimal exploration in multi-armed bandits,” in ICML’13: Proc. of the 30th International Conference on Machine Learning, vol. 28, 2013, pp. 1238–1246.
  133. S. Falkner, A. Klein, and F. Hutter, “BOHB: robust and efficient hyperparameter optimization at scale,” in ICML’18: Proc. of the 35th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, vol. 80.   PMLR, 2018, pp. 1436–1445.
  134. J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl, “Algorithms for hyper-parameter optimization,” in NIPS’11: Proc. of 25th Annual Conference on Neural Information Processing Systems 2011, 2011, pp. 2546–2554.
  135. J. Wang, J. Xu, and X. Wang, “Combination of hyperband and Bayesian optimization for hyperparameter optimization in deep learning,” CoRR, vol. abs/1801.01596, 2018.
  136. N. H. Awad, N. Mallik, and F. Hutter, “DEHB: evolutionary hyberband for scalable, robust and efficient hyperparameter optimization,” in IJCAI’21: Proc. of the Thirtieth International Joint Conference on Artificial Intelligence.   ijcai.org, 2021, pp. 2147–2153.
  137. Y. Li, Y. Shen, J. Jiang, J. Gao, C. Zhang, and B. Cui, “MFES-HB: efficient hyperband with multi-fidelity quality measurements,” in AAAI’21: Proc. of the AAAI Conference on Artificial Intelligence.   AAAI Press, 2021, pp. 8491–8500.
  138. X. Zhu, Y. Liu, P. Ghysels, D. Bindel, and X. S. Li, “GPTuneBand: Multi-task and multi-fidelity autotuning for large-scale high performance computing applications,” in PPSC’22: Proc. of the 2022 SIAM Conference on Parallel Processing for Scientific Computing, 2022, pp. 1–13.
  139. L. Li, K. G. Jamieson, A. Rostamizadeh, E. Gonina, J. Ben-tzur, M. Hardt, B. Recht, and A. Talwalkar, “A system for massively parallel hyperparameter tuning,” in MLSys’20: Proc. of Machine Learning and Systems 2020.   mlsys.org, 2020.
  140. O. Bohdal, L. Balles, M. Wistuba, B. Ermis, C. Archambeau, and G. Zappella, “PASHA: efficient HPO and NAS with progressive resource allocation,” in ICLR’23: Proc. of The Eleventh International Conference on Learning Representations, 2023.
  141. Y. Li, Y. Shen, H. Jiang, W. Zhang, J. Li, J. Liu, C. Zhang, and B. Cui, “Hyper-Tune: Towards efficient hyper-parameter tuning at scale,” Proc. VLDB Endow., vol. 15, no. 6, pp. 1256–1265, 2022.
  142. H. Li, Z. Huang, X. Liu, C. Zeng, and P. Zou, “Multi-fidelity meta-optimization for nature inspired optimization algorithms,” Appl. Soft Comput., vol. 96, p. 106619, 2020.
  143. M. A. El-Beltagy and A. J. Keane, “A comparison of various optimization algorithms on a multilevel problem,” Eng. Appl. Artif. Intell., vol. 12, no. 5, pp. 639–654, 1999.
  144. S. Liu, H. Wang, and W. Yao, “A surrogate-assisted evolutionary algorithm with hypervolume triggered fidelity adjustment for noisy multiobjective integer programming,” Appl. Soft Comput., vol. 126, p. 109263, 2022.
  145. P. Jiang, Q. Zhou, J. Liu, and Y. Cheng, “A three-stage surrogate model assisted multi-objective genetic algorithm for computationally expensive problems,” in CEC’19: Proc. of 2019 IEEE Congress on Evolutionary Computation, 2019, pp. 1680–1687.
  146. M. M. Mamun, H. K. Singh, and T. Ray, “A multifidelity approach for bilevel optimization with limited computing budget,” IEEE Trans. Evol. Comput., vol. 26, no. 2, pp. 392–399, 2022.
  147. H. Yang, S. H. Hong, and Y. Wang, “A sequential multi-fidelity surrogate-based optimization methodology based on expected improvement reduction,” Struct. Multidiscipl. Optim., vol. 65, no. 5, p. 153, 2022.
  148. H. Yang and Y. Wang, “A sparse multi-fidelity surrogate-based optimization method with computational awareness,” Eng. Comput., vol. 39, no. 5, pp. 3473–3489, 2023.
  149. Z. Liu, H. Xu, and P. Zhu, “An adaptive multi-fidelity approach for design optimization of mesostructure-structure systems,” Struct. Multidiscipl. Optim., vol. 62, pp. 375–386, 2020.
  150. L. Shu, P. Jiang, Q. Zhou, X. Shao, J. Hu, and X. Meng, “An on-line variable fidelity metamodel assisted multi-objective genetic algorithm for engineering design optimization,” Appl. Soft Comput., vol. 66, pp. 438–448, 2018.
  151. D. Lim, Y. Ong, Y. Jin, and B. Sendhoff, “Evolutionary optimization with dynamic fidelity computational models,” in ICIC’08: Proc. of the 4th International Conference on Intelligent Computing, ser. Lecture Notes in Computer Science, vol. 5227.   Springer, 2008, pp. 235–242.
  152. D. E. Bryson and M. P. Rumpfkeil, “Variable-fidelity surrogate modeling of lambda wing transonic aerodynamic performance,” in Proc. of the 54th AIAA Aerospace Sciences Meeting.   AIAA, 2016, p. 0294.
  153. H. Wang, Y. Jin, and J. Doherty, “A generic test suite for evolutionary multifidelity optimization,” IEEE Trans. Evol. Comput., vol. 22, no. 6, pp. 836–850, 2018.
  154. C. Li, P. Wang, and H. Dong, “Kriging-based multi-fidelity optimization via information fusion with uncertainty,” J. Mech. Sci. Technol., vol. 32, no. 1, pp. 245–259, 2018.
  155. A. Serani, R. Pellegrini, J. Wackers, C.-E. Jeanson, P. Queutey, M. Visonneau, and M. Diez, “Adaptive multi-fidelity sampling for CFD-based optimisation via radial basis function metamodels,” Int. J. Comut. Fluid Dyn., vol. 33, no. 6-7, pp. 237–255, 2019.
  156. M. P. Rumpfkeil and P. S. Beran, “Multi-fidelity, gradient-enhanced, and locally optimized sparse polynomial chaos and Kriging surrogate models applied to benchmark problems,” in AIAA Scitech 2020 Forum, 2020, p. 0677.
  157. S. van Rijn and S. Schmitt, “MF2: A collection of multi-fidelity benchmark functions in python,” J. Open Source Softw., vol. 5, no. 52, p. 2049, 2020.
  158. D. J. Toal, “Some considerations regarding the use of multi-fidelity Kriging in the construction of surrogate models,” Struct. Multidiscipl. Optim., vol. 51, no. 6, pp. 1223–1245, 2015.
  159. L. Mainini, A. Serani, M. P. Rumpfkeil, E. A. Minisci, D. Quagliarella, H. Pehlivan, S. Yildiz, S. Ficini, R. Pellegrini, F. D. Fiore, D. E. Bryson, M. Nikbay, M. Diez, and P. Beran, “Analytical benchmark problems for multifidelity optimization methods,” in Research Workshop AVT-354 on Multi-fidelity Methods for Military Vehicle Design, 2022.
  160. A. Kenny, T. Ray, H. K. Singh, and X. Li, “A test suite for multi-objective multi-fidelity optimization,” in EMO’23: Proc. of the 12th International Conference on Evolutionary Multi-Criterion Optimization.   Springer, 2023, pp. 361–373.
  161. Y. LeCun, Y. Bengio, and G. E. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015.
  162. M. Feurer and F. Hutter, “Hyperparameter optimization,” in Automated Machine Learning - Methods, Systems, Challenges, ser. The Springer Series on Challenges in Machine Learning, F. Hutter, L. Kotthoff, and J. Vanschoren, Eds.   Springer, 2019, pp. 3–33.
  163. A. Klein, S. Falkner, S. Bartels, P. Hennig, and F. Hutter, “Fast Bayesian optimization of machine learning hyperparameters on large datasets,” in AISTATS’17: Proc. of the 20th International Conference on Artificial Intelligence and Statistics, vol. 54, 2017, pp. 528–536.
  164. K. Kandasamy, G. Dasarathy, J. G. Schneider, and B. Póczos, “Multi-fidelity bayesian optimisation with continuous approximations,” in ICML’17: Proc. of the 34th International Conference on Machine Learning, vol. 70.   PMLR, 2017, pp. 1799–1808.
  165. H. Bertrand, R. Ardon, M. Perrot, and I. Bloch, “Hyperparameter optimization of deep neural networks: combining hperband with bayesian model selection,” in Conférence francophone sur l’apprentissage automatique, 2017.
  166. M. Wistuba, A. Kadra, and J. Grabocka, “Supervising the multi-fidelity race of hyperparameter configurations,” in NeurIPS’22: Proc. of the Annual Conference on Neural Information Processing Systems 2022, 2022.
  167. L. Leifsson and S. Koziel, “Multi-fidelity design optimization of transonic airfoils using shape-preserving response prediction,” Procedia Comput. Sci., vol. 1, no. 1, pp. 1311–1320, 2010.
  168. T. Benamara, P. Breitkopf, I. Lepot, and C. Sainvitu, “Adaptive infill sampling criterion for multi-fidelity optimization based on Gappy-POD: Application to the flight domain study of a transonic airfoil,” Struct. Multidisc. Optim., vol. 54, pp. 843–855, 2016.
  169. T. R. Barrett, N. W. Bressloff, and A. J. Keane, “Airfoil shape design and optimization using multifidelity analysis and embedded inverse design,” AIAA J., vol. 44, no. 9, pp. 2051–2060, 2006.
  170. A. March and K. Willcox, “Constrained multifidelity optimization using model calibration,” Struct. Multidisc. Optim., vol. 46, pp. 93–109, 2012.
  171. C. Aye, K. Wansaseub, S. Kumar, G. Tejani, S. Bureerat, A. Yildiz, and N. Pholdee, “Airfoil shape optimisation using a multi-fidelity surrogate-assisted metaheuristic with a new multi-objective infill sampling technique,” CMES-Computer Modeling in Engineering & Sciences, 2023.
  172. J. Demange, A. M. Savill, and T. Kipouros, “Multifidelity optimization for high-lift airfoils,” in The Proc. of the 54th AIAA Aerospace Sciences Meeting, 2016, p. 0557.
  173. J. Tao and G. Sun, “Application of deep learning based multi-fidelity surrogate model to robust aerodynamic design optimization,” Aerosp. Sci. Technol., vol. 92, pp. 722–737, 2019.
  174. A. Ariyarit and M. Kanazaki, “Multi-fidelity multi-objective efficient global optimization applied to airfoil design problems,” Appl. Sci., vol. 7, no. 12, p. 1318, 2017.
  175. R. Priyanka and M. Sivapragasam, “Multi-fidelity surrogate model-based airfoil optimization at a transitional low Reynolds number,” Sādhanā, vol. 46, no. 1, p. 58, 2021.
  176. S. Tao, D. W. Apley, W. Chen, A. Garbo, D. J. Pate, and B. J. German, “Input mapping for model calibration with application to wing aerodynamics,” AIAA J., vol. 57, no. 7, pp. 2734–2745, 2019.
  177. A. Elham, “Adjoint quasi-three-dimensional aerodynamic solver for multi-fidelity wing aerodynamic shape optimization,” Aerosp. Sci. Technol., vol. 41, pp. 241–249, 2015.
  178. S. Brahmachary, G. Natarajan, and N. Sahoo, “A hybrid aerodynamic shape optimization approach for axisymmetric body in hypersonic flow,” in Fluid Mechanics and Fluid Power–Contemporary Research: Proceedings of the 5th International and 41st National Conference on FMFP 2014.   Springer, 2017, pp. 301–311.
  179. D. Rajnarayan, A. Haas, and I. Kroo, “A multifidelity gradient-free optimization method and application to aerodynamic design,” in Proc. of the 12th AIAA/ISSMO multidisciplinary analysis and optimization conference, 2008, p. 6020.
  180. J. Tancred and M. P. Rumpfkeil, “Aerodynamic response quantification of complex hypersonic configurations using variable fidelity surrogate modeling,” in Proc. of the 53rd AIAA Aerospace Sciences Meeting, 2015, p. 1703.
  181. S. Bahrami, C. Tribes, C. Devals, T. C. Vu, and F. Guibault, “Multi-fidelity shape optimization of hydraulic turbine runner blades using a multi-objective mesh adaptive direct search algorithm,” Appl. Math. Model., vol. 40, no. 2, pp. 1650–1668, 2016.
  182. S. Bahrami, C. Tribes, S. V. F. T. C. Vu, and F. Guibault, “Multi-fidelity design optimization of francis turbine runner blades,” in IOP Conference Series: Earth and Environmental Science, vol. 22, no. 1.   IOP Publishing, 2014, p. 012029.
  183. Z. Guo, L. Song, C. Park, J. Li, and R. T. Haftka, “Analysis of dataset selection for multi-fidelity surrogates for a turbine problem,” Struct. Multidiscip. Optim., vol. 57, pp. 2127–2142, 2018.
  184. D. J. J. Toal, X. Zhang, A. J. Keane, C. Y. Lee, and M. Zedda, “The potential of a multifidelity approach to gas turbine combustor design optimization,” J. Eng. Gas Turbine. Power., vol. 143, no. 5, p. 051002, 2021.
  185. S. Nachar, P.-A. Boucard, D. Néron, and C. Rey, “Multi-fidelity Bayesian optimization using model-order reduction for viscoplastic structures,” Finite Elem. Anal. Des., vol. 176, p. 103400, 2020.
  186. D. J. J. Toal, A. J. Keane, D. Benito, J. A. Dixon, J. Yang, M. Price, T. Robinson, A. Remouchamps, and N. Kill, “Multifidelity multidisciplinary whole-engine thermomechanical design optimization,” J. Propuls. Power, vol. 30, no. 6, pp. 1654–1666, 2014.
  187. M. M. Joly, T. Verstraete, and G. Paniagua, “Integrated multifidelity, multidisciplinary evolutionary design optimization of counterrotating compressors,” Integr. Comput. Aided Eng., vol. 21, no. 3, pp. 249–261, 2014.
  188. S. Mondal, M. M. Joly, and S. Sarkar, “Multi-fidelity global-local optimization of a transonic compressor rotor,” in Turbo Expo: Power for Land, Sea, and Air, vol. 58585.   American Society of Mechanical Engineers, 2019, p. V02DT46A020.
  189. M. Tezzele, L. Fabris, M. Sidari, M. Sicchiero, and G. Rozza, “A multifidelity approach coupling parameter space reduction and nonintrusive POD with application to structural optimization of passenger ship hulls,” International Journal for Numerical Methods in Engineering, vol. 124, no. 5, pp. 1193–1210, 2023.
  190. X. Liu, D. Wan, and L. Lei, “Multi-fidelity model and reduced-order method for comprehensive hydrodynamic performance optimization and prediction of JBC ship,” Ocean Eng., vol. 267, p. 113321, 2023.
  191. R. Pellegrini, A. Serani, S. Harries, and M. Diez, “Multi-objective hull-form optimization of a swath configuration via design-space dimensionality reduction, multi-fidelity metamodels, and swarm intelligence,” in MARINE’17: Proc. of the the 7th International Conference on Computational Methods in Marine Engineering.   CIMNE, 2017, pp. 95–106.
  192. M. J. Wankhede, N. W. Bressloff, and A. J. Keane, “Efficient strategy for low NOx combustor design in the spatial domain using multi-fidelity solutions,” in Turbo Expo: Power for Land, Sea, and Air, vol. 55102.   American Society of Mechanical Engineers, 2013, p. V01AT04A019.
  193. ——, “Combustor design optimization using co-Kriging of steady and unsteady turbulent combustion,” J. Eng. Gas Turbine. Power., vol. 133, p. 121504, 2011.
  194. J. I. Madsen and M. Langthjem, “Multifidelity response surface approximations for the optimum design of diffuser flows,” Optim. Eng., vol. 2, pp. 453–468, 2001.
  195. Y.-P. Bu, W.-P. Song, Z.-H. Han, and Y. Zhang, “Efficient aerostructural optimization of helicopter rotors toward aeroacoustic noise reduction using multilevel hierarchical kriging model,” Aerosp. Sci. Technol., vol. 127, p. 107683, 2022.
  196. D. Zhang, B. Zhang, Z. Wang, and X. Zhu, “An efficient surrogate-based optimization method for BWBUG based on multifidelity model and geometric constraint gradients,” Math. Probl. Eng., vol. 2021, pp. 1–13, 2021.
  197. P. Singh, I. Couckuyt, K. Elsayed, D. Deschrijver, and T. Dhaene, “Multi-objective geometry optimization of a gas cyclone using triple-fidelity co-Kriging surrogate models,” J. Optim. Theory Appl., vol. 175, no. 1, pp. 172–193, 2017.
  198. L. Wang, Y. Yao, L. Zhang, C. D. Adenutsi, G. Zhao, and F. Lai, “An intelligent multi-fidelity surrogate-assisted multi-objective reservoir production optimization method based on transfer stacking,” Comput. Geosci., vol. 26, pp. 1279 – 1295, 2022.
  199. L. Wang, Y. Yao, T. Zhang, C. D. Adenutsi, G. Zhao, and F. Lai, “A novel self-adaptive multi-fidelity surrogate-assisted multi-objective evolutionary algorithm for simulation-based production optimization,” J. Pet. Sci. Eng., vol. 211, p. 110111, 2022.
  200. L. Wang, Y. Yao, Z. Tao, C. D. Adenutsi, G. C. Zhao, and F. Lai, “A rapid intelligent multi-fidelity surrogate-assisted multi-objective optimization method for water-flooding reservoir production optimization,” Arab. J. Geosci., vol. 15, 2022.
  201. M. A. Cardoso and L. J. Durlofsky, “Use of reduced-order modeling procedures for production optimization,” SPE Journal, vol. 15, no. 02, pp. 426–435, 2010.
  202. L. Wang, Y. Yao, W. Wang, C. D. Adenutsi, G. Zhao, and F. Lai, “Integrated optimization design for horizontal well spacing and fracture stage placement in shale gas reservoir,” J. Nat. Gas Eng., vol. 105, p. 104706, 2022.
  203. G. Zhao, Y. Yao, L. Wang, C. D. Adenutsi, D. Feng, and W. Z. Wu, “Optimization design of horizontal well fracture stage placement in shale gas reservoirs based on an efficient variable-fidelity surrogate model and intelligent algorithm,” Energy Rep., vol. 8, pp. 3589–3599, 2022.
  204. H. Bu, Y. Yang, L. Song, and J. Li, “Improving the film cooling performance of a turbine endwall with multi-fidelity modeling considering conjugate heat transfer,” J. Turbomach., vol. 144, no. 1, p. 011011, 2022.
  205. Y. Kim, S. Lee, and K. Yee, “Variable-fidelity optimization of film-cooling hole arrangements considering conjugate heat transfer,” J. Propuls. Power, vol. 34, no. 5, pp. 1140–1151, 2018.
  206. D. J. Hartl, E. Galván, R. J. Malak, and J. W. Baur, “Parameterized design optimization of a magnetohydrodynamic liquid metal active cooling concept,” J. Mech. Des., vol. 138, p. 031402, 2016.
  207. D. J. Hartl, G. J. Frank, and J. W. Baur, “Embedded magnetohydrodynamic liquid metal thermal transport: validated analysis and design optimization,” J. Intell. Mater. Syst. Struct., vol. 28, no. 7, pp. 862–877, 2017.
  208. X. Wang, Y. Liu, W. Sun, X. Song, and J. Zhang, “Multidisciplinary and multifidelity design optimization of electric vehicle battery thermal management system,” J. Mech. Des., vol. 140, no. 9, p. 094501, 2018.
  209. D. Tran, S. Chakraborty, A. V. Melckebeke, N. Vu, Y. Lan, M. E. Baghdadi, and O. Hegazy, “Multi-fidelity electro-thermal optimization of multiport converter employing sic MOSFET and indirect liquid cooling,” in EVER’19: Proc. of the 14th International Conference on Ecological Vehicles and Renewable Energies, 2019, pp. 1–7.
  210. J. P. Jacobs, S. Koziel, and S. Ogurtsov, “Computationally efficient multi-fidelity bayesian support vector regression modeling of planar antenna input characteristics,” IEEE Trans. Antennas Propag., vol. 61, pp. 980–984, 2013.
  211. B. Liu, S. Koziel, and N. T. Ali, “SADEA-II: A generalized method for efficient global optimization of antenna design,” J. Comput. Des. Eng., vol. 4, no. 2, pp. 86–97, 2017.
  212. S. Koziel, S. Ogurtsov, and L. Leifsson, “Simulation-driven design of antennas using coarse-discretization electromagnetic models,” in ICCS’11: Proc. of the 2011 International Conference on Computational Science, ser. Procedia Computer Science, vol. 4.   Elsevier, 2011, pp. 1252–1261.
  213. S. Koziel and A. Bekasiewicz, “Rapid adjoint-based design optimization of compact microwave structures using multi-fidelity simulation models,” EuMC’16: Proc. of the 46th European Microwave Conference, pp. 174–177, 2016.
  214. S. Koziel and S. Ogurtsov, “Multilevel microwave design optimization with automated model fidelity adjustment,” Int. J. RF Microw. Comput.-Aided Eng., vol. 24, pp. 281–288, 2014.
  215. H. S. Kim, M. Koç, and J. Ni, “A hybrid multi-fidelity approach to the optimal design of warm forming processes using a knowledge-based artificial neural network,” Int. J. Mach. Tools Manuf., vol. 47, pp. 211–222, 2007.
  216. M. Li, Z. Liu, L. Huang, Q. Chen, Q. Zhai, W. Han, and P. Zhu, “Multi-fidelity data-driven optimization design framework for self-piercing riveting process parameters,” J. Manuf. Process., vol. 99, pp. 812–824, 2023.
  217. Q. Zhou, Y. Yang, P. Jiang, X. Shao, L. Cao, J. Hu, Z. Gao, and C. Wang, “A multi-fidelity information fusion metamodeling assisted laser beam welding process parameter optimization approach,” Adv. Eng. Softw., vol. 110, pp. 85–97, 2017.
  218. Y. Yang, Z. Gao, and L. Cao, “Identifying optimal process parameters in deep penetration laser welding by adopting hierarchical-Kriging model,” Infrared Phys. Technol., vol. 92, pp. 443–453, 2018.
  219. X. Zhou, S.-J. Hsieh, and J.-C. Wang, “Accelerating extrusion-based additive manufacturing optimization processes with surrogate-based multi-fidelity models,” Int. J. Adv. Manuf. Technol., vol. 103, pp. 4071–4083, 2019.
  220. F. Sorourifar, N. A. Choksi, and J. A. Paulson, “Computationally efficient integrated design and predictive control of flexible energy systems using multi-fidelity simulation-based bayesian optimization,” Optim. Control Appl. Methods., vol. 44, no. 2, pp. 549–576, 2023.
  221. T. A. Reist, D. W. Zingg, M. Rakowitz, G. Potter, and S. Banerjee, “Multifidelity optimization of hybrid wing–body aircraft with stability and control requirements,” J. Aircr., vol. 56, no. 2, pp. 442–456, 2019.
  222. P. G. Anselma, A. Biswas, J. Roeleveld, G. Belingardi, and A. Emadi, “Multi-fidelity near-optimal on-line control of a parallel hybrid electric vehicle powertrain,” in ITEC’2019: IEEE transportation electrification conference and expo.   IEEE, 2019, pp. 1–6.
  223. M. F. Keskin, B. Peng, B. Kulcsár, and H. Wymeersch, “Altruistic control of connected automated vehicles in mixed-autonomy multi-lane highway traffic,” IFAC-PapersOnLine, vol. 53, pp. 14 966–14 971, 2020.
  224. N. Alexandrov, R. Lewis, C. Gumbert, L. Green, and P. Newman, “Optimization with variable-fidelity models applied to wing design,” in Proc. of the 38th Aerospace Sciences Meeting and Exhibit, 2000, p. 841.
  225. J. Nagawkar, J. Ren, X. Du, L. Leifsson, and S. Koziel, “Single-and multipoint aerodynamic shape optimization using multifidelity models and manifold mapping,” J. of Aircr., vol. 58, no. 3, pp. 591–608, 2021.
  226. Y. Goldfeld, K. Vervenne, J. Arbocz, and F. V. Keulen, “Multi-fidelity optimization of laminated conical shells for buckling,” Struct. Multidiscip. Optim., vol. 30, pp. 128–141, 2005.
  227. R. Pellegrini, C. Leotardi, U. Iemma, E. F. Campana, and M. Diez, “A multi-fidelity adaptive sampling method for metamodel-based uncertainty quantification of computer simulations,” in ECCOMAS’16: Proc. of the VII European congress on computational methods in applied sciences and engineering, 2016.
  228. K. Yaji, S. Yamasaki, and K. Fujita, “Data-driven multifidelity topology design using a deep generative model: Application to forced convection heat transfer problems,” Comput. Methods Appl. Mech. Eng., vol. 388, p. 114284, 2022.
  229. A. Mannarino and P. Mantegazza, “Multifidelity control of aeroelastic systems: an immersion and invariance approach,” J. Guid. Control Dyn., vol. 37, no. 5, pp. 1568–1582, 2014.
  230. C. Mo, P. Perdikaris, and J. R. Raney, “Accelerated design of architected materials with multifidelity Bayesian optimization,” J. Eng. Mech., vol. 149, 2023.
  231. G. Pilania, J. E. Gubernatis, and T. Lookman, “Multi-fidelity machine learning models for accurate bandgap predictions of solids,” Comput. Mater. Sci., vol. 129, pp. 156–163, 2017.
  232. S. F. Ghoreishi, A. Molkeri, A. Srivastava, R. Arróyave, and D. L. Allaire, “Multi-information source fusion and optimization to realize ICME: Application to dual-phase materials,” J. Mech. Des., vol. 140, p. 111409, 2018.
  233. D. Khatamsaz, A. Molkeri, R. Couperthwaite, J. James, R. Arróyave, D. L. Allaire, and A. Srivastava, “Efficiently exploiting process-structure-property relationships in material design by multi-information source fusion,” Acta Mater., vol. 206, p. 116619, 2021.
  234. F. A. C. Viana, V. Steffen, S. Butkewitsch, and M. de Freitas Leal, “Optimization of aircraft structural components by using nature-inspired algorithms and multi-fidelity approximations,” J. Glob. Optim., vol. 45, no. 3, pp. 427–449, 2009.
  235. H. An, B. D. Youn, and H. S. Kim, “Variable-stiffness composite optimization using dynamic and exponential multi-fidelity surrogate models,” Int. J. Mech. Sci., vol. 257, p. 108547, 2023.
  236. A. Pourhabib, J. Z. Huang, K. Wang, C. Zhang, B. Wang, and Y. Ding, “Modulus prediction of buckypaper based on multi-fidelity analysis involving latent variables,” IIE Transactions, vol. 47, pp. 141–152, 2015.
  237. J. Qian, Y. Cheng, A. Zhang, Q. Zhou, and J. Zhang, “Optimization design of metamaterial vibration isolator with honeycomb structure based on multi-fidelity surrogate model,” Struct. Multidisc. Optim., vol. 64, pp. 423–439, 2021.
  238. Q. Guo, J. Hang, S. Wang, W. Hui, and Z. H. Xie, “Design optimization of variable stiffness composites by using multi-fidelity surrogate models,” Struct. Multidisc. Optim., vol. 63, pp. 439–461, 2020.
  239. D. Khatamsaz, A. Molkeri, R. Couperthwaite, J. James, R. Arróyave, A. Srivastava, and D. L. Allaire, “Adaptive active subspace-based efficient multifidelity materials design,” Mater. Des., vol. 209, p. 110001, 2021.
  240. C. Fare, P. Fenner, M. Benatan, A. Varsi, and E. O. Pyzer-Knapp, “A multi-fidelity machine learning approach to high throughput materials screening,” Npj Comput. Mater., vol. 8, pp. 1–9, 2022.
  241. S. P. Lewis, “A how-to guide for predicting properties of materials with DFT [review of ”density functional theory: A practical introduction” (sholl, D.S. and steckel, j.a.; 2009) [book review],” Comput. Sci. Eng., vol. 12, no. 6, pp. 5–7, 2010.
  242. K. Greenman, W. H. Green, and R. Gómez-Bombarelli, “Multi-fidelity prediction of molecular optical peaks with deep learning,” Chem. Sci., vol. 13, pp. 1152–1162, 2021.
  243. O. A. Egorova, R. Hafizi, D. C. Woods, and G. M. Day, “Multifidelity statistical machine learning for molecular crystal structure prediction,” J. Phys. Chem. A, vol. 124, no. 39, pp. 8065–8078, 2020.
  244. F. Mayr, M. Wieder, O. Wieder, and T. Langer, “Improving small molecule pk a prediction using transfer learning with graph neural networks,” Front. Chem., vol. 10, 2022. [Online]. Available: https://api.semanticscholar.org/CorpusID:246178950
  245. J. Wu, Y. Wan, Z. Wu, S. Zhang, D. Cao, C.-Y. Hsieh, and T. Hou, “Mf-sup-pka: Multi-fidelity modeling with subgraph pooling mechanism for pka prediction,” Acta Pharm. Sin. B., vol. 13, pp. 2572–2584, 2022.
  246. Y. Duan, L. Fu, X. Zhang, T. Long, Y. He, Z. Liu, A. Lu, Y. Deng, C. Hsieh, T. Hou, and D. Cao, “Improved gnns for log d 7.4 prediction by transferring knowledge from low-fidelity data,” J. Chem. Inf. Model., vol. 63, no. 8, pp. 2345–2359, 2023.
  247. Y. Wang, J. Xiong, F. Xiao, W. Zhang, K. Cheng, J. Rao, B. Niu, X. Tong, N. Qu, R. Zhang, D. Wang, K. Chen, X. Li, and M. Zheng, “Logd7.4 prediction enhanced by transferring knowledge from chromatographic retention time, microscopic pka and logp,” J. Cheminformatics, vol. 15, no. 1, p. 76, 2023.
  248. D. Buterez, J. P. Janet, S. J. Kiddle, and P. Liò, “MF-PCBA: multifidelity high-throughput screening benchmarks for drug discovery and machine learning,” J. Chem. Inf. Model., vol. 63, no. 9, pp. 2667–2678, 2023.
  249. A. Hernández-García, N. Saxena, M. Jain, C. Liu, and Y. Bengio, “Multi-fidelity active learning with GFlowNets,” CoRR, vol. abs/2306.11715, 2023.
  250. O. C. Madin and M. R. Shirts, “Using physical property surrogate models to perform accelerated multi-fidelity optimization of force field parameters,” Digital Discovery, vol. 2, pp. 828 – 847, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:258539519
  251. A. D. Jagtap, D. Mitsotakis, and G. E. Karniadakis, “Deep learning of inverse water waves problems using multi-fidelity data: Application to Serre-Green-Naghdi equations,” CoRR, vol. abs/2202.02899, 2022. [Online]. Available: https://arxiv.org/abs/2202.02899
  252. S. Basir and I. Senocak, “Physics and equality constrained artificial neural networks: Application to forward and inverse problems with multi-fidelity data fusion,” J. Comput. Phys., vol. 463, p. 111301, 2021.
  253. F. Regazzoni, S. Pagani, A. Cosenza, A. Lombardi, and A. M. Quarteroni, “A physics-informed multi-fidelity approach for the estimation of differential equations parameters in low-data or large-noise regimes,” Rendiconti Lincei, vol. 32, no. 3, pp. 437–470, 2021.
  254. M. Ramezankhani, A. Nazemi, A. Narayan, H. Voggenreiter, M. Harandi, R. J. Seethaler, and A. S. Milani, “A data-driven multi-fidelity physics-informed learning framework for smart manufacturing: A composites processing case study,” in ICPS’22: Proc. of the 5th IEEE International Conference on Industrial Cyber-Physical System, 2022, pp. 1–7.
  255. M. Islam, M. S. H. Thakur, S. Mojumder, and M. N. Hasan, “Extraction of material properties through multi-fidelity deep learning from molecular dynamics simulation,” Comput. Mater. Sci., vol. 188, p. 110187, 2021.
  256. J. Lei, Q. Liu, and X. Wang, “Physics-informed multi-fidelity learning-driven imaging method for electrical capacitance tomography,” Eng. Appl. Artif. Intell., vol. 116, p. 105467, 2022.
  257. J. Lei and X. Wang, “Transfer learning-driven inversion method for the imaging problem in electrical capacitance tomography,” Expert Syst. Appl., vol. 227, p. 120277, 2023.
  258. A. S. Thelen, D. E. Bryson, B. K. Stanford, and P. S. Beran, “Multi-fidelity gradient-based optimization for high-dimensional aeroelastic configurations,” Algorithms, vol. 15, no. 4, p. 131, 2022.
  259. H. Liu, J. Cai, Y. Ong, and Y. Wang, “Understanding and comparing scalable gaussian process regression for big data,” Knowl. Based Syst., vol. 164, pp. 324–335, 2019.
  260. M. Padidar, X. Zhu, L. Huang, J. R. Gardner, and D. Bindel, “Scaling gaussian processes with derivative information using variational inference,” in NeurIPS’21: Proc. of 34th Annual Conference on Neural Information Processing Systems 2021, 2021, pp. 6442–6453.
  261. K. Li, Á. Fialho, and S. Kwong, “Multi-objective differential evolution with adaptive control of parameters and operators,” in LION5: Proc. of the 5th International Conference on Learning and Intelligent Optimization, 2011, pp. 473–487.
  262. K. Li, S. Kwong, R. Wang, K. Tang, and K. Man, “Learning paradigm based on jumping genes: A general framework for enhancing exploration in evolutionary multiobjective optimization,” Inf. Sci., vol. 226, pp. 1–22, 2013.
  263. L. Sun and K. Li, “Adaptive operator selection based on dynamic thompson sampling for MOEA/D,” in PPSN’20: Proc. of 16th International Conference on Parallel Problem Solving from Nature, ser. Lecture Notes in Computer Science, vol. 12270.   Springer, 2020, pp. 271–284.
  264. K. Li, J. Zheng, M. Li, C. Zhou, and H. Lv, “A novel algorithm for non-dominated hypervolume-based multiobjective optimization,” in SMC’09: Proc. of 2009 the IEEE International Conference on Systems, Man and Cybernetics, 2009, pp. 5220–5226.
  265. K. Li, S. Kwong, R. Wang, J. Cao, and I. J. Rudas, “Multi-objective differential evolution with self-navigation,” in SMC’12: Proc. of the 2012 IEEE International Conference on Systems, Man, and Cybernetics, 2012, pp. 508–513.
  266. K. Li, Q. Zhang, S. Kwong, M. Li, and R. Wang, “Stable matching-based selection in evolutionary multiobjective optimization,” IEEE Trans. Evol. Comput., vol. 18, no. 6, pp. 909–923, 2014.
  267. K. Li, Á. Fialho, S. Kwong, and Q. Zhang, “Adaptive operator selection with bandits for a multiobjective evolutionary algorithm based on decomposition,” IEEE Trans. Evol. Comput., vol. 18, no. 1, pp. 114–130, 2014.
  268. K. Li, S. Kwong, and K. Deb, “A dual-population paradigm for evolutionary multiobjective optimization,” Inf. Sci., vol. 309, pp. 50–72, 2015.
  269. K. Li, K. Deb, Q. Zhang, and S. Kwong, “An evolutionary many-objective optimization algorithm based on dominance and decomposition,” IEEE Trans. Evol. Comput., vol. 19, no. 5, pp. 694–716, 2015.
  270. K. Li, S. Kwong, Q. Zhang, and K. Deb, “Interrelationship-based selection for decomposition multiobjective optimization,” IEEE Trans. Cybern., vol. 45, no. 10, pp. 2076–2088, 2015.
  271. M. Wu, S. Kwong, Q. Zhang, K. Li, R. Wang, and B. Liu, “Two-level stable matching-based selection in MOEA/D,” in SMC’15: Proc. of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, 2015, pp. 1720–1725.
  272. M. Wu, S. Kwong, Y. Jia, K. Li, and Q. Zhang, “Adaptive weights generation for decomposition-based multi-objective optimization using gaussian process regression,” in GECCO’17: Proc. of the 2017 Genetic and Evolutionary Computation Conference.   ACM, 2017, pp. 641–648.
  273. M. Wu, K. Li, S. Kwong, Y. Zhou, and Q. Zhang, “Matching-based selection with incomplete lists for decomposition multiobjective optimization,” IEEE Trans. Evol. Comput., vol. 21, no. 4, pp. 554–568, 2017.
  274. K. Li, R. Chen, G. Min, and X. Yao, “Integration of preferences in decomposition multiobjective optimization,” IEEE Trans. Cybern., vol. 48, no. 12, pp. 3359–3370, 2018.
  275. M. Wu, K. Li, S. Kwong, Q. Zhang, and J. Zhang, “Learning to decompose: A paradigm for decomposition-based multiobjective optimization,” IEEE Trans. Evol. Comput., vol. 23, no. 3, pp. 376–390, 2019. [Online]. Available: https://doi.org/10.1109/TEVC.2018.2865931
  276. M. Wu, K. Li, S. Kwong, and Q. Zhang, “Evolutionary many-objective optimization based on adversarial decomposition,” IEEE Trans. Cybern., vol. 50, no. 2, pp. 753–764, 2020.
  277. B. Lyu, Y. Yang, S. Wen, T. Huang, and K. Li, “Neural architecture search for portrait parsing,” IEEE Trans. Neural Networks Learn. Syst., vol. 34, no. 3, pp. 1112–1121, 2023.
  278. B. Lyu, M. Hamdi, Y. Yang, Y. Cao, Z. Yan, K. Li, S. Wen, and T. Huang, “Efficient spectral graph convolutional network deployment on memristive crossbars,” IEEE Trans. Emerg. Top. Comput. Intell., vol. 7, no. 2, pp. 415–425, 2023.
  279. B. Lyu, L. Lu, M. Hamdi, S. Wen, Y. Yang, and K. Li, “MTLP-JR: multi-task learning-based prediction for joint ranking in neural architecture search,” Comput. Electr. Eng., vol. 105, p. 108474, 2023.
  280. R. Tang, K. Li, W. Ding, Y. Wang, H. Zhou, and G. Fu, “Reference point based multi-objective optimization of reservoir operation: a comparison of three algorithms,” Water Resources Management, vol. 34, no. 3, pp. 1005–1020, 2020.
  281. S. Zhou, K. Li, and G. Min, “Attention-based genetic algorithm for adversarial attack in natural language processing,” in PPSN’22: Proc. of 17th International Conference on Parallel Problem Solving from Nature, ser. Lecture Notes in Computer Science, vol. 13398.   Springer, 2022, pp. 341–355.
  282. ——, “Adversarial example generation via genetic algorithm: a preliminary result,” in GECCO’22: Companion of 2022 Genetic and Evolutionary Computation Conference.   ACM, 2022, pp. 469–470.
  283. P. N. Williams, K. Li, and G. Min, “A surrogate assisted evolutionary strategy for image approximation by density-ratio estimation,” in CEC’23: Proc. of 2023 IEEE Congress on Evolutionary Computation.   IEEE, 2023, pp. 1–8.
  284. ——, “Sparse adversarial attack via bi-objective optimization,” in EMO’23: Proc. of the 12th International Conference on Evolutionary Multi-Criterion Optimization, ser. Lecture Notes in Computer Science, vol. 13970.   Springer, 2023, pp. 118–133. [Online]. Available: https://doi.org/10.1007/978-3-031-27250-9_9
  285. ——, “Black-box adversarial attack via overlapped shapes,” in GECCO ’22: Genetic and Evolutionary Computation Conference, Companion Volume, Boston, Massachusetts, USA, July 9 - 13, 2022.   ACM, 2022, pp. 467–468.
  286. P. N. Williams and K. Li, “Black-box sparse adversarial attack via multi-objective optimisation CVPR proceedings,” in CVPR’23: Proc. of 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition.   IEEE, 2023, pp. 12 291–12 301.
  287. K. Li, Z. Xiang, and K. C. Tan, “Which surrogate works for empirical performance modelling? A case study with differential evolution,” in CEC’19: Proc. of the 2019 IEEE Congress on Evolutionary Computation, 2019, pp. 1988–1995.
  288. K. Li, Z. Xiang, T. Chen, S. Wang, and K. C. Tan, “Understanding the automated parameter optimization on transfer learning for cross-project defect prediction: an empirical study,” in ICSE’20: Proc. of the 42nd International Conference on Software Engineering.   ACM, 2020, pp. 566–577.
  289. M. Liu, K. Li, and T. Chen, “DeepSQLi: deep semantic learning for testing SQL injection,” in ISSTA’20: Proc. of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis.   ACM, 2020, pp. 286–297.
  290. K. Li, Z. Xiang, T. Chen, and K. C. Tan, “BiLO-CPDP: Bi-level programming for automated model discovery in cross-project defect prediction,” in ASE’20: Proc. of the 35th IEEE/ACM International Conference on Automated Software Engineering.   IEEE, 2020, pp. 573–584.
  291. K. Li, H. Yang, and W. Visser, “Danuoyi: Evolutionary multi-task injection testing on web application firewalls,” IEEE Trans. Softw. Eng., 2023, accepted for publication.
  292. J. Xu, K. Li, M. Abusara, and Y. Zhang, “Admm-based OPF problem against cyber attacks in smart grid,” in SMC’21: Proc. of 2021 IEEE International Conference on Systems, Man, and Cybernetics.   IEEE, 2021, pp. 1418–1423.
  293. J. Xu, K. Li, and M. Abusara, “Multi-objective reinforcement learning based multi-microgrid system optimisation problem,” in EMO’21: Proc. of 11th International Conference on Evolutionary Multi-Criterion Optimization, vol. 12654.   Springer, 2021, pp. 684–696.
  294. ——, “Preference based multi-objective reinforcement learning for multi-microgrid system optimization problem in smart grid,” Memetic Comput., vol. 14, no. 2, pp. 225–235, 2022.
  295. J. Billingsley, K. Li, W. Miao, G. Min, and N. Georgalas, “A formal model for multi-objective optimisation of network function virtualisation placement,” in EMO’19: Proc. of 10th International Conference on Evolutionary Multi-Criterion Optimization, ser. Lecture Notes in Computer Science, vol. 11411.   Springer, 2019, pp. 529–540.
  296. ——, “Routing-led placement of vnfs in arbitrary networks,” in CEC’20: Proc. of 2020 IEEE Congress on Evolutionary Computation.   IEEE, 2020, pp. 1–8.
  297. J. Billingsley, W. Miao, K. Li, G. Min, and N. Georgalas, “Performance analysis of SDN and NFV enabled mobile cloud computing,” in GLOBECOM’20: Proc. of 2020 IEEE Global Communications Conference.   IEEE, 2020, pp. 1–6.
  298. J. Billingsley, K. Li, W. Miao, G. Min, and N. Georgalas, “Parallel algorithms for the multiobjective virtual network function placement problem,” in EMO’21: Proc. of 11th International Conference on Evolutionary Multi-Criterion Optimization, ser. Lecture Notes in Computer Science, vol. 12654.   Springer, 2021, pp. 708–720.
  299. J. Cao, S. Kwong, R. Wang, and K. Li, “A weighted voting method using minimum square error based on extreme learning machine,” in ICMLC’12: Proc. of the 2012 International Conference on Machine Learning and Cybernetics, 2012, pp. 411–414.
  300. K. Li, R. Wang, S. Kwong, and J. Cao, “Evolving extreme learning machine paradigm with adaptive operator selection and parameter control,” International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. supp02, pp. 143–154, 2013.
  301. K. Li and S. Kwong, “A general framework for evolutionary multiobjective optimization via manifold learning,” Neurocomputing, vol. 146, pp. 65–74, 2014.
  302. J. Cao, S. Kwong, R. Wang, X. Li, K. Li, and X. Kong, “Class-specific soft voting based multiple extreme learning machines ensemble,” Neurocomputing, vol. 149, pp. 275–284, 2015.
  303. R. Wang, S. Ye, K. Li, and S. Kwong, “Bayesian network based label correlation analysis for multi-label classifier chain,” Inf. Sci., vol. 554, pp. 256–275, 2021.
  304. H. Gao, H. Nie, and K. Li, “Visualisation of pareto front approximation: A short survey and empirical comparisons,” in CEC’19: Proc. of the 2019 IEEE Congress on Evolutionary Computation, 2019, pp. 1750–1757.
  305. K. Li, K. Deb, and X. Yao, “R-metric: Evaluating the performance of preference-based evolutionary multiobjective optimization using reference points,” IEEE Trans. Evol. Comput., vol. 22, no. 6, pp. 821–835, 2018.
  306. K. Li, M. Liao, K. Deb, G. Min, and X. Yao, “Does preference always help? A holistic study on preference-based evolutionary multiobjective optimization using reference points,” IEEE Trans. Evol. Comput., vol. 24, no. 6, pp. 1078–1096, 2020.
  307. K. Li, H. Nie, H. Gao, and X. Yao, “Posterior decision making based on decomposition-driven knee point identification,” IEEE Trans. Evol. Comput., vol. 26, no. 6, pp. 1409–1423, 2022.
  308. R. Tanabe and K. Li, “Quality indicators for preference-based evolutionary multi-objective optimization using a reference point: A review and analysis,” IEEE Trans. Evol. Comput., 2023, accepted for publication.
  309. R. Chen, K. Li, and X. Yao, “Dynamic multiobjectives optimization with a changing number of objectives,” IEEE Trans. Evol. Comput., vol. 22, no. 1, pp. 157–171, 2018.
  310. K. Li, “Progressive preference learning: Proof-of-principle results in MOEA/D,” in EMO’19: Proc. of the 10th International Conference Evolutionary Multi-Criterion Optimization, 2019, pp. 631–643.
  311. K. Li, R. Chen, D. A. Savic, and X. Yao, “Interactive decomposition multiobjective optimization via progressively learned value functions,” IEEE Trans. Fuzzy Syst., vol. 27, no. 5, pp. 849–860, 2019.
  312. X. Fan, K. Li, and K. C. Tan, “Surrogate assisted evolutionary algorithm based on transfer learning for dynamic expensive multi-objective optimisation problems,” in CEC’20: Proc. of the 2020 IEEE Congress on Evolutionary Computation.   IEEE, 2020, pp. 1–8.
  313. R. Chen and K. Li, “Transfer bayesian optimization for expensive black-box optimization in dynamic environment,” in SMC’21: Proc. of 2021 IEEE International Conference on Systems, Man, and Cybernetics.   IEEE, 2021, pp. 1374–1379.
  314. S. Li, K. Li, and W. Li, ““why not looking backward?” a robust two-step method to automatically terminate bayesian optimization,” in NeurIPS’23: Proc. of 37th Conference on Neural Information Processing Systems, 2023, pp. 1–12.
  315. K. Li, R. Chen, G. Fu, and X. Yao, “Two-archive evolutionary algorithm for constrained multiobjective optimization,” IEEE Trans. Evol. Comput., vol. 23, no. 2, pp. 303–315, 2019.
  316. X. Shan and K. Li, “An improved two-archive evolutionary algorithm for constrained multi-objective optimization,” in EMO’21: Proc. of the 11th International Conference on Evolutionary Multicriteria Optimization, ser. Lecture Notes in Computer Science, vol. 12654.   Springer, 2021, pp. 235–247.
  317. S. Li, K. Li, and W. Li, “Do we really need to use constraint violation in constrained evolutionary multi-objective optimization?” in PPSN’22: Proc. of the 17th International Conference on Parallel Problem Solving from Nature, ser. Lecture Notes in Computer Science, vol. 13399.   Springer, 2022, pp. 124–137.
  318. S. Wang and K. Li, “Constrained Bayesian optimization under partial observations: Balanced improvements and provable convergence,” in AAAI’24: Proc. of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024, accepted for publication. [Online]. Available: https://arxiv.org/abs/2312.03212
  319. H. Ishibuchi, Y. Setoguchi, H. Masuda, and Y. Nojima, “Performance of decomposition-based many-objective algorithms strongly depends on pareto front shapes,” IEEE Trans. Evol. Comput., vol. 21, no. 2, pp. 169–190, 2017.
  320. C. Ying, A. Klein, E. Christiansen, E. Real, K. Murphy, and F. Hutter, “NAS-Bench-101: Towards reproducible neural architecture search,” in ICML’19: Proc. of the 36th International Conference on Machine Learning, vol. 97.   PMLR, 2019, pp. 7105–7114.
  321. X. Dong and Y. Yang, “NAS-Bench-201: Extending the scope of reproducible neural architecture search,” in ICLR’20: Proc. of the 8th International Conference on Learning Representations.   OpenReview.net, 2020.
  322. K. Eggensperger, P. Müller, N. Mallik, M. Feurer, R. Sass, A. Klein, N. H. Awad, M. Lindauer, and F. Hutter, “HPOBench: A collection of reproducible multi-fidelity benchmark problems for HPO,” in NeurIPS’21: Proc. of the Annual Conference on Neural Information Processing Systems 2021, 2021.
  323. F. Pfisterer, L. Schneider, J. Moosbauer, M. Binder, and B. Bischl, “YAHPO gym - an efficient multi-objective multi-fidelity benchmark for hyperparameter optimization,” in AutoML’22: Proc. of 2022 International Conference on Automated Machine Learning, vol. 188, 2022, pp. 3/1–39.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Authors (2)

  1. Ke Li
  2. Fan Li
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 tweet and received 0 likes.

Upgrade to Pro to view all of the tweets about this paper:

Start a free 7-day Pro trial