Advancing Fluid-Based Thermal Management Systems Design: Leveraging Graph Neural Networks for Graph Regression and Efficient Enumeration Reduction (2311.14874v1)
Abstract: In this research, we developed a graph-based framework to represent various aspects of optimal thermal management system design, with the aim of rapidly and efficiently identifying optimal design candidates. Initially, the graph-based framework is utilized to generate diverse thermal management system architectures. The dynamics of these system architectures are modeled under various loading conditions, and an open-loop optimal controller is employed to determine each system's optimal performance. These modeled cases constitute the dataset, with the corresponding optimal performance values serving as the labels for the data. In the subsequent step, a Graph Neural Network (GNN) model is trained on 30% of the labeled data to predict the systems' performance, effectively addressing a regression problem. Utilizing this trained model, we estimate the performance values for the remaining 70% of the data, which serves as the test set. In the third step, the predicted performance values are employed to rank the test data, facilitating prioritized evaluation of the design scenarios. Specifically, a small subset of the test data with the highest estimated ranks undergoes evaluation via the open-loop optimal control solver. This targeted approach concentrates on evaluating higher-ranked designs identified by the GNN, replacing the exhaustive search (enumeration-based) of all design cases. The results demonstrate a significant average reduction of over 92% in the number of system dynamic modeling and optimal control analyses required to identify optimal design scenarios.
- Bayat, S., Shahmansouri, N., Peddada, S. R., Tessier, A., Butscher, A., and Allison, J. T., 2023, “Extracting Design Knowledge from Optimization Data: Enhancing Engineering Design in Fluid Based Thermal Management Systems,” arXiv preprint arXiv:2310.16324.
- Bayat, S. and Allison, J. T., 2023, “SS-MPC: A user-friendly software based on single shooting optimization to solve Model Predictive Control problems,” Software Impacts, 17, p. 100566.
- Bayat, S. and Allison, J. T., 2023, “LGR-MPC: A user-friendly software based on Legendre-Gauss-Radau pseudo spectral method for solving Model Predictive Control problems,” arXiv preprint arXiv:2310.15960.
- Bayat, S., Shahmansouri, N., Peddada, S. R., Tessier, A., Butscher, A., and Allison, J. T., 2023, “Multi-split configuration design for fluid-based thermal management systems,” arXiv preprint arXiv:2310.15500.
- Herber, D. R., 2017, “Advances in combined architecture, plant, and control design,” .
- Bayat, S. and Allison, J., 2023, “Control Co-Design with varying available information applied to vehicle suspensions,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, American Society of Mechanical Engineers.
- Herber, D. R., Guo, T., and Allison, J. T., 2017, “Enumeration of architectures with perfect matchings,” Journal of Mechanical Design, 139(5), p. 051403.
- Peddada, S. R., Herber, D. R., Pangborn, H. C., Alleyne, A. G., and Allison, J. T., 2019, “Optimal flow control and single split architecture exploration for fluid-based thermal management,” Journal of Mechanical Design, 141(8), p. 083401.
- Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., and Müller, K.-R., 2021, “Explaining deep neural networks and beyond: A review of methods and applications,” Proceedings of the IEEE, 109(3), pp. 247–278.
- Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., and Sun, M., 2020, “Graph neural networks: A review of methods and applications,” AI open, 1, pp. 57–81.
- Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., and Philip, S. Y., 2020, “A comprehensive survey on graph neural networks,” IEEE transactions on neural networks and learning systems, 32(1), pp. 4–24.
- Sirico, A. and Herber, D. R., 2023, “ON THE USE OF GEOMETRIC DEEP LEARNING FOR THE ITERATIVE CLASSIFICATION AND DOWN-SELECTION OF ANALOG ELECTRIC CIRCUITS,” Journal of Mechanical Design, pp. 1–15.
- Guo, T., Herber, D. R., and Allison, J. T., 2018, “Reducing evaluation cost for circuit synthesis using active learning,” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 51753, American Society of Mechanical Engineers, p. V02AT03A011.
- Guo, T., Lohan, D. J., Cang, R., Ren, M. Y., and Allison, J. T., 2018, “An indirect design representation for topology optimization using variational autoencoder and style transfer,” 2018 AIAA/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, p. 0804.
- Chen, W. and Fuge, M., 2019, “Synthesizing designs with interpart dependencies using hierarchical generative adversarial networks,” Journal of Mechanical Design, 141(11), p. 111403.
- Bayat, S., Lee, Y. H., and Allison, J. T., 2023, “Nested Control Co-design of a Spar Buoy Horizontal-axis Floating Offshore Wind Turbine,” arXiv preprint arXiv:2310.15463.
- Allison, J. T., Guo, T., and Han, Z., 2014, “Co-design of an active suspension using simultaneous dynamic optimization,” Journal of Mechanical Design, 136(8), p. 081003.
- Allison, J. and Herber, D. R., 2013, “Multidisciplinary design optimization of dynamic engineering systems,” 54th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, p. 1462.
- Gill, P. E., Murray, W., and Saunders, M. A., 2005, “SNOPT: An SQP algorithm for large-scale constrained optimization,” SIAM review, 47(1), pp. 99–131.
- Biegler, L. T. and Zavala, V. M., 2009, “Large-scale nonlinear programming using IPOPT: An integrating framework for enterprise-wide dynamic optimization,” Computers & Chemical Engineering, 33(3), pp. 575–582.
- Patterson, M. A. and Rao, A. V., 2014, “GPOPS-II: A MATLAB software for solving multiple-phase optimal control problems using hp-adaptive Gaussian quadrature collocation methods and sparse nonlinear programming,” ACM Transactions on Mathematical Software (TOMS), 41(1), pp. 1–37.
- Falck, R., Gray, J. S., Ponnapalli, K., and Wright, T., 2021, “dymos: A Python package for optimal control of multidisciplinary systems,” Journal of Open Source Software, 6(59), p. 2809.
- Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O., and Dahl, G. E., 2020, “Message passing neural networks,” Machine learning meets quantum physics, pp. 199–214.
- Hamilton, W., Ying, Z., and Leskovec, J., 2017, “Inductive representation learning on large graphs,” Advances in neural information processing systems, 30.
- Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., and Bengio, Y., 2018, “Graph Attention Networks,” 1710.10903
- Xu, K., Hu, W., Leskovec, J., and Jegelka, S., 2019, “How Powerful are Graph Neural Networks?” 1810.00826
- Bronstein, M. M., Bruna, J., Cohen, T., and Veličković, P., 2021, “Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges,” 2104.13478
- Botchkarev, A., 2018, “Performance metrics (error measures) in machine learning regression, forecasting and prognostics: Properties and typology,” arXiv preprint arXiv:1809.03006.
- Sen, P. K., 1968, “Estimates of the regression coefficient based on Kendall’s tau,” Journal of the American statistical association, 63(324), pp. 1379–1389.
- Van der Maaten, L. and Hinton, G., 2008, “Visualizing data using t-SNE.” Journal of machine learning research, 9(11).