Papers
Topics
Authors
Recent
Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 150 tok/s
Gemini 2.5 Pro 50 tok/s Pro
GPT-5 Medium 31 tok/s Pro
GPT-5 High 26 tok/s Pro
GPT-4o 105 tok/s Pro
Kimi K2 185 tok/s Pro
GPT OSS 120B 437 tok/s Pro
Claude Sonnet 4.5 36 tok/s Pro
2000 character limit reached

A Transition System Abstraction Framework for Neural Network Dynamical System Models (2402.11739v1)

Published 18 Feb 2024 in eess.SY, cs.LG, and cs.SY

Abstract: This paper proposes a transition system abstraction framework for neural network dynamical system models to enhance the model interpretability, with applications to complex dynamical systems such as human behavior learning and verification. To begin with, the localized working zone will be segmented into multiple localized partitions under the data-driven Maximum Entropy (ME) partitioning method. Then, the transition matrix will be obtained based on the set-valued reachability analysis of neural networks. Finally, applications to human handwriting dynamics learning and verification are given to validate our proposed abstraction framework, which demonstrates the advantages of enhancing the interpretability of the black-box model, i.e., our proposed framework is able to abstract a data-driven neural network model into a transition system, making the neural network model interpretable through verifying specifications described in Computational Tree Logic (CTL) languages.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. S. Wang, Y. Fan, S. Jin, P. Takyi-Aninakwa, and C. Fernandez, “Improved anti-noise adaptive long short-term memory neural network modeling for the robust remaining useful life prediction of lithium-ion batteries,” Reliability Engineering & System Safety, vol. 230, p. 108920, 2023.
  2. A. Liu, T. Chen, H. Zhu, M. Fu, and J. Xu, “Fuzzy variable impedance-based adaptive neural network control in physical human–robot interaction,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 237, no. 2, pp. 220–230, 2023.
  3. M. Ghazvini, H. Maddah, R. Peymanfar, M. H. Ahmadi, and R. Kumar, “Experimental evaluation and artificial neural network modeling of thermal conductivity of water based nanofluid containing magnetic copper nanoparticles,” Physica A: Statistical Mechanics and its Applications, vol. 551, p. 124127, 2020.
  4. H. Zhang, T.-W. Weng, P.-Y. Chen, C.-J. Hsieh, and L. Daniel, “Efficient neural network robustness certification with general activation functions,” Advances in Neural Information Processing Systems, vol. 31, 2018.
  5. S. Wang, H. Zhang, K. Xu, X. Lin, S. Jana, C.-J. Hsieh, and J. Z. Kolter, “Beta-crown: Efficient bound propagation with per-neuron split constraints for neural network robustness verification,” Advances in Neural Information Processing Systems, vol. 34, 2021.
  6. H.-D. Tran, X. Yang, D. Manzanas Lopez, P. Musau, L. V. Nguyen, W. Xiang, S. Bak, and T. T. Johnson, “NNV: the neural network verification tool for deep neural networks and learning-enabled cyber-physical systems,” in International Conference on Computer Aided Verification, pp. 3–17, Springer, 2020.
  7. M. Fazlyab, M. Morari, and G. J. Pappas, “Safety verification and robustness analysis of neural networks via quadratic constraints and semidefinite programming,” IEEE Transactions on Automatic Control, vol. 67, no. 1, pp. 1–15, 2020.
  8. Y. Yang, T. Wang, J. P. Woolard, and W. Xiang, “Guaranteed approximation error estimation of neural networks and model modification,” Neural Networks, vol. 151, pp. 61–69, 2022.
  9. M. Poli, S. Massaroli, L. Scimeca, S. Chun, S. J. Oh, A. Yamashita, H. Asama, J. Park, and A. Garg, “Neural hybrid automata: Learning dynamics with multiple modes and stochastic transitions,” Advances in Neural Information Processing Systems, vol. 34, pp. 9977–9989, 2021.
  10. C. Sprague, Efficient and Trustworthy Artificial Intelligence for Critical Robotic Systems. PhD thesis, Kungliga Tekniska högskolan, 2022.
  11. O. A. Beg, H. Abbas, T. T. Johnson, and A. Davoudi, “Model validation of PWM DC-DC converters,” IEEE Transactions on Industrial Electronics, vol. 64, no. 9, pp. 7049–7059, 2017.
  12. A. Chowdhery, S. Narang, J. Devlin, M. Bosma, G. Mishra, A. Roberts, P. Barham, H. W. Chung, C. Sutton, S. Gehrmann, et al., “Palm: Scaling language modeling with pathways,” arXiv preprint arXiv:2204.02311, 2022.
  13. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, “Adaptive mixtures of local experts,” Neural Computation, vol. 3, no. 1, pp. 79–87, 1991.
  14. S. Horváth, D. Kovalev, K. Mishchenko, P. Richtárik, and S. Stich, “Stochastic distributed learning with gradient quantization and double-variance reduction,” Optimization Methods and Software, vol. 38, no. 1, pp. 91–106, 2023.
  15. X. Li, H. Xiong, X. Li, X. Wu, X. Zhang, J. Liu, J. Bian, and D. Dou, “Interpretable deep learning: Interpretation, interpretability, trustworthiness, and beyond,” Knowledge and Information Systems, vol. 64, no. 12, pp. 3197–3234, 2022.
  16. J. Liu, N. Ozay, U. Topcu, and R. M. Murray, “Synthesis of reactive switching protocols from temporal logic specifications,” IEEE Transactions on Automatic Control, vol. 58, no. 7, pp. 1771–1785, 2013.
  17. Y. Yang, Z. Mo, and W. Xiang, “A data-driven hybrid automaton framework to modeling complex dynamical systems,” in 2023 IEEE International Conference on Industrial Technology (ICIT), pp. 1–6, IEEE, 2023.
  18. V. Rajagopalan and A. Ray, “Symbolic time series analysis via wavelet-based partitioning,” Signal processing, vol. 86, no. 11, pp. 3309–3320, 2006.
  19. W. Xiang, H.-D. Tran, and T. T. Johnson, “Output reachable set estimation and verification for multilayer neural networks,” IEEE transactions on neural networks and learning systems, vol. 29, no. 11, pp. 5777–5783, 2018.
  20. M. Lahijanian, S. B. Andersson, and C. Belta, “Formal verification and synthesis for discrete-time stochastic systems,” IEEE Transactions on Automatic Control, vol. 60, no. 8, pp. 2031–2045, 2015.
  21. R. F. Reinhart, Z. Shareef, and J. J. Steil, “Hybrid analytical and data-driven modeling for feed-forward robot control,” Sensors, vol. 17, no. 2, p. 311, 2017.
  22. R. F. Reinhart and J. J. Steil, “Neural learning and dynamical selection of redundant solutions for inverse kinematic control,” in 2011 11th IEEE-RAS International Conference on Humanoid Robots, pp. 564–569, IEEE, 2011.
  23. M. Khansari, E. Klingbeil, and O. Khatib, “Adaptive human-inspired compliant contact primitives to perform surface–surface contact under uncertainty,” The International Journal of Robotics Research, vol. 35, no. 13, pp. 1651–1675, 2016.
  24. H. Pan, Y. Li, Y. Cao, and Z. Ma, “Model checking computation tree logic over finite lattices,” Theoretical computer science, vol. 612, pp. 45–62, 2016.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up