PID Tuning using Cross-Entropy Deep Learning: a Lyapunov Stability Analysis
Abstract: Underwater Unmanned Vehicles (UUVs) have to constantly compensate for the external disturbing forces acting on their body. Adaptive Control theory is commonly used there to grant the control law some flexibility in its response to process variation. Today, learning-based (LB) adaptive methods are leading the field where model-based control structures are combined with deep model-free learning algorithms. This work proposes experiments and metrics to empirically study the stability of such a controller. We perform this stability analysis on a LB adaptive control system whose adaptive parameters are determined using a Cross-Entropy Deep Learning method.
- Adaptive Control, 437–450. Springer Berlin Heidelberg, Berlin, Heidelberg.
- Berg, V. (2012). Development and Commissioning of a DP system for ROV SF 30k. Ph.D. thesis, NTNU.
- Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. Cambridge University Press.
- Direct adaptive pole-placement controller using deep reinforcement learning: Application to auv control. IFAC-PapersOnLine, 54(16), 333–340. 13th IFAC CAMS.
- Learning-Based vs Model-Free Adaptive Control of a MAV Under Wind Gust. Informatics in Control, Automation and Robotics, 362–385.
- Fossen, T.I. (2011). Handbook of Marine Craft Hydrodynamics and Motion Control. Wiley.
- Genetic algorithm based pid controller tuning approach for continuous stirred tank reactor. Adv. Artif. Intell.
- Deep learning for station keeping of auvs. In MTS/IEEE OCEANS.
- Liberzon, D. (2005). Review of liapunov functions and stability in control theory. Automatica, 41.
- UUV simulator: A gazebo-based package for underwater intervention and multi-robot simulation. In MTS/IEEE OCEANS. Monterey.
- McCue, L. (2016). Handbook of marine craft hydrodynamics and motion control [bookshelf]. IEEE Control Systems Magazine.
- O’Dwyer, A. (2006). Handbook of PI and PID controller tuning rules. Imperial College Press.
- Parks, P. (1981). Stability and convergence of adaptive controllers-continuous systems. In IEE Proceedings D-Control Theory and Applications. IET.
- Rubinstein, R.Y. (1997). Optimization of computer simulation models with rare events. European Journal of Operational Research, 99, 89–112.
- Reinforcement learning an introduction - Second edition. MIT Press.
- Reinforcement learning-based adaptive trajectory planning for auvs in under-ice environments. In MTS/IEEE OCEANS.
- Natural evolution strategies. IEEE Congress on Evolutionary Computation.
- Modeling of a complex-shaped underwater vehicle for robust control scheme. Journal of Intelligent and Robotic Systems.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.