Reinforcement Learning-Based Control of CrazyFlie 2.X Quadrotor
Abstract: The objective of the project is to explore synergies between classical control algorithms such as PID and contemporary reinforcement learning algorithms to come up with a pragmatic control mechanism to control the CrazyFlie 2.X quadrotor. The primary objective would be performing PID tuning using reinforcement learning strategies. The secondary objective is to leverage the learnings from the first task to implement control for navigation by integrating with the lighthouse positioning system. Two approaches are considered for navigation, a discrete navigation problem using Deep Q-Learning with finite predefined motion primitives, and deep reinforcement learning for a continuous navigation approach. Simulations for RL training will be performed on gym-pybullet-drones, an open-source gym-based environment for reinforcement learning, and the RL implementations are provided by stable-baselines3
- Scott Fujimoto, Herke Hoof and David Meger “Addressing Function Approximation Error in Actor-Critic Methods” In CoRR abs/1802.09477, 2018 arXiv: http://arxiv.org/abs/1802.09477
- “Characterising the Robustness of Reinforcement Learning for Continuous Control using Disturbance Injection” In Progress and Challenges in Building Trustworthy Embodied AI, 2022 URL: https://openreview.net/forum?id=IgXOXUVObLB
- Greiff, Marcus “Modelling and Control of the Crazyflie Quadrotor for Aggressive and Autonomous Flight by Optical Flow Driven State Estimation” Student Paper, 2017
- Greiff, Marcus “Nonlinear Control of Unmanned Aerial Vehicles : Systems With an Attitude” Department of Automatic Control, Lund University, 2021 URL: %7Bhttps://lup.lub.lu.se/search/files/109517053/MG_thesis_final.pdf%7D
- “Minimum snap trajectory generation and control for quadrotors” In 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 2520–2525 DOI: 10.1109/ICRA.2011.5980409
- “Learning to Fly—a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Control” In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
- “Stable-Baselines3: Reliable Reinforcement Learning Implementations” In Journal of Machine Learning Research 22.268, 2021, pp. 1–8 URL: http://jmlr.org/papers/v22/20-1364.html
Paper Prompts
Sign up for free to create and run prompts on this paper.