Papers
Topics
Authors
Recent
Search
2000 character limit reached

Reinforcement Learning-Based Control of CrazyFlie 2.X Quadrotor

Published 6 Jun 2023 in cs.RO and cs.LG | (2306.03951v2)

Abstract: The objective of the project is to explore synergies between classical control algorithms such as PID and contemporary reinforcement learning algorithms to come up with a pragmatic control mechanism to control the CrazyFlie 2.X quadrotor. The primary objective would be performing PID tuning using reinforcement learning strategies. The secondary objective is to leverage the learnings from the first task to implement control for navigation by integrating with the lighthouse positioning system. Two approaches are considered for navigation, a discrete navigation problem using Deep Q-Learning with finite predefined motion primitives, and deep reinforcement learning for a continuous navigation approach. Simulations for RL training will be performed on gym-pybullet-drones, an open-source gym-based environment for reinforcement learning, and the RL implementations are provided by stable-baselines3

Definition Search Book Streamline Icon: https://streamlinehq.com
References (7)
  1. Scott Fujimoto, Herke Hoof and David Meger “Addressing Function Approximation Error in Actor-Critic Methods” In CoRR abs/1802.09477, 2018 arXiv: http://arxiv.org/abs/1802.09477
  2. “Characterising the Robustness of Reinforcement Learning for Continuous Control using Disturbance Injection” In Progress and Challenges in Building Trustworthy Embodied AI, 2022 URL: https://openreview.net/forum?id=IgXOXUVObLB
  3. Greiff, Marcus “Modelling and Control of the Crazyflie Quadrotor for Aggressive and Autonomous Flight by Optical Flow Driven State Estimation” Student Paper, 2017
  4. Greiff, Marcus “Nonlinear Control of Unmanned Aerial Vehicles : Systems With an Attitude” Department of Automatic Control, Lund University, 2021 URL: %7Bhttps://lup.lub.lu.se/search/files/109517053/MG_thesis_final.pdf%7D
  5. “Minimum snap trajectory generation and control for quadrotors” In 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 2520–2525 DOI: 10.1109/ICRA.2011.5980409
  6. “Learning to Fly—a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Control” In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
  7. “Stable-Baselines3: Reliable Reinforcement Learning Implementations” In Journal of Machine Learning Research 22.268, 2021, pp. 1–8 URL: http://jmlr.org/papers/v22/20-1364.html
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.