HDVIO: Improving Localization and Disturbance Estimation with Hybrid Dynamics VIO (2306.11429v2)
Abstract: Visual-inertial odometry (VIO) is the most common approach for estimating the state of autonomous micro aerial vehicles using only onboard sensors. Existing methods improve VIO performance by including a dynamics model in the estimation pipeline. However, such methods degrade in the presence of low-fidelity vehicle models and continuous external disturbances, such as wind. Our proposed method, HDVIO, overcomes these limitations by using a hybrid dynamics model that combines a point-mass vehicle model with a learning-based component that captures complex aerodynamic effects. HDVIO estimates the external force and the full robot state by leveraging the discrepancy between the actual motion and the predicted motion of the hybrid dynamics model. Our hybrid dynamics model uses a history of thrust and IMU measurements to predict the vehicle dynamics. To demonstrate the performance of our method, we present results on both public and novel drone dynamics datasets and show real-world experiments of a quadrotor flying in strong winds up to 25 km/h. The results show that our approach improves the motion and external force estimation compared to the state-of-the-art by up to 33% and 40%, respectively. Furthermore, differently from existing methods, we show that it is possible to predict the vehicle dynamics accurately while having no explicit knowledge of its full state.
- VIMO: Simultaneous visual inertial model-based odometry and force estimation. Robotics: Science and Systems (RSS), 2019.
- Vid-fusion: Robust visual-inertial-dynamics odometry for accurate external force estimation. In IEEE Int. Conf. Robot. Autom. (ICRA), 2021.
- Visual-inertial-aided online mav system identification. In IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2022.
- NeuroBEM: Hybrid aerodynamic quadrotor model. Robotics: Science and Systems (RSS), 2021.
- Quadrotor gray-box model identification from high-speed flight data. Journal of Aircraft, 2019.
- Range, endurance, and optimal speed estimates for multicopters. IEEE Robot. Autom. Lett., 2022.
- Neural-fly enables rapid learning for agile flight in strong winds. Science Robotics, 2022.
- Vins-mono: A robust and versatile monocular visual-inertial state estimator. IEEE Trans. Robot., 2018.
- Rotors—a modular gazebo mav simulator framework. In Robot operating system (ROS). 2016.
- Propeller thrust and drag in forward flight. In 2017 IEEE Conf. on Control Tech. and Applications (CCTA), 2017.
- Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499, 2016. Accessed: 2023-19-05.
- SVO: Semidirect visual odometry for monocular and multicamera systems. IEEE Trans. Robot., 2017.
- Keyframe-based visual–inertial odometry using nonlinear optimization. Int. J. Robot. Research, 2015.
- On-manifold preintegration for real-time visual-inertial odometry. IEEE Trans. Robot., 2016.
- The blackbird uav dataset. Int. J. Robot. Research, 2020.
- The visual-inertial-dynamical multirotor dataset. In IEEE Int. Conf. Robot. Autom. (ICRA), 2022.
- A unified framework for external wrench estimation, interaction control and collision reflexes for flying robots. In IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2014.
- A nonlinear force observer for quadrotors and application to physical interactive tasks. In 2014 IEEE/ASME Int. Conf. on Advanced Intel. Mechatronics, 2014.
- Impedance control of vtol uavs with a momentum-based external generalized forces estimator. In IEEE Int. Conf. Robot. Autom. (ICRA), 2014.
- Unscented external force and torque estimation for quadrotors. In IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2016.
- Admittance control for physical human-quadrocopter interaction. In IEEE Eur. Control Conf. (ECC), 2013.
- Collaborative transportation using mavs via passive force control. In IEEE Int. Conf. Robot. Autom. (ICRA), 2017.
- Model-aided state estimation for quadrotor micro air vehicles amidst wind disturbances. In IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2014.
- A multi-state constraint kalman filter for vision-aided inertial navigation. In IEEE Int. Conf. Robot. Autom. (ICRA), 2007.
- Touch the wind: Simultaneous airflow, drag and interaction sensing on a multirotor. In IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2020.
- Contact forces preintegration for estimation in legged robotics using factor graphs. In IEEE Int. Conf. Robot. Autom. (ICRA), 2021.
- Flightmare: A flexible quadrotor simulator. 2020.
- Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and service robotics, 2018.
- Comprehensive simulation of quadrotor uavs using ros and gazebo. In International conference on simulation, modeling, and programming for autonomous robots, 2012.
- Quadrotor helicopter flight dynamics and control: Theory and experiment. In AIAA guidance, navigation and control conference and exhibit, 2007.
- Influence of forward and descent flight on quadrotor dynamics. Recent Advances in Aircraft Technology, 2012.
- An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271, 2018. Accessed 2023-03-02.
- A tutorial on quantitative trajectory evaluation for visual(-inertial) odometry. In IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), 2018.
- Continuous-time vs. discrete-time vision-based slam: A comparative study. IEEE Robot. Autom. Lett., 2022.
- Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight. Science Robotics, 2022.
- Modeling of an unmanned hybrid aerial vehicle. In 2014 IEEE Conf. on Control Applications (CCA), 2014.
- Nils Paul van Hinsberg. Aerodynamics of smooth and rough square-section prisms at incidence in very high reynolds-number cross-flows. Experiments in Fluids, 2021.
- Aerodynamic characteristics of seven symmetrical airfoil sections through 180-degree angle of attack for use in aerodynamic analysis of vertical axis wind turbines. In Sandia National Labs., Albuquerque, NM (USA), 1981.
- Structure-from-motion revisited. In IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), 2016.
- Visual attention prediction improves performance of autonomous drone racing agents. Plos one, 2022.