Design of an Adaptive Lightweight LiDAR to Decouple Robot-Camera Geometry (2302.14334v2)
Abstract: A fundamental challenge in robot perception is the coupling of the sensor pose and robot pose. This has led to research in active vision where robot pose is changed to reorient the sensor to areas of interest for perception. Further, egomotion such as jitter, and external effects such as wind and others affect perception requiring additional effort in software such as image stabilization. This effect is particularly pronounced in micro-air vehicles and micro-robots who typically are lighter and subject to larger jitter but do not have the computational capability to perform stabilization in real-time. We present a novel microelectromechanical (MEMS) mirror LiDAR system to change the field of view of the LiDAR independent of the robot motion. Our design has the potential for use on small, low-power systems where the expensive components of the LiDAR can be placed external to the small robot. We show the utility of our approach in simulation and on prototype hardware mounted on a UAV. We believe that this LiDAR and its compact movable scanning design provide mechanisms to decouple robot and sensor geometry allowing us to simplify robot perception. We also demonstrate examples of motion compensation using IMU and external odometry feedback in hardware.
- “Optical flow-based 3d human motion estimation from monocular video” In German Conference on Pattern Recognition, 2017, pp. 347–360 Springer
- “IMU-aided image stabilization and tracking in a HSM-driven camera positioning unit” In 2013 IEEE International Symposium on Industrial Electronics, 2013, pp. 1–7 IEEE
- Moshe Ben-Ezra, Assaf Zomet and Shree K Nayar “Jitter camera: High resolution video from a low resolution detector” In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. 2, 2004, pp. II–II IEEE
- “Receding horizon” next-best-view” planner for 3d exploration” In 2016 IEEE international conference on robotics and automation (ICRA), 2016, pp. 1462–1468 IEEE
- “Real-time video stabilization based on motion compensation” In 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC), 2009, pp. 1495–1498 IEEE
- “Perception-aware Path Planning” In IEEE Transactions on Robotics Institute of ElectricalElectronics Engineers, 2016, pp. Epub–ahead
- John L Crassidis “Sigma-point Kalman filtering for integrated GPS and inertial navigation” In IEEE Transactions on Aerospace and Electronic Systems 42.2 IEEE, 2006, pp. 750–756
- Frank Dellaert “Factor graphs and GTSAM: A hands-on introduction”, 2012
- “Feature-constrained active visual SLAM for mobile robot navigation” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 7233–7238 IEEE
- Paul Furgale, Joern Rehder and Roland Siegwart “Unified temporal and spatial calibration for multi-sensor systems” In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2013, pp. 1280–1286 IEEE
- Andreas Geiger, Philip Lenz and Raquel Urtasun “Are we ready for autonomous driving? the kitti vision benchmark suite” In 2012 IEEE conference on computer vision and pattern recognition, 2012, pp. 3354–3361 IEEE
- Craig L Glennie, Arpan Kusari and Aldo Facchin “Calibration and stability analysis of the VLP-16 laser scanner.” In International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences 40, 2016
- “The perfect match: 3d point cloud matching with smoothed densities” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 5545–5554
- “3.1: MOEMS Laser Projector for Handheld Devices Featuring Motion Compensation” In SID Symposium Digest of Technical Papers 38.1, 2007, pp. 1–3 Wiley Online Library
- “Rotation averaging” In International journal of computer vision 103.3 Springer, 2013, pp. 267–305
- “Hawk Head Stabilization” In YouTube YouTube, 2020 URL: https://www.youtube.com/watch?v=aqgewVCC0k0
- “Gain-compensated sinusoidal scanning of a galvanometer mirror in proportional-integral-differential control using the pre-emphasis technique for motion-blur compensation” In Applied Optics 55.21 Optical Society of America, 2016, pp. 5640–5646
- E Farrell Helbling, Sawyer B Fuller and Robert J Wood “Pitch and yaw control of a robotic insect using an onboard magnetometer” In 2014 IEEE international conference on robotics and automation (ICRA), 2014, pp. 5516–5522 IEEE
- Katie Lynn Hoffman “Design and locomotion studies of a miniature centipede-inspired robot”, 2013
- Stefan Hrabar, Peter Corke and Volker Hilsenstein “PTZ camera pose estimation by tracking a 3D target” In 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 240–247 IEEE
- “System Design and Performance Characterization of a MEMS-Based Laser Scanning Time-of-Flight Sensor Based on a 256×\times×64-pixel Single-Photon Imager” In IEEE Photonics Journal 5.2 IEEE, 2013, pp. 6800114–6800114
- Kemiao Jia, Sagnik Pal and Huikai Xie “An electrothermal tip–tilt–piston micromirror based on folded dual S-shaped bimorphs” In Journal of Microelectromechanical systems 18.5 IEEE, 2009, pp. 1004–1015
- “System performance of an inertially stabilized gimbal platform with friction, resonance, and vibration effects” In Journal of Nonlinear Dynamics 2017 Hindawi, 2017
- “UAV-borne lidar with MEMS mirror-based scanning capability” In Laser Radar Technology and Applications XXI 9832, 2016, pp. 98320M International Society for OpticsPhotonics
- “Development of small size 3D LIDAR” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 4620–4626 IEEE
- “g 2 o: A general framework for graph optimization” In 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 3607–3613 IEEE
- “Tracking moving objects by using a pan-tilt-zoom camera” In ITC-CSCC: International Technical Conference on Circuits Systems, Computers and Communications, 2009, pp. 1012–1015
- “Modelling and experimental verification of step response overshoot removal in electrothermally-actuated mems mirrors” In Micromachines 8.10 Multidisciplinary Digital Publishing Institute, 2017, pp. 289
- “Nonorthogonal Aerial Optoelectronic Platform Based on Triaxial and Control Method Designed for Image Sensors” In Sensors 20.1 Multidisciplinary Digital Publishing Institute, 2020, pp. 10
- “IEEE standard specification format guide and test procedure for single-axis interferometric fiber optic gyros”, 1998
- “Detection and Compensation of Periodic Jitters of Oscillating MEMS Mirrors used in Automotive Driving Assistance Systems” In 2019 IEEE Sensors Applications Symposium (SAS), 2019, pp. 1–5 IEEE
- “Closed-loop control of gimbal-less MEMS mirrors for increased bandwidth in LiDAR applications” In Laser Radar Technology and Applications XXII 10191, 2017, pp. 101910N International Society for OpticsPhotonics
- Yash Mulgaonkar, Gareth Cross and Vijay Kumar “Design of small, safe and robust quadrotor swarms” In 2015 IEEE international conference on robotics and automation (ICRA), 2015, pp. 2208–2215 IEEE
- “Mc2slam: Real-time inertial lidar odometry using two-scan motion compensation” In German Conference on Pattern Recognition, 2018, pp. 60–72 Springer
- Tao Peng and Satyandra K Gupta “Model and algorithms for point cloud construction using digital projection patterns”, 2007
- Ethan Phelps and Charles A Primmerman “Blind Compensation of Angle Jitter for Satellite-Based Ground-Imaging Lidar” In IEEE Transactions on Geoscience and Remote Sensing 58.2 IEEE, 2019, pp. 1436–1449
- “Feature-rich path planning for robust navigation of MAVs with mono-SLAM” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 3870–3875 IEEE
- “Towards DJI phantom 4 realistic simulation with gimbal and RC controller in ROS/Gazebo environment” In 2017 10th International Conference on Developments in eSystems Engineering (DeSE), 2017, pp. 262–266 IEEE
- “Airsim: High-fidelity visual and physical simulation for autonomous vehicles” In Field and service robotics, 2018, pp. 621–635 Springer
- “Lio-sam: Tightly-coupled lidar inertial odometry via smoothing and mapping” In 2020 IEEE/RSJ international conference on intelligent robots and systems (IROS), 2020, pp. 5135–5142 IEEE
- “Background compensation for pan-tilt-zoom cameras using 1-D feature matching and outlier rejection” In IEEE transactions on circuits and systems for video technology 21.3 IEEE, 2010, pp. 371–377
- “Focal length change compensation for monocular slam” In 2015 IEEE International Conference on Image Processing (ICIP), 2015, pp. 4982–4986 IEEE
- “Zoom factor compensation for monocular SLAM” In 2015 IEEE Virtual Reality (VR), 2015, pp. 293–294 IEEE
- Takafumi Taketomi, Hideaki Uchiyama and Sei Ikeda “Visual SLAM algorithms: a survey from 2010 to 2016” In IPSJ Transactions on Computer Vision and Applications 9.1 Springer, 2017, pp. 16
- “Adaptive fovea for scanning depth sensors” In The International Journal of Robotics Research 39.7 SAGE Publications Sage UK: London, England, 2020, pp. 837–855
- Sebastian Thrun “Probabilistic robotics” In Communications of the ACM 45.3 ACM New York, NY, USA, 2002, pp. 52–57
- Nikolas Trawny and Stergios I Roumeliotis “Indirect Kalman filter for 3D attitude estimation” In University of Minnesota, Dept. of Comp. Sci. & Eng., Tech. Rep 2 Citeseer, 2005, pp. 2005
- Robert K Tyson “Performance assessment of MEMS adaptive optics in tactical airborne systems” In Adaptive Optics Systems and Technology 3762, 1999, pp. 91–100 International Society for OpticsPhotonics
- Dingkang Wang, Connor Watkins and Huikai Xie “MEMS Mirrors for LiDAR: A review” In Micromachines 11.5 Multidisciplinary Digital Publishing Institute, 2020, pp. 456
- “A Large Aperture 2-Axis Electrothermal MEMS Mirror for Compact 3D LiDAR” In 2019 International Conference on Optical MEMS and Nanophotonics (OMN), 2019, pp. 180–181 IEEE
- “A low-voltage, low-current, digital-driven MEMS mirror for low-power LiDAR” In IEEE Sensors Letters 4.8 IEEE, 2020, pp. 1–4
- “An ultra-fast electrothermal micromirror with bimorph actuators made of copper/tungsten” In 2017 International Conference on Optical MEMS and Nanophotonics (OMN), 2017, pp. 1–2 IEEE
- Robert Wood, Radhika Nagpal and Gu-Yeon Wei “flight of the robobees” In Scientific American 308.3 Scientific American, a division of Nature America, Inc., 2013, pp. 60–65 URL: http://www.jstor.org/stable/26018027
- “Fast-lio2: Fast direct lidar-inertial odometry” In IEEE Transactions on Robotics IEEE, 2022
- “Computational simulation and free flight validation of body vibration of flapping-wing MAV in forward flight” In Aerospace Science and Technology 95 Elsevier, 2019, pp. 105491
- “The grand challenges of Science Robotics” In Science robotics 3.14 AAAS, 2018, pp. eaar7650
- Heng Yang, Jingnan Shi and Luca Carlone “Teaser: Fast and certifiable point cloud registration” In IEEE Transactions on Robotics 37.2 IEEE, 2020, pp. 314–333
- Haoyang Ye, Yuying Chen and Ming Liu “Tightly coupled 3d lidar inertial odometry and mapping” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 3144–3150 IEEE
- “LOAM: Lidar Odometry and Mapping in Real-time.” In Robotics: Science and Systems 2.9, 2014
- Xiaoyang Zhang, Liang Zhou and Huikai Xie “A fast, large-stroke electrothermal MEMS mirror based on Cu/W bimorph” In Micromachines 6.12 Multidisciplinary Digital Publishing Institute, 2015, pp. 1876–1889
- “Perception-aware receding horizon navigation for MAVs” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 2534–2541 IEEE