Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Design of an Adaptive Lightweight LiDAR to Decouple Robot-Camera Geometry (2302.14334v2)

Published 28 Feb 2023 in cs.RO

Abstract: A fundamental challenge in robot perception is the coupling of the sensor pose and robot pose. This has led to research in active vision where robot pose is changed to reorient the sensor to areas of interest for perception. Further, egomotion such as jitter, and external effects such as wind and others affect perception requiring additional effort in software such as image stabilization. This effect is particularly pronounced in micro-air vehicles and micro-robots who typically are lighter and subject to larger jitter but do not have the computational capability to perform stabilization in real-time. We present a novel microelectromechanical (MEMS) mirror LiDAR system to change the field of view of the LiDAR independent of the robot motion. Our design has the potential for use on small, low-power systems where the expensive components of the LiDAR can be placed external to the small robot. We show the utility of our approach in simulation and on prototype hardware mounted on a UAV. We believe that this LiDAR and its compact movable scanning design provide mechanisms to decouple robot and sensor geometry allowing us to simplify robot perception. We also demonstrate examples of motion compensation using IMU and external odometry feedback in hardware.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (61)
  1. “Optical flow-based 3d human motion estimation from monocular video” In German Conference on Pattern Recognition, 2017, pp. 347–360 Springer
  2. “IMU-aided image stabilization and tracking in a HSM-driven camera positioning unit” In 2013 IEEE International Symposium on Industrial Electronics, 2013, pp. 1–7 IEEE
  3. Moshe Ben-Ezra, Assaf Zomet and Shree K Nayar “Jitter camera: High resolution video from a low resolution detector” In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. 2, 2004, pp. II–II IEEE
  4. “Receding horizon” next-best-view” planner for 3d exploration” In 2016 IEEE international conference on robotics and automation (ICRA), 2016, pp. 1462–1468 IEEE
  5. “Real-time video stabilization based on motion compensation” In 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC), 2009, pp. 1495–1498 IEEE
  6. “Perception-aware Path Planning” In IEEE Transactions on Robotics Institute of ElectricalElectronics Engineers, 2016, pp. Epub–ahead
  7. John L Crassidis “Sigma-point Kalman filtering for integrated GPS and inertial navigation” In IEEE Transactions on Aerospace and Electronic Systems 42.2 IEEE, 2006, pp. 750–756
  8. Frank Dellaert “Factor graphs and GTSAM: A hands-on introduction”, 2012
  9. “Feature-constrained active visual SLAM for mobile robot navigation” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 7233–7238 IEEE
  10. Paul Furgale, Joern Rehder and Roland Siegwart “Unified temporal and spatial calibration for multi-sensor systems” In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2013, pp. 1280–1286 IEEE
  11. Andreas Geiger, Philip Lenz and Raquel Urtasun “Are we ready for autonomous driving? the kitti vision benchmark suite” In 2012 IEEE conference on computer vision and pattern recognition, 2012, pp. 3354–3361 IEEE
  12. Craig L Glennie, Arpan Kusari and Aldo Facchin “Calibration and stability analysis of the VLP-16 laser scanner.” In International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences 40, 2016
  13. “The perfect match: 3d point cloud matching with smoothed densities” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 5545–5554
  14. “3.1: MOEMS Laser Projector for Handheld Devices Featuring Motion Compensation” In SID Symposium Digest of Technical Papers 38.1, 2007, pp. 1–3 Wiley Online Library
  15. “Rotation averaging” In International journal of computer vision 103.3 Springer, 2013, pp. 267–305
  16. “Hawk Head Stabilization” In YouTube YouTube, 2020 URL: https://www.youtube.com/watch?v=aqgewVCC0k0
  17. “Gain-compensated sinusoidal scanning of a galvanometer mirror in proportional-integral-differential control using the pre-emphasis technique for motion-blur compensation” In Applied Optics 55.21 Optical Society of America, 2016, pp. 5640–5646
  18. E Farrell Helbling, Sawyer B Fuller and Robert J Wood “Pitch and yaw control of a robotic insect using an onboard magnetometer” In 2014 IEEE international conference on robotics and automation (ICRA), 2014, pp. 5516–5522 IEEE
  19. Katie Lynn Hoffman “Design and locomotion studies of a miniature centipede-inspired robot”, 2013
  20. Stefan Hrabar, Peter Corke and Volker Hilsenstein “PTZ camera pose estimation by tracking a 3D target” In 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 240–247 IEEE
  21. “System Design and Performance Characterization of a MEMS-Based Laser Scanning Time-of-Flight Sensor Based on a 256×\times×64-pixel Single-Photon Imager” In IEEE Photonics Journal 5.2 IEEE, 2013, pp. 6800114–6800114
  22. Kemiao Jia, Sagnik Pal and Huikai Xie “An electrothermal tip–tilt–piston micromirror based on folded dual S-shaped bimorphs” In Journal of Microelectromechanical systems 18.5 IEEE, 2009, pp. 1004–1015
  23. “System performance of an inertially stabilized gimbal platform with friction, resonance, and vibration effects” In Journal of Nonlinear Dynamics 2017 Hindawi, 2017
  24. “UAV-borne lidar with MEMS mirror-based scanning capability” In Laser Radar Technology and Applications XXI 9832, 2016, pp. 98320M International Society for OpticsPhotonics
  25. “Development of small size 3D LIDAR” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 4620–4626 IEEE
  26. “g 2 o: A general framework for graph optimization” In 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 3607–3613 IEEE
  27. “Tracking moving objects by using a pan-tilt-zoom camera” In ITC-CSCC: International Technical Conference on Circuits Systems, Computers and Communications, 2009, pp. 1012–1015
  28. “Modelling and experimental verification of step response overshoot removal in electrothermally-actuated mems mirrors” In Micromachines 8.10 Multidisciplinary Digital Publishing Institute, 2017, pp. 289
  29. “Nonorthogonal Aerial Optoelectronic Platform Based on Triaxial and Control Method Designed for Image Sensors” In Sensors 20.1 Multidisciplinary Digital Publishing Institute, 2020, pp. 10
  30. “IEEE standard specification format guide and test procedure for single-axis interferometric fiber optic gyros”, 1998
  31. “Detection and Compensation of Periodic Jitters of Oscillating MEMS Mirrors used in Automotive Driving Assistance Systems” In 2019 IEEE Sensors Applications Symposium (SAS), 2019, pp. 1–5 IEEE
  32. “Closed-loop control of gimbal-less MEMS mirrors for increased bandwidth in LiDAR applications” In Laser Radar Technology and Applications XXII 10191, 2017, pp. 101910N International Society for OpticsPhotonics
  33. Yash Mulgaonkar, Gareth Cross and Vijay Kumar “Design of small, safe and robust quadrotor swarms” In 2015 IEEE international conference on robotics and automation (ICRA), 2015, pp. 2208–2215 IEEE
  34. “Mc2slam: Real-time inertial lidar odometry using two-scan motion compensation” In German Conference on Pattern Recognition, 2018, pp. 60–72 Springer
  35. Tao Peng and Satyandra K Gupta “Model and algorithms for point cloud construction using digital projection patterns”, 2007
  36. Ethan Phelps and Charles A Primmerman “Blind Compensation of Angle Jitter for Satellite-Based Ground-Imaging Lidar” In IEEE Transactions on Geoscience and Remote Sensing 58.2 IEEE, 2019, pp. 1436–1449
  37. “Feature-rich path planning for robust navigation of MAVs with mono-SLAM” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 3870–3875 IEEE
  38. “Towards DJI phantom 4 realistic simulation with gimbal and RC controller in ROS/Gazebo environment” In 2017 10th International Conference on Developments in eSystems Engineering (DeSE), 2017, pp. 262–266 IEEE
  39. “Airsim: High-fidelity visual and physical simulation for autonomous vehicles” In Field and service robotics, 2018, pp. 621–635 Springer
  40. “Lio-sam: Tightly-coupled lidar inertial odometry via smoothing and mapping” In 2020 IEEE/RSJ international conference on intelligent robots and systems (IROS), 2020, pp. 5135–5142 IEEE
  41. “Background compensation for pan-tilt-zoom cameras using 1-D feature matching and outlier rejection” In IEEE transactions on circuits and systems for video technology 21.3 IEEE, 2010, pp. 371–377
  42. “Focal length change compensation for monocular slam” In 2015 IEEE International Conference on Image Processing (ICIP), 2015, pp. 4982–4986 IEEE
  43. “Zoom factor compensation for monocular SLAM” In 2015 IEEE Virtual Reality (VR), 2015, pp. 293–294 IEEE
  44. Takafumi Taketomi, Hideaki Uchiyama and Sei Ikeda “Visual SLAM algorithms: a survey from 2010 to 2016” In IPSJ Transactions on Computer Vision and Applications 9.1 Springer, 2017, pp. 16
  45. “Adaptive fovea for scanning depth sensors” In The International Journal of Robotics Research 39.7 SAGE Publications Sage UK: London, England, 2020, pp. 837–855
  46. Sebastian Thrun “Probabilistic robotics” In Communications of the ACM 45.3 ACM New York, NY, USA, 2002, pp. 52–57
  47. Nikolas Trawny and Stergios I Roumeliotis “Indirect Kalman filter for 3D attitude estimation” In University of Minnesota, Dept. of Comp. Sci. & Eng., Tech. Rep 2 Citeseer, 2005, pp. 2005
  48. Robert K Tyson “Performance assessment of MEMS adaptive optics in tactical airborne systems” In Adaptive Optics Systems and Technology 3762, 1999, pp. 91–100 International Society for OpticsPhotonics
  49. Dingkang Wang, Connor Watkins and Huikai Xie “MEMS Mirrors for LiDAR: A review” In Micromachines 11.5 Multidisciplinary Digital Publishing Institute, 2020, pp. 456
  50. “A Large Aperture 2-Axis Electrothermal MEMS Mirror for Compact 3D LiDAR” In 2019 International Conference on Optical MEMS and Nanophotonics (OMN), 2019, pp. 180–181 IEEE
  51. “A low-voltage, low-current, digital-driven MEMS mirror for low-power LiDAR” In IEEE Sensors Letters 4.8 IEEE, 2020, pp. 1–4
  52. “An ultra-fast electrothermal micromirror with bimorph actuators made of copper/tungsten” In 2017 International Conference on Optical MEMS and Nanophotonics (OMN), 2017, pp. 1–2 IEEE
  53. Robert Wood, Radhika Nagpal and Gu-Yeon Wei “flight of the robobees” In Scientific American 308.3 Scientific American, a division of Nature America, Inc., 2013, pp. 60–65 URL: http://www.jstor.org/stable/26018027
  54. “Fast-lio2: Fast direct lidar-inertial odometry” In IEEE Transactions on Robotics IEEE, 2022
  55. “Computational simulation and free flight validation of body vibration of flapping-wing MAV in forward flight” In Aerospace Science and Technology 95 Elsevier, 2019, pp. 105491
  56. “The grand challenges of Science Robotics” In Science robotics 3.14 AAAS, 2018, pp. eaar7650
  57. Heng Yang, Jingnan Shi and Luca Carlone “Teaser: Fast and certifiable point cloud registration” In IEEE Transactions on Robotics 37.2 IEEE, 2020, pp. 314–333
  58. Haoyang Ye, Yuying Chen and Ming Liu “Tightly coupled 3d lidar inertial odometry and mapping” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 3144–3150 IEEE
  59. “LOAM: Lidar Odometry and Mapping in Real-time.” In Robotics: Science and Systems 2.9, 2014
  60. Xiaoyang Zhang, Liang Zhou and Huikai Xie “A fast, large-stroke electrothermal MEMS mirror based on Cu/W bimorph” In Micromachines 6.12 Multidisciplinary Digital Publishing Institute, 2015, pp. 1876–1889
  61. “Perception-aware receding horizon navigation for MAVs” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 2534–2541 IEEE
Citations (2)

Summary

We haven't generated a summary for this paper yet.