Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
134 tokens/sec
GPT-4o
10 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

3-Dimensional Sonic Phase-invariant Echo Localization (2306.08281v2)

Published 14 Jun 2023 in cs.RO, cs.CV, and cs.LG

Abstract: Parallax and Time-of-Flight (ToF) are often regarded as complementary in robotic vision where various light and weather conditions remain challenges for advanced camera-based 3-Dimensional (3-D) reconstruction. To this end, this paper establishes Parallax among Corresponding Echoes (PaCE) to triangulate acoustic ToF pulses from arbitrary sensor positions in 3-D space for the first time. This is achieved through a novel round-trip reflection model that pinpoints targets at the intersection of ellipsoids, which are spanned by sensor locations and detected arrival times. Inter-channel echo association becomes a crucial prerequisite for target detection and is learned from feature similarity obtained by a stack of Siamese Multi-Layer Perceptrons (MLPs). The PaCE algorithm enables phase-invariant 3-D object localization from only 1 isotropic emitter and at least 3 ToF receivers with relaxed sensor position constraints. Experiments are conducted with airborne ultrasound sensor hardware and back this hypothesis with quantitative results.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (26)
  1. H. Peremans, K. Audenaert, and J. Van Campenhout, “A high-resolution sensor based on tri-aural perception,” IEEE Transactions on Robotics and Automation, vol. 9, no. 1, pp. 36–48, 1993.
  2. O. Wijk and H. Christensen, “Triangulation-based fusion of sonar data with application in robot pose tracking,” IEEE Transactions on Robotics and Automation, vol. 16, no. 6, pp. 740–752, 2000.
  3. D. Bank and T. Kampke, “High-resolution ultrasonic environment imaging,” IEEE Transactions on Robotics, vol. 23, no. 2, pp. 370–381, 2007.
  4. K. Araki, R. Suzuki, S. Inoue, and Y. Nishimoto, “Obstacle detection device and obstacle detection method,” Mitsubishi Electric Corp., Patent No. JP2016128769A, Jul 2016.
  5. A. Rudoy, “3d-position determination method and device,” Toposens GmbH, Patent No. US10698094B2, Aug 2016.
  6. A. Walz and F. Thunert, “Method for detecting an object in an environmental region of a motor vehicle by means of an ultrasound sensor device by determining a 3-D position of an object point, ultrasound sensor device and driver assistance system,” Valeo Schalter und Sensoren GmbH, Patent No. DE102018102350A1, Aug 2019.
  7. J. Reijniers and H. Peremans, “Biomimetic sonar system performing spectrum-based localization,” IEEE Transactions on Robotics, vol. 23, no. 6, pp. 1151–1159, 2007.
  8. F. Schillebeeckx, F. D. Mey, D. Vanderelst, and H. Peremans, “Biomimetic sonar: Binaural 3d localization using artificial bat pinnae,” The International Journal of Robotics Research, vol. 30, no. 8, pp. 975–987, 2011.
  9. I. Eliakim, Z. Cohen, G. Kosa, and Y. Yovel, “A fully autonomous terrestrial bat-like acoustic robot,” PLOS Computational Biology, vol. 14, no. 9, pp. 1–13, 09 2018. [Online]. Available: https://doi.org/10.1371/journal.pcbi.1006406
  10. J. H. Christensen, S. Hornauer, and S. X. Yu, “Batvision: Learning to see 3d spatial layout with two ears,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 1581–1587.
  11. E. Tracy and N. Kottege, “CatChatter: Acoustic perception for mobile robots,” IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 7209–7216, 2021.
  12. K. K. Parida, S. Srivastava, and G. Sharma, “Beyond image to depth: Improving depth prediction using echoes,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 8268–8277.
  13. G. Irie, T. Shibata, and A. Kimura, “Co-attention-guided bilinear model for echo-based depth estimation,” in ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022, pp. 4648–4652.
  14. C. Hahne and R. Sznitman, “Parallax among corresponding echoes,” Patent No. EP22197595.6, Sep 2022.
  15. F. Ahmad and M. G. Amin, “Noncoherent approach to through-the-wall radar localization,” IEEE Transactions on Aerospace and Electronic Systems, vol. 42, no. 4, pp. 1405–1419, 2006.
  16. M. Mirbach, “A simple surface estimation algorithm for uwb pulse radars based on trilateration,” in 2011 IEEE International Conference on Ultra-Wideband (ICUWB), 2011, pp. 273–277.
  17. M. Malanowski and K. Kulpa, “Two methods for target localization in multistatic passive radar,” IEEE Transactions on Aerospace and Electronic Systems, vol. 48, no. 1, pp. 572–580, 2012.
  18. R. Kuc and V. Kuc, “Modeling human echolocation of near-range targets with an audible sonar,” The Journal of the Acoustical Society of America, vol. 139, no. 2, pp. 581–587, 2016.
  19. C.-W. Juan and J.-S. Hu, “Object localization and tracking system using multiple ultrasonic sensors with newton-raphson optimization and kalman filtering techniques,” Applied Sciences, vol. 11, no. 23, 2021. [Online]. Available: https://www.mdpi.com/2076-3417/11/23/11243
  20. F. von Haxthausen, S. Böttger, D. Wulff, J. Hagenah, V. García-Vázquez, and S. Ipsen, “Medical robotics for ultrasound imaging: Current systems and future trends,” Current Robotics Reports, vol. 2, no. 1, pp. 2662–4087, 2021.
  21. C. Hahne, A. Aggoun, V. Velisavljevic, S. Fiebig, and M. Pesch, “Baseline and triangulation geometry in a standard plenoptic camera,” International Journal of Computer Vision, pp. 1–15, 8 2017.
  22. C. Hahne, “Multimodal exponentially modified gaussian oscillators,” in 2022 IEEE International Ultrasonics Symposium (IUS), 2022, pp. 1–4.
  23. T. Padois, O. Doutres, and F. Sgard, “On the use of modified phase transform weighting functions for acoustic imaging with the generalized cross correlation,” The Journal of the Acoustical Society of America, vol. 145, no. 3, pp. 1546–1555, 2019.
  24. R. Lee, M.-S. Kang, B.-H. Kim, K.-H. Park, S. Q. Lee, and H.-M. Park, “Sound source localization based on gcc-phat with diffuseness mask in noisy and reverberant environments,” IEEE Access, vol. 8, pp. 7373–7382, 2020.
  25. R. Hadsell, S. Chopra, and Y. LeCun, “Dimensionality reduction by learning an invariant mapping,” in 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), vol. 2, 2006, pp. 1735–1742.
  26. Toposens GmbH, “ECHO ONE: 3d ultrasonic echolocation and ranging sensor,” Data Sheet V1.0, July 2022.
Citations (3)

Summary

We haven't generated a summary for this paper yet.