Papers
Topics
Authors
Recent
Search
2000 character limit reached

A Novel Dynamic Light-Section 3D Reconstruction Method for Wide-Range Sensing

Published 3 Mar 2024 in cs.RO | (2403.01374v1)

Abstract: Existing galvanometer-based laser scanning systems are challenging to apply in multi-scale 3D reconstruction because of the difficulty in achieving a balance between high reconstruction accuracy and a wide reconstruction range. This paper presents a novel method that synchronizes laser scanning by switching the field-of-view (FOV) of a camera using multi-galvanometers. In addition to the advanced hardware setup, we establish a comprehensive mathematical model of the system by modeling dynamic camera, dynamic laser, and their combined interaction. We then propose a high-precision and flexible calibration method by constructing an error model and minimizing the objective function. Finally, we evaluate the performance of the proposed system by scanning standard components. The evaluation results demonstrate that the accuracy of the proposed 3D reconstruction system achieves 0.3 mm when the measurement range is extended to 1100 mm $\times$ 1300 mm $\times$ 650 mm. With the same reconstruction accuracy, the reconstruction range is expanded by a factor of 25, indicating that the proposed method simultaneously allows for high-precision and wide-range 3D reconstruction in industrial applications.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. J. Wu, K. Lian, Y. Deng, P. Jiang, and C. Zhang, “Multi-objective parameter optimization of fiber laser welding considering energy consumption and bead geometry,” IEEE Transactions on Automation Science and Engineering, vol. 19, no. 4, pp. 3561–3574, 2022.
  2. X. Du and Q. Chen, “Dual-laser goniometer: A flexible optical angular sensor for joint angle measurement,” IEEE Transactions on Industrial Electronics, vol. 68, no. 7, pp. 6328–6338, 2021.
  3. B. Deng, W. Wu, X. Li, H. Wang, Y. He, G. Shen, Y. Tang, K. Zhou, Z. Zhang, and Y. Wang, “Active 3-d thermography based on feature-free registration of thermogram sequence and 3-d shape via a single thermal camera,” IEEE Transactions on Industrial Electronics, vol. 69, no. 11, pp. 11 774–11 784, 2022.
  4. S. M. M. Gazafrudi, D. Younesian, and M. Torabi, “A high accuracy and high speed imaging and measurement system for rail corrugation inspection,” IEEE Transactions on Industrial Electronics, vol. 68, no. 9, pp. 8894–8903, 2021.
  5. Y.-j. Zhao, Y.-x. Xiong, and Y. Wang, “Three-dimensional accuracy of facial scan for facial deformities in clinics: a new evaluation method for facial scanner accuracy,” PLoS One, vol. 12, no. 1, p. e0169402, Jan. 2017.
  6. C. Wei, C. Sihai, L. Dong, and J. Guohua, “A compact two-dimensional laser scanner based on piezoelectric actuators,” Review of Scientific Instruments, vol. 86, no. 1, p. 013102, Jan. 2015.
  7. T. Czimmermann, M. Chiurazzi, M. Milazzo, S. Roccella, M. Barbieri, P. Dario, C. M. Oddo, and G. Ciuti, “An autonomous robotic platform for manipulation and inspection of metallic surfaces in industry 4.0,” IEEE Transactions on Automation Science and Engineering, vol. 19, no. 3, pp. 1691–1706, 2022.
  8. X. Xu, Z. Fei, J. Yang, Z. Tan, and M. Luo, “Line structured light calibration method and centerline extraction: A review,” Results in Physics, vol. 19, no. 3, p. 103637, Dec. 2020.
  9. S. Yin, Y. Ren, Y. Guo, J. Zhu, S. Yang, and S. Ye, “Development and calibration of an integrated 3d scanning system for high-accuracy large-scale metrology,” Measurement, vol. 54, no. 9, pp. 65–76, Aug. 2014.
  10. J. Xiao, X. Hu, W. Lu, J. Ma, and X. Guo, “A new three-dimensional laser scanner design and its performance analysis,” Optik, vol. 126, no. 7-8, pp. 701–707, Apr. 2015.
  11. X. Du and Q. Chen, “Dual-laser goniometer: A flexible optical angular sensor for joint angle measurement,” IEEE Transactions on Industrial Electronics, vol. 68, no. 7, pp. 6328–6338, Apr. 2021.
  12. T. Jiang, H. Cui, and X. Cheng, “Accurate calibration for large-scale tracking-based visual measurement system,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–11, Aug. 2021.
  13. T. Wang, S. Yang, S. Li, Y. Yuan, P. Hu, T. Liu, and S. Jia, “Error analysis and compensation of galvanometer laser scanning measurement system,” Acta Optica Sinica, vol. 40, no. 23, pp. 162–174, 2020.
  14. P. Eisert, K. Polthier, and J. Hornegger, “A mathematical model and calibration procedure for galvanometric laser scanning systems,” in Vision, Modeling, and Visualization, vol. 591, pp. 207–214, 12 2011.
  15. C. Yu, X. Chen, and J. Xi, “Modeling and calibration of a novel one-mirror galvanometric laser scanner,” Sensors, vol. 17, no. 1, p. 164, Jan. 2017.
  16. S. Yang, L. Yang, G. Zhang, T. Wang, and X. Yang, “Modeling and calibration of the galvanometric laser scanning three-dimensional measurement system,” Nanomanufacturing and Metrology, vol. 1, no. 3, pp. 180–192, Sep. 2018.
  17. X. Ying, K. Peng, Y. Hou, S. Guan, J. Kong, and H. Zha, “Self-calibration of catadioptric camera with two planar mirrors from silhouettes,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 5, pp. 1206–1220, May. 2013.
  18. Z. Wu and R. J. Radke, “Keeping a pan-tilt-zoom camera calibrated,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 8, pp. 1994–2007, Aug. 2013.
  19. A. Schmidt, L. Sun, G. Aragon-Camarasa, and J. P. Siebert, “The calibration of the pan-tilt units for the active stereo head,” in Image Processing and Communications Challenges 7, pp. 213–221.   Springer, 2016.
  20. C. P. Sanjeev Kumar, Christian Micheloni, “Stereo localization using dual ptz cameras,” in International Conference on Computer Analysis of Images and Patterns, vol. 5702, pp. 1061–1069, Oct. 2009.
  21. I. N. Junejo and H. Foroosh, “Optimizing ptz camera calibration from two images,” Machine Vision and Applications, vol. 23, no. 2, pp. 375–389, Feb. 2012.
  22. S. Kumar, C. Micheloni, C. Piciarelli, and G. L. Foresti, “Stereo rectification of uncalibrated and heterogeneous images,” Pattern Recognition Letters, vol. 31, no. 11, pp. 1445–1452, Aug. 2010.
  23. Z. Han and L. Zhang, “Modeling and calibration of a galvanometer-camera imaging system,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–9, 2022.
  24. I. De Boi, S. Sels, and R. Penne, “Semidata-driven calibration of galvanometric setups using gaussian processes,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–8, 2022.
  25. I. D. Boi, S. Sels, O. De Moor, S. Vanlanduit, and R. Penne, “Input and output manifold constrained gaussian process regression for galvanometric setup calibration,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–8, 2022.
  26. S. Hu, Y. Matsumoto, T. Takaki, and I. Ishii, “Monocular stereo measurement using high-speed catadioptric tracking,” Sensors, vol. 17, no. 8, p. 1839, Aug. 2017.
  27. Z. Zhang, “Flexible camera calibration by viewing a plane from unknown orientations,” vol. 1, pp. 666–673 vol.1, Sep. 1999.
  28. S. Yi and S. Min, “A practical calibration method for stripe laser imaging system,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–7, Sep. 2021.
  29. Z. Li, L. Ma, X. Long, Y. Chen, H. Deng, F. Yan, and Q. Gu, “Hardware-oriented algorithm for high-speed laser centerline extraction based on hessian matrix,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–14, 2021.
  30. X. Li, B. Liu, X. Mei, W. Wang, X. Wang, and X. Li, “Development of an in-situ laser machining system using a three-dimensional galvanometer scanner,” Engineering, vol. 6, no. 1, pp. 68–76, 2020.
  31. K. He, C. Sui, T. Huang, Y. Zhang, W. Zhou, X. Chen, and Y.-H. Liu, “3d surface reconstruction of transparent objects using laser scanning with a four-layers refinement process,” Optics Express, vol. 30, no. 6, pp. 8571–8591, 2022.
  32. X. Zexiao, W. Jianguo, and J. Ming, “Study on a full field of view laser scanning system,” International Journal of Machine Tools and Manufacture, vol. 47, no. 1, pp. 33–43, 2007.
  33. S. Chi, Z. Xie, and W. Chen, “A laser line auto-scanning system for underwater 3d reconstruction,” Sensors, vol. 16, no. 9, p. 1534, 2016.
Citations (3)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up