Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Comprehensive Overview of Fish-Eye Camera Distortion Correction Methods (2401.00442v2)

Published 31 Dec 2023 in cs.CV

Abstract: The fisheye camera, with its unique wide field of view and other characteristics, has found extensive applications in various fields. However, the fisheye camera suffers from significant distortion compared to pinhole cameras, resulting in distorted images of captured objects. Fish-eye camera distortion is a common issue in digital image processing, requiring effective correction techniques to enhance image quality. This review provides a comprehensive overview of various methods used for fish-eye camera distortion correction. The article explores the polynomial distortion model, which utilizes polynomial functions to model and correct radial distortions. Additionally, alternative approaches such as panorama mapping, grid mapping, direct methods, and deep learning-based methods are discussed. The review highlights the advantages, limitations, and recent advancements of each method, enabling readers to make informed decisions based on their specific needs.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. Incremental learning for robust visual tracking. International Journal of Computer Vision, 77(1–3):125–141, 2008.
  2. Monocular vision for mobile robot localization and autonomous navigation. International Journal of Computer Vision, 74(3):237–260, 2007.
  3. Review of geometric distortion compensation in fish-eye cameras. In Proceedings of IET Irish Signals and Systems Conference, pages 162–167, 2008.
  4. Correcting perceived perspective distortions using object specific planar transformations. In 2016 IEEE International Conference on Computational Photography (ICCP), pages 1–10, May 2016.
  5. Floor segmentation of omnidirectional images for mobile robot visual navigation. In Proceedings of IEEE International Conference on Intelligent Robots and Systems, pages 804–809, 2010.
  6. Moving object detection, tracking and following using an omnidirectional camera on a mobile robot. In Proceedings of IEEE International Conference on Robotics and Automation, pages 5630–5635, 2014.
  7. Creating image-based vr using a self-calibrating fisheye lens. In Proceedings of IEEE computer society conference on computer vision and pattern recognition, pages 237–243. IEEE, 1997.
  8. Rudolf Kingslake. A history of the photographic lens. Elsevier, 1989.
  9. Kenro Miyamoto. Fish Eye Lens. Journal of the Optical Society of America, 54(8):1060, 1964.
  10. Nonparametric correction of distortion. In Proceedings of IEEE Workshop on Applications of Computer Vision, pages 214–219, 1996.
  11. C Brown Duane. Close-range camera calibration. Photogramm. Eng, 37(8):855–866, 1971.
  12. J. Kannala and S.S. Brandt. A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(8):1335–1340, 2006.
  13. A combined corner and edge detector. In Alvey vision conference, volume 15, pages 10–5244. Citeseer, 1988.
  14. Jianbo Shi et al. Good features to track. In 1994 Proceedings of IEEE conference on computer vision and pattern recognition, pages 593–600. IEEE, 1994.
  15. David G Lowe. Distinctive image features from scale-invariant keypoints. International journal of computer vision, 60:91–110, 2004.
  16. Surf: Speeded up robust features. In Computer Vision–ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7-13, 2006. Proceedings, Part I 9, pages 404–417. Springer, 2006.
  17. Use of the hough transformation to detect lines and curves in pictures. Communications of the ACM, 15(1):11–15, 1972.
  18. An iterative image registration technique with an application to stereo vision. In IJCAI’81: 7th international joint conference on Artificial intelligence, volume 2, pages 674–679, 1981.
  19. Radial lens distortion correction using convolutional neural networks trained with synthesized images. In Computer Vision–ACCV 2016: 13th Asian Conference on Computer Vision, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part III 13, pages 35–49. Springer, 2017.
  20. Wound intensity correction and segmentation with convolutional neural networks. Concurrency and computation: practice and experience, 29(6):e3927, 2017.
  21. Deepcorrect: Correcting dnn models against image distortions. IEEE Transactions on Image Processing, 28(12):6022–6034, 2019.
  22. Radial lens distortion correction by adding a weight layer with inverted foveal models to convolutional neural networks. In 2018 24th International Conference on Pattern Recognition (ICPR), pages 1–6. IEEE, 2018.
  23. Rotinvmtl: Rotation invariant multinet on fisheye images for autonomous driving applications. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, pages 0–0, 2019.
  24. Optimization of a cnn-based object detector for fisheye cameras. In 2019 IEEE International Conference on Vehicular Electronics and Safety (ICVES), pages 1–7. IEEE, 2019.
  25. Real-time semantic segmentation for fisheye urban driving images based on erfnet. Sensors, 19(3):503, 2019.
  26. Neural ray surfaces for self-supervised learning of depth and ego-motion. In 2020 International Conference on 3D Vision (3DV), pages 1–11. IEEE, 2020.
  27. Woodscape fisheye object detection for autonomous driving–cvpr 2022 omnicv workshop challenge. arXiv preprint arXiv:2206.12912, 2022.
  28. A stronger stitching algorithm for fisheye images based on deblurring and registration. IEEE Sensors Letters, 2023.
  29. Fish-eye distortion correction based on midpoint circle algorithm. In 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 2224–2228. IEEE, 2012.
  30. Geometric calibration of full spherical panoramic ricoh-theta camera. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences; IV-1/W1, 4:237–245, 2017.
  31. Mislgan: an anti-forensic camera model falsification framework using a generative adversarial network. In 2018 25th IEEE International Conference on Image Processing (ICIP), pages 535–539. IEEE, 2018.
  32. Deep learning-based imaging using single-lens and multi-aperture diffractive optical systems. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, pages 0–0, 2019.
  33. Dr-gan: Automatic radial distortion rectification using conditional gan in real-time. IEEE Transactions on Circuits and Systems for Video Technology, 30(3):725–733, 2019.
  34. Blind first-order perspective distortion correction using parallel convolutional neural networks. Sensors, 20(17):4898, 2020.
  35. Wggan: A wavelet-guided generative adversarial network for thermal image translation. In Generative Adversarial Networks for Image-to-Image Translation, pages 313–327. Elsevier, 2021.
  36. Learning to remove refractive distortions from underwater images. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 5007–5016, 2021.
  37. Unsupervised learning of depth estimation from imperfect rectified stereo laparoscopic images. Computers in biology and medicine, 140:105109, 2022.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now