Papers
Topics
Authors
Recent
Search
2000 character limit reached

Improved Generalizability of CNN Based Lane Detection in Challenging Weather Using Adaptive Preprocessing Parameter Tuning

Published 9 Feb 2024 in eess.IV | (2402.06825v2)

Abstract: Ensuring the robustness of lane detection systems is essential for the reliability of autonomous vehicles, particularly in the face of diverse weather conditions. While numerous algorithms have been proposed, addressing challenges posed by varying weather remains an ongoing issue. Geometric-based lane detection methods, rooted in the inherent properties of road geometry, provide enhanced generalizability. However, these methods often require manual parameter tuning to accommodate it fluctuating illumination and weather conditions. Conversely, learning-based approaches, trained on pre-labeled datasets, excel in localizing intricate and curved lane configurations but grapple with the absence of diverse weather datasets. This paper introduces a promising hybrid approach that merges the strengths of both methodologies. A novel adaptive preprocessing method is proposed in this work. Utilizing a fuzzy inference system (FIS), the algorithm dynamically adjusts parameters in geometric-based image processing functions and enhances adaptability to diverse weather conditions. Notably, this preprocessing algorithm is designed to seamlessly integrate with all learning-based lane detection models. When implemented in conjunction with CNN-based models, the hybrid approach demonstrates commendable generalizability across weather conditions and adaptability to complex lane configurations. Rigorous testing on datasets featuring challenging weather conditions showcases the proposed method's significant improvements over existing models, underscoring its efficacy in addressing the persistent challenges associated with lane detection in adverse weather scenarios.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (32)
  1. B.-C. Chen, B.-C. Luan, and K. Lee, “Design of lane keeping system using adaptive model predictive control,” in 2014 IEEE International Conference on Automation Science and Engineering (CASE), pp. 922–926, 2014.
  2. C. Lee and J.-H. Moon, “Robust lane detection and tracking for real-time applications,” IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 12, pp. 4043–4048, 2018.
  3. S. Sultana, B. Ahmed, M. Paul, M. R. Islam, and S. Ahmad, “Vision-based robust lane detection and tracking in challenging conditions,” IEEE Access, vol. 11, pp. 67938–67955, 2023.
  4. S. Luo, X. Zhang, J. Hu, and J. Xu, “Multiple lane detection via combining complementary structural constraints,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 12, pp. 7597–7606, 2021.
  5. Q. Lin, Y. Han, and H. Hahn, “Real-time lane departure detection based on extended edge-linking algorithm,” in 2010 Second International Conference on Computer Research and Development, pp. 725–730, IEEE, 2010.
  6. Q. Li, L. Chen, M. Li, S.-L. Shaw, and A. Nüchter, “A sensor-fusion drivable-region and lane-detection system for autonomous vehicle navigation in challenging road scenarios,” IEEE Transactions on Vehicular Technology, vol. 63, no. 2, pp. 540–555, 2013.
  7. Z. Chen, J. Zhang, and D. Tao, “Progressive lidar adaptation for road detection,” IEEE/CAA Journal of Automatica Sinica, vol. 6, no. 3, pp. 693–702, 2019.
  8. M. Aldibaja, N. Suganuma, and K. Yoneda, “Improving localization accuracy for autonomous driving in snow-rain environments,” in 2016 IEEE/SICE International Symposium on System Integration (SII), pp. 212–217, IEEE, 2016.
  9. C. Rose, J. Britt, J. Allen, and D. Bevly, “An integrated vehicle navigation system utilizing lane-detection and lateral position estimation systems in difficult environments for gps,” IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 6, pp. 2615–2629, 2014.
  10. S. Sultana and B. Ahmed, “Lane detection and tracking under rainy weather challenges,” in 2021 IEEE Region 10 Symposium (TENSYMP), pp. 1–6, IEEE, 2021.
  11. T. Zheng, Y. Huang, Y. Liu, W. Tang, Z. Yang, D. Cai, and X. He, “Clrnet: Cross layer refinement network for lane detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 898–907, 2022.
  12. T. Zheng, H. Fang, Y. Zhang, W. Tang, Z. Yang, H. Liu, and D. Cai, “Resa: Recurrent feature-shift aggregator for lane detection,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 3547–3554, 2021.
  13. Y. Hou, Z. Ma, C. Liu, and C. C. Loy, “Learning lightweight lane detection cnns by self attention distillation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019.
  14. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778, 2016.
  15. A. Paszke, A. Chaurasia, S. Kim, and E. Culurciello, “Enet: A deep neural network architecture for real-time semantic segmentation,” arXiv preprint arXiv:1606.02147, 2016.
  16. “Tusimple benchmark.” https://github.com/TuSimple/tusimple-benchmark/issues/3. Accessed: 2023-06-06.
  17. M. Aly, “Real time detection of lane markers in urban streets,” in 2008 IEEE Intelligent Vehicles Symposium, pp. 7–12, 2008.
  18. A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the kitti vision benchmark suite,” in 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3354–3361, 2012.
  19. X. Pan, J. Shi, P. Luo, X. Wang, and X. Tang, “Spatial as deep: Spatial cnn for traffic scene understanding,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, 2018.
  20. “DSDLDE v.0.9: Video clips for lane marking detection.”
  21. M. M. Yusuf, T. Karim, and A. S. Saif, “A robust method for lane detection under adverse weather and illumination conditions using convolutional neural network,” in Proceedings of the International Conference on Computing Advancements, pp. 1–8, 2020.
  22. Y. Dong, S. Patil, B. van Arem, and H. Farah, “A hybrid spatial–temporal deep learning architecture for lane detection,” Computer-Aided Civil and Infrastructure Engineering, vol. 38, no. 1, pp. 67–86, 2023.
  23. Y. Lee, J. Lee, Y. Hong, Y. Ko, and M. Jeon, “Unconstrained road marking recognition with generative adversarial networks,” in 2019 IEEE Intelligent Vehicles Symposium (IV), pp. 1414–1419, 2019.
  24. T. Liu, Z. Chen, Y. Yang, Z. Wu, and H. Li, “Lane detection in low-light conditions using an efficient data enhancement: Light conditions style transfer,” in 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 1394–1399, 2020.
  25. X. Nie, Z. Xu, W. Zhang, X. Dong, N. Liu, and Y. Chen, “Foggy lane dataset synthesized from monocular images for lane detection algorithms,” Sensors, vol. 22, no. 14, p. 5210, 2022.
  26. R. Paul, S. H. Hawkins, L. O. Hall, D. B. Goldgof, and R. J. Gillies, “Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic ct,” in 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 002570–002575, 2016.
  27. J. Peeples, W. Xu, and A. Zare, “Histogram layers for texture analysis,” IEEE Transactions on Artificial Intelligence, vol. 3, no. 4, pp. 541–552, 2021.
  28. J. Li, D. Zhang, Y. Ma, and Q. Liu, “Lane image detection based on convolution neural network multi-task learning,” Electronics, vol. 10, no. 19, p. 2356, 2021.
  29. A. Küçükmanisa, O. Akbulut, and O. Urhan, “Robust and real-time lane detection filter based on adaptive neuro-fuzzy inference system,” IET Image Processing, vol. 13, no. 7, pp. 1181–1190, 2019.
  30. C. Tomasi and R. Manduchi, “Bilateral filtering for gray and color images,” in Sixth international conference on computer vision (IEEE Cat. No. 98CH36271), pp. 839–846, IEEE, 1998.
  31. J. Canny, “A computational approach to edge detection,” IEEE Transactions on pattern analysis and machine intelligence, no. 6, pp. 679–698, 1986.
  32. P. V. Hough, “Method and means for recognizing complex patterns,” Dec. 18 1962. US Patent 3,069,654.
Citations (1)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.