Decoupling the Curve Modeling and Pavement Regression for Lane Detection (2309.10533v1)
Abstract: The curve-based lane representation is a popular approach in many lane detection methods, as it allows for the representation of lanes as a whole object and maximizes the use of holistic information about the lanes. However, the curves produced by these methods may not fit well with irregular lines, which can lead to gaps in performance compared to indirect representations such as segmentation-based or point-based methods. We have observed that these lanes are not intended to be irregular, but they appear zigzagged in the perspective view due to being drawn on uneven pavement. In this paper, we propose a new approach to the lane detection task by decomposing it into two parts: curve modeling and ground height regression. Specifically, we use a parameterized curve to represent lanes in the BEV space to reflect the original distribution of lanes. For the second part, since ground heights are determined by natural factors such as road conditions and are less holistic, we regress the ground heights of key points separately from the curve modeling. Additionally, we have unified the 2D and 3D lane detection tasks by designing a new framework and a series of losses to guide the optimization of models with or without 3D lane labels. Our experiments on 2D lane detection benchmarks (TuSimple and CULane), as well as the recently proposed 3D lane detection datasets (ONCE-3Dlane and OpenLane), have shown significant improvements. We will make our well-documented source code publicly available.
- Laneaf: Robust multi-lane detection with affinity fields. IEEE Robotics and Automation Letters, 6(4): 7477–7484.
- CurveFormer: 3D Lane Detection by Curve Propagation with Curve Queries and Attention. arXiv preprint arXiv:2209.07989.
- Recent progress in road and lane detection: a survey. Machine vision and applications, 25(3): 727–745.
- Persformer: 3d lane detection via perspective transformer and the openlane benchmark. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXXVIII, 550–567. Springer.
- Simultaneous vehicle and lane detection via MobileNetV3 in car following scene. Plos one, 17(3): e0264551.
- Rethinking efficient lane detection via curve modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 17062–17070.
- 3d-lanenet: end-to-end 3d multiple lane detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2921–2930.
- CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains. arXiv preprint arXiv:2206.08083.
- El-gan: Embedding loss driven generative adversarial networks for lane detection. In proceedings of the european conference on computer vision (ECCV) Workshops, 0–0.
- Gen-lanenet: A generalized and scalable approach for 3d lane detection. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXI 16, 666–681. Springer.
- Laneformer: Object-aware Row-Column Transformers for Lane Detection. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, 799–807.
- Learning lightweight lane detection cnns by self attention distillation. In Proceedings of the IEEE/CVF international conference on computer vision, 1013–1021.
- Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detection. arXiv preprint arXiv:2301.02371.
- Key points estimation and point instance segmentation approach for lane detection. IEEE Transactions on Intelligent Transportation Systems, 23(7): 8949–8958.
- Line-cnn: End-to-end traffic line detection with line proposal unit. IEEE Transactions on Intelligent Transportation Systems, 21(1): 248–258.
- Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13, 740–755. Springer.
- Condlanenet: a top-to-down lane detection framework based on conditional convolution. In Proceedings of the IEEE/CVF international conference on computer vision, 3773–3782.
- End-to-end lane shape prediction with transformers. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, 3694–3702.
- One Million Scenes for Autonomous Driving: ONCE Dataset.
- Towards end-to-end lane detection: an instance segmentation approach. In 2018 IEEE intelligent vehicles symposium (IV), 286–291. IEEE.
- Spatial as deep: Spatial cnn for traffic scene understanding. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32.
- Philion, J. 2019. Fastdraw: Addressing the long tail of lane detection by adapting a sequential prediction network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11582–11591.
- Ultra fast structure-aware deep lane detection. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXIV 16, 276–291. Springer.
- Focus on local: Detecting lane marker from bottom up via key point. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14122–14130.
- Structure guided lane detection. arXiv preprint arXiv:2105.05403.
- Scalability in perception for autonomous driving: Waymo open dataset. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2446–2454.
- Keep your eyes on the lane: Real-time attention-guided lane detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 294–302.
- Polylanenet: Lane estimation via deep polynomial regression. In 2020 25th International Conference on Pattern Recognition (ICPR), 6150–6156. IEEE.
- A review of lane detection methods based on deep learning. Pattern Recognition, 111: 107623.
- Tusimple. 2020. Tusimple benchmark https://github.com/TuSimple /tusimple-benchmark/. Accessed.
- End-to-end lane detection through differentiable least-squares fitting. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, 0–0.
- A keypoint-based global association network for lane detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1392–1401.
- RCLane: Relay Chain Prediction for Lane Detection. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXXVIII, 461–477. Springer.
- Once-3dlanes: Building monocular 3d lane detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 17143–17152.
- Keeping the vehicle on the road: A survey on on-road lane detection systems. acm Computing Surveys (CSUR), 46(1): 1–43.
- Deep layer aggregation. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2403–2412.
- Lane Detection Transformer Based on Multi-frame Horizontal and Vertical Attention and Visual Transformer Module. In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXXIX, 1–16. Springer.
- Resa: Recurrent feature-shift aggregator for lane detection. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, 3547–3554.
- Clrnet: Cross layer refinement network for lane detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 898–907.