Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards a safe MLOps Process for the Continuous Development and Safety Assurance of ML-based Systems in the Railway Domain (2307.02867v1)

Published 6 Jul 2023 in cs.SE, cs.AI, cs.LG, cs.SY, and eess.SY

Abstract: Traditional automation technologies alone are not sufficient to enable driverless operation of trains (called Grade of Automation (GoA) 4) on non-restricted infrastructure. The required perception tasks are nowadays realized using Machine Learning (ML) and thus need to be developed and deployed reliably and efficiently. One important aspect to achieve this is to use an MLOps process for tackling improved reproducibility, traceability, collaboration, and continuous adaptation of a driverless operation to changing conditions. MLOps mixes ML application development and operation (Ops) and enables high frequency software releases and continuous innovation based on the feedback from operations. In this paper, we outline a safe MLOps process for the continuous development and safety assurance of ML-based systems in the railway domain. It integrates system engineering, safety assurance, and the ML life-cycle in a comprehensive workflow. We present the individual stages of the process and their interactions. Moreover, we describe relevant challenges to automate the different stages of the safe MLOps process.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. EASA. 2021. European Union Aviation Safety Agency (EASA) Concept Paper: First usable guidance for Level 1 machine learning applications. https://www.easa.europa.eu/en/downloads/134357/en.
  2. EN 50126-1:2018-10. 2018. Railway Applications – The Specification and Demonstration of Reliability, Availability, Maintainability and Safety (RAMS) - Part 1: Generic RAMS Process.
  3. EN 50128:2012-02. 2012. Railway Applications – Communication, signaling and processing systems – Software for railway control and protection systems.
  4. EN 50129:2019-06. 2019. Railway application – Communications, signaling and processing systems – Safety related electronic systems for signaling.
  5. EN 50657:2017-11. 2017. Railways Applications - Rolling stock applications - Software on Board Rolling Stock.
  6. Guidance on the Assurance of Machine Learning in Autonomous Systems (AMLAS). https://arxiv.org/abs/2102.01564.
  7. ISO 21448:2022-06. 2022. Road vehicles - Safety of the Intended Functionality.
  8. ISO 26262-2:2018-12. 2018. Road vehicles – Functional safety – Part 2: Management of functional safety.
  9. The goal structuring notation–a safety argument notation. In Proceedings of the dependable systems and networks 2004 workshop on assurance cases, 6.
  10. A Safety Standard Approach for Fully Autonomous Vehicles. In Romanovsky, A.; Troubitsyna, E.; Gashi, I.; Schoitsch, E.; and Bitsch, F., eds., Computer Safety, Reliability, and Security, 326–332. Springer International Publishing.
  11. Deep learning. nature, 521(7553): 436–444.
  12. Loukides, M. 2012. What is DevOps? O’Reilly Media, Inc.
  13. Organization of machine learning based product development as per ISO 26262 and ISO/PAS 21448. In 2020 IEEE 25th Pacific Rim International Symposium on Dependable Computing (PRDC), 110–119.
  14. Capturing Dependencies Within Machine Learning via a Formal Process Model. In Leveraging Applications of Formal Methods, Verification and Validation. Adaptation and Learning. ISoLA2022. Lecture Notes in Computer Science, vol 13707. Springer, 249–265.
  15. SAE. 1996. ARP 4761: Guidelines and Methods for Conducting the Safety Assessment Process on Civil Airborne Systems and Equipment.
  16. SAE. 2010. ARP 4754A: Guidelines for Development of Civil Aircraft and Systems.
  17. Hidden Technical Debt in Machine Learning Systems. In Cortes, C.; Lawrence, N.; Lee, D.; Sugiyama, M.; and Garnett, R., eds., Advances in Neural Information Processing Systems, volume 28. Curran Associates, Inc.
  18. Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology. Machine Learning and Knowledge Extraction, 3(2): 392–413.
  19. VDE-AR-E 2842-61-2 Anwendungsregel:2021-06. 2021. Development and trustworthiness of autonomous/cognitive systems.
  20. Waschulzik, T. 1999. Qualitätsgesicherte effiziente Entwicklung vorwärtsgerichteter künstlicher Neuronaler Netze mit überwachtem Lernen (QUEEN). Dissertation, Technische Universität München, Fachbereich Informatik.
  21. Quality assured efficient engineering of feedforward neural networks with supervised learning (QUEEN) evaluated with the”pima indians diabetes database”. In Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium, volume 4, 97–102 vol.4.
  22. Safety first for automated driving. https://newsroom.intel.com/wp-content/uploads/sites/11/2019/07/Intel-Safety-First-for-Automated-Driving.pdf.
  23. AI-Blueprint for Deep Neural Networks. In SafeAI@ AAAI.
  24. Zeller, M. 2022. Component Fault and Deficiency Tree (CFDT): Combining Functional Safety and SOTIF Analysis. In Model-Based Safety and Assessment, 146–152. ISBN 978-3-031-15842-1.
Citations (3)

Summary

We haven't generated a summary for this paper yet.