Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Towards Architecting Sustainable MLOps: A Self-Adaptation Approach (2404.04572v1)

Published 6 Apr 2024 in cs.SE

Abstract: In today's dynamic technological landscape, sustainability has emerged as a pivotal concern, especially with respect to architecting Machine Learning enabled Systems (MLS). Many ML models fail in transitioning to production, primarily hindered by uncertainties due to data variations, evolving requirements, and model instabilities. Machine Learning Operations (MLOps) offers a promising solution by enhancing adaptability and technical sustainability in MLS. However, MLOps itself faces challenges related to environmental impact, technical maintenance, and economic concerns. Over the years, self-adaptation has emerged as a potential solution to handle uncertainties. This paper introduces a novel approach employing self-adaptive principles integrated into the MLOps architecture through a MAPE-K loop to bolster MLOps sustainability. By autonomously responding to uncertainties, including data, model dynamics, and environmental variations, our approach aims to address the sustainability concerns of a given MLOps pipeline identified by an architect at design time. Further, we implement the method for a Smart City use case to display the capabilities of our approach.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. K. Costello and M. Rimol, “Gartner identifies the top strategic technology trends for 2021,” 2020.
  2. C. Becker, R. Chitchyan, L. Duboc, S. Easterbrook, B. Penzenstadler, N. Seyff, and C. C. Venters, “Sustainability design and software: The karlskrona manifesto,” in 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, vol. 2, 2015, pp. 467–476.
  3. D. Sculley, G. Holt, D. Golovin, E. Davydov, T. Phillips, D. Ebner, V. Chaudhary, M. Young, J.-F. Crespo, and D. Dennison, “Hidden technical debt in machine learning systems,” Advances in neural information processing systems, vol. 28, 2015.
  4. G. Symeonidis, E. Nerantzis, A. Kazakis, and G. A. Papakostas, “Mlops - definitions, tools and challenges,” in 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC), 2022.
  5. P. Lago, “Architecture design decision maps for software sustainability,” in 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS), 2019, pp. 61–64.
  6. J. Cámara, J. Troya, A. Vallecillo, N. Bencomo, R. Calinescu, B. H. Cheng, D. Garlan, and B. Schmerl, “The uncertainty interaction problem in self-adaptive systems,” Software and Systems Modeling, vol. 21, no. 4.
  7. M. Casimiro, P. Romano, D. Garlan, and L. Rodrigues, “Towards a framework for adapting machine learning components,” in 2022 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS).   IEEE, 2022, pp. 131–140.
  8. J. Kephart and D. Chess, “The vision of autonomic computing,” Computer, vol. 36, no. 1, pp. 41–50, 2003.
  9. S. Shankar, R. Garcia, J. M. Hellerstein, and A. G. Parameswaran, “Operationalizing machine learning,” University of California, Berkeley.
  10. S. Amershi, A. Begel, C. Bird, R. DeLine, H. Gall, E. Kamar, N. Nagappan, B. Nushi, and T. Zimmermann, “Software engineering for machine learning: A case study,” in 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP), 2019, pp. 291–300.
  11. F. Bayram, B. S. Ahmed, E. Hallin, and A. Engman, “A drift handling approach for self-adaptive ml software in scalable industrial processes,” in Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, 2022, pp. 1–5.
  12. M. Casimiro, P. Romano, D. Garlan, G. A. Moreno, E. Kang, and M. Klein, “Self-adaptation for machine learning based systems.” in ECSA (Companion), 2021.
  13. D. A. Tamburri, “Sustainable mlops: Trends and challenges,” in 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), 2020, pp. 17–23.
  14. I. Gerostathopoulos, C. Raibulet, and P. Lago, “Expressing the adaptation intent as a sustainability goal,” in Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ser. ICSE-NIER ’22.   New York, NY, USA: Association for Computing Machinery, 2022, p. 36–40.
  15. N. Nilesh, I. Patwardhan, J. Narang, and S. Chaudhari, “Iot-based aqi estimation using image processing and learning methods,” in 2022 IEEE 8th World Forum on Internet of Things (WF-IoT).   IEEE, 2022, pp. 1–5.
  16. “Uber Michelangelo ML Platform,” 9 2017. [Online]. Available: https://www.uber.com/blog/michelangelo-machine-learning-platform/
  17. A. Metzger, C. Quinton, Z. Á. Mann, L. Baresi, and K. Pohl, “Realizing self-adaptive systems via online reinforcement learning and feature-model-guided exploration,” Computing, 2022.
  18. C. Stevens and H. Bagheri, “Reducing run-time adaptation space via analysis of possible utility bounds,” in Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering.   New York, NY, USA: Association for Computing Machinery, 2020, p. 1522–1534.
  19. S. Kulkarni, A. Marda, and K. Vaidhyanathan, “Towards self-adaptive machine learning-enabled systems through qos-aware model switching,” Proceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering, 2023.
  20. R. Nazir, A. Bucaioni, and P. Pelliccione, “Architecting ml-enabled systems: Challenges, best practices, and design decisions,” Journal of Systems and Software, vol. 207, p. 111860, 2024.

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com